Ph.D. / Postdoctoral / Master’s Expert

• Design and solve challenging STEMs problems to probe the limitations of large language models.
• Create clear, high-quality, step-by-step solutions with well-articulated reasoning.
• Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models typically struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation).
• Help define new evaluation benchmarks based on Physics curricula spanning early undergraduate to PhD-level topics.
• fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills.

• Good research and analytical skills
• Ability to provide constructive feedback and detailed annotations.
• Creative and lateral thinking abilities.
• Excellent structured communication and collaboration skills in a remote setting.
• Self-motivated and able to work independently in a remote setting.
• Desktop/Laptop set up with a good internet connection.
• solid foundation in STEM, particularly at the level expected in engineering entrance exams, as well as graduate or PhD-level programs.
• able to break down complex STEM concepts into simple, clear explanations and work efficiently.

• Candidates currently pursuing a Master’s/Ph.D./Postdoctoral degree in STEM, Applied Physics, or a related field are eligible and encouraged to apply.
• Ability to analyze and solve complex physics problems with a structured and logical approach.
• Ability to explain STEM concepts clearly using simple language, visuals, and physics reasoning.

RequiredAlso useful

Also listed: critical thinking, problem solving, analytical skills, communication.

Project and contracting process: Turing. Applications continue on the provider's website.