Physicist for AI Model Evaluation [Remote]

Role Overview:

• In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills.
• The ideal candidate should have a solid foundation in Physics, particularly at the level expected in engineering entrance exams, as well as graduate or PhD-level programs.
• You should be able to break down complex Physics concepts into simple, clear explanations and work efficiently.
• The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!

Key Responsibilities:

• Design and solve challenging Physics problems to probe the limitations of large language models.
• Create clear, high-quality, step-by-step solutions with well-articulated reasoning.
• Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models typically struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation).
• Help define new evaluation benchmarks based on Physics curricula spanning early undergraduate to PhD-level topics.

Qualifications:

• Analytical Skills: Good research and analytical skills.
• Feedback Skills: Ability to provide constructive feedback and detailed annotations.
• Creative Thinking: Creative and lateral thinking abilities.
• Communication: Excellent structured communication and collaboration skills in a remote setting.
• Independence: Self-motivated and able to work independently in a remote setting.
• Technical Setup: Desktop/Laptop set up with a good internet connection.

Preferred Qualifications:

• Candidates currently pursuing a Master’s/Ph.D./Postdoctoral degree in Physics, Applied Physics, or a related field are eligible and encouraged to apply.
• Ability to analyze and solve complex physics problems with a structured and logical approach.
• Ability to explain physics concepts clearly using simple language, visuals, and physics reasoning.

Work Terms:

• Engagement type: Contractor assignment/freelancer (no medical/paid leave)

Compensation:

• Details regarding compensation will be discussed during the application process.

Perks of Freelancing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.
• Potential for contract extension based on performance and project needs.