Physics Researcher for AI Model Evaluation [Remote]
$80 - $140 per hourSaidGig
Remote
- Remote job
Role Overview
Join a pioneering effort in physics research by authoring and verifying golden reference solutions for the CritPt benchmark. This role involves solving complex research-level physics problems, auditing expert solutions, and adjudicating between parallel attempts, all to produce fully human-verified reference data that evaluates large language models on advanced physics reasoning.
Physics Subdomains Covered- High Energy Physics & Mathematical Physics
- Biophysics & Statistical Physics
- Condensed Matter & AMO
- Gravitation / Cosmology / Astrophysics
- Quantum Information
- Optical Properties of Materials
- Magnetic Materials
- Measurements in Quantum Mechanics
- Solve research-level physics challenges end-to-end with verifiable derivations, code, and peer-reviewed references.
- Decompose challenges into standalone checkpoint sub-problems that require genuine physical reasoning.
- Author Python answer templates with auto-grading functions for symbolic or numerical answers.
- Audit submitted solutions for correctness, scope, and method soundness; deliver actionable feedback across iterations.
- Adjudicate between parallel solver attempts and decide which solution becomes the golden reference.
- Document chain-of-thought reasoning, error tolerances, equivalent symbolic forms, and verification test cases.
- Solver: PhD or postdoc in the relevant subfield (senior PhD student minimum).
- Auditor: Postdoc or junior professor in the relevant subfield (PhD minimum).
- Adjudicator: Full professor or industry research PI in the relevant subfield (senior postdoc or junior professor minimum).
- Hands-on familiarity with at least two canonical methods of the target subfield, demonstrable through publications (broader coverage strongly preferred).
- 3, 5 representative publications (arXiv ID or DOI), ideally within the last ~5 years and in the target subfield.
- Working proficiency with LaTeX, Python, Jupyter, and SymPy.
- Strong written English (B2/C1/C2 minimum; native or near-native preferred).
- Expected commitment: ~10 hours/week, sustained across an 8, 10 week window per task pool.
- Pay range: $80, $140 per hour, based on role and demonstrated expertise.
- Asynchronous work.
Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Physics Researcher for AI Model Evaluation [Remote] in Remote vacancy
$40 per hour
DataAnnotation is seeking a Postdoctoral Researcher in Arizona to train AI models by evaluating chatbot outputs and solving complex physics-based logic problems. The ideal candidate will hold a PhD and possess expertise in classical mechanics, E&M, thermodynamics, and...SuggestedRemote jobHourly payFlexible hours- ...technology company is seeking an R&D Physicist to evaluate the performance of AI chatbots by assessing complex physics outputs. This role necessitates a strong grasp... ...tasks including measuring AI logic and improving model quality. While a Bachelor’s degree in a relevant...SuggestedRemote jobHourly pay
$40 per hour
...Theoretical Physicist to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the... ...you will need to hold an expert understanding of physics. Other related fields include, but are not...SuggestedRemote jobHourly payFull timeContract workPart time- ...technology firm is seeking an R&D Physicist to join their team remotely. The role involves training AI models, measuring their performance, and evaluating their outputs regarding physics-related tasks. Candidates should have a strong understanding of physics and excellent...SuggestedRemote jobHourly pay
- ...Expert Network to connect with leading AI labs and companies seeking your... ...15-30 hours per week. Training and evaluating AI models in physics Creating tasks and deliverables based... ...specific feedback to advance frontier AI research What We’re Looking For Professional...SuggestedRemote jobContract work
$40 per hour
A technology company is seeking a Postdoctoral Physics Associate to join their team. In this remote role, you will train AI models, measure their progress, and evaluate their performance in solving complex physics problems. Applicants should have a PhD in Physics or a related...Remote jobHourly payFlexible hours$50 per hour
...fine-tuning large language models, utilizing strong... ...Leverage a solid foundation in Physics, particularly at the level... ...insights into leveraging AI to enhance analytical... ...Collaborate with LLM researchers to align problems with evaluation goals, particularly in areas...Remote jobContract workFor contractorsFreelance$50 per hour
...fine-tune large language models (like ChatGPT) using your... ...have a solid foundation in Physics, particularly at the... ...you learn how to leverage AI to be a better analyst. This... ...Collaborate with LLM researchers to align problems with evaluation goals, especially in areas...Remote jobContract workFor contractorsFreelance$40 per hour
A leading AI research company is seeking a Postdoctoral Researcher in New York to train AI models by evaluating their performance and logic. This role offers the flexibility of choosing... ...field and a strong understanding of physics concepts. The position is remote with competitive...Remote jobHourly pay$40 per hour
DataAnnotation is seeking a Scientific Researcher (Physics) to help train AI models by evaluating their outputs on complex physics problems. This role allows flexibility as you choose your projects from home. The ideal candidate should have a solid understanding of classical...Remote jobHourly pay$40 per hour
DataAnnotation is seeking a Postdoctoral Associate in Mathematics to contribute to AI model training. The role entails evaluating AI chatbots by providing diverse mathematical challenges and assessing their logical outputs. This position allows for flexibility as it’s...Remote jobHourly payFull timePart time- A tech company is seeking a Postdoctoral Researcher to evaluate AI chatbots and improve their performance. This role is remote and can be part-time... ...to work on. Candidates must have a strong understanding of physics, particularly classical mechanics and thermodynamics, and a...Remote jobHourly payFull timePart time
$40 per hour
DataAnnotation is seeking an existing Scientific Researcher (Physics) in the United States to assist in training AI models. Responsibilities include giving AI chatbots complex physics problems, evaluating their logic, and improving model quality. This role allows you to...Remote jobHourly pay$40 per hour
A technology firm seeks a Graduate Physics Research Intern to improve AI models by evaluating their outputs and solving complex physics problems. This role is remote, allowing you to manage your own schedule and select projects that interest you. Applicants should have...Remote jobHourly payInternship$40 per hour
DataAnnotation is seeking an experienced Scientific Researcher (Physics) to evaluate AI chatbot performance and improve model quality. The role allows you to work on your own schedule from home. Applicants should have a strong understanding of physics, especially in classical...Remote jobHourly pay$40 per hour
A leading tech firm is seeking experienced quantitative professionals to evaluate AI-generated analyses and enhance AI development. The role offers the flexibility of remote work with competitive pay starting at $40+ per hour. Candidates should have experience in data science...Remote jobHourly pay$40 per hour
A tech-focused company is seeking experienced quantitative professionals to evaluate AI-generated analysis and provide technical feedback. This remote role allows you to choose your schedule and work from various countries including the US. Ideal candidates will have a...Remote jobHourly pay$40 per hour
...experienced professionals to join their team. In this remote role, you will evaluate AI-generated security content, solve technical cybersecurity issues, and provide vital feedback to enhance AI models. Candidates should have at least 2 years of hands-on experience in...Remote jobHourly payFlexible hours$60 per hour
An innovative AI development company is seeking experienced quantitative professionals to evaluate AI-generated analyses and contribute to the advancement of AI systems. This role offers the flexibility of remote work, competitive pay of up to $60 per hour, and the opportunity...Remote jobHourly pay$40 per hour
A dynamic AI development company is seeking experienced quantitative professionals in Georgia to evaluate AI-generated work and provide vital feedback. This role is fully remote, allowing candidates from various countries to contribute flexibly. Ideal applicants will have...Remote jobHourly pay$50 - $100 per hour
Dataannotation is looking for quantitative professionals to evaluate AI-generated analyses and help train cutting-edge AI models. This independent contractor role offers flexibility in project selection and payment at rates starting from $50-$100+ per hour. The ideal candidate...Remote jobHourly payFor contractors$40 per hour
A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This role is flexible, allowing you to choose your projects and work from anywhere. Ideal candidates should have at least...Remote jobHourly payFlexible hours$60 per hour
A leading AI systems company is looking for experienced quantitative professionals to help validate AI-generated analyses. This fully... ...in a quantitative field preferred. Responsibilities include evaluating AI outputs, designing quantitative problems, and providing impactful...Remote job$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analysis and shape future AI systems. The role offers fully remote work with a flexible schedule and competitive pay starting at $40+ per hour. Candidates should...Remote jobHourly payFlexible hours$40 per hour
A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and improve AI systems. Candidates should have 2+ years in cybersecurity, including roles like penetration testing and incident response. The position offers flexible hours...Remote jobHourly payFlexible hours$50 - $60 per hour
A technology company specializing in AI is looking for an Anesthesiologist to join their team remotely. This role involves evaluating AI chatbots and ensuring their medical accuracy. Candidates must have a medical degree, and fluency in English is required. The position...Remote jobHourly payFull timePart time$40 per hour
A leading technology company is seeking experienced cybersecurity professionals to help train AI models. In this remote role, you will evaluate AI-generated security content and solve technical cybersecurity problems. Candidates must have 2+ years of hands-on experience...Remote jobHourly pay$150 per hour
Modern MedEd is hiring Psychiatry experts to design clinical scenarios and evaluate AI-generated model outputs in healthcare. This role requires board certification and offers remote, flexible participation at a rate of $150-$350/hr based on experience. Responsibilities...Remote jobFlexible hours- An innovative AI training company is seeking a Biology Instructor to assess and enhance AI models by evaluating their responses to complex biology questions. The ideal candidate will possess expert-level knowledge in biology and related fields such as biochemistry. This...Remote jobHourly payContract workFlexible hours
$40 per hour
A leading AI development firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical cybersecurity problems. The role allows for flexible hours and the option to work from various countries, including the US. Ideal...Remote jobHourly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physics Researcher for AI Model Evaluation [Remote]. Be the first to apply!
