Physics Researcher for AI Model Evaluation
$80 - $135 per hourSaidGig
Role Overview
Join a cutting-edge initiative to develop and verify golden reference solutions for the CritPt benchmark, a leading research-level physics benchmark. This role involves solving complex physics problems, auditing peer solutions, and producing fully human-verified reference data that will be instrumental in evaluating large language models on advanced physics reasoning.
Physics Subdomains CoveredThe role encompasses various subdomains including:
- High Energy Physics & Mathematical Physics
- Biophysics & Statistical Physics
- Condensed Matter & AMO
- Gravitation / Cosmology / Astrophysics
- Quantum Information
- Optical Properties of Materials
- Magnetic Materials
- Measurements in Quantum Mechanics
- Solve research-level physics challenges end-to-end, providing verifiable derivations, code, and peer-reviewed references.
- Decompose complex challenges into standalone checkpoint sub-problems requiring genuine physical reasoning.
- Author Python answer templates with auto-grading functions for symbolic or numerical answers.
- Audit submitted solutions for correctness, scope, and methodological soundness, delivering actionable feedback throughout the process.
- Adjudicate between parallel solver attempts to determine which solution will be designated as the golden reference.
- Document reasoning processes, error tolerances, equivalent symbolic forms, and verification test cases.
- Solver: PhD or postdoc in the relevant subfield (senior PhD student minimum).
- Auditor: Postdoc or junior professor in the relevant subfield (PhD minimum).
- Adjudicator: Full professor or industry research PI in the relevant subfield (senior postdoc or junior professor minimum).
- Hands-on familiarity with at least two canonical methods of the target subfield, demonstrated through publications (broader coverage strongly preferred).
- 3, 5 representative publications (arXiv ID or DOI), ideally within the last ~5 years and in the target subfield.
- Working proficiency with LaTeX, Python, Jupyter, and SymPy.
- Strong written English skills (B2/C1/C2 minimum; native or near-native preferred).
- Expected commitment: ~10 hours/week, sustained across an 8, 10 week window per task pool.
- Pay range: $80, $135 per hour, based on role and demonstrated expertise.
- Asynchronous work environment.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Physics Researcher for AI Model Evaluation in United States vacancy
$40 per hour
A leading AI training company is seeking a Scientific Researcher in Physics to evaluate AI chatbots by providing them with complex physics problems. The ideal candidate should... ...and effectively assess the outputs of the models for accuracy. This position offers flexible...SuggestedRemote jobHourly payWork from homeFlexible hours$40 per hour
DataAnnotation is seeking a Postdoctoral Researcher in Arizona to train AI models by evaluating chatbot outputs and solving complex physics-based logic problems. The ideal candidate will hold a PhD and possess expertise in classical mechanics, E&M, thermodynamics, and...SuggestedRemote jobHourly payFlexible hours- ...technology company is seeking an R&D Physicist to evaluate the performance of AI chatbots by assessing complex physics outputs. This role necessitates a strong grasp... ...tasks including measuring AI logic and improving model quality. While a Bachelor’s degree in a relevant...SuggestedRemote jobHourly pay
$40 per hour
...Theoretical Physicist to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the... ...you will need to hold an expert understanding of physics. Other related fields include, but are not...SuggestedRemote jobHourly payFull timeContract workPart time- ...technology firm is seeking an R&D Physicist to join their team remotely. The role involves training AI models, measuring their performance, and evaluating their outputs regarding physics-related tasks. Candidates should have a strong understanding of physics and excellent...SuggestedRemote jobHourly pay
$40 per hour
A technology company is seeking a Postdoctoral Physics Associate to join their team. In this remote role, you will train AI models, measure their progress, and evaluate their performance in solving complex physics problems. Applicants should have a PhD in Physics or a related...Remote jobHourly payFlexible hours$40 per hour
DataAnnotation is seeking a Physics Data Analyst based in Tennessee. In this role, you will be responsible for evaluating AI chatbots by providing them with complex physics problems and measuring their outputs. A strong grasp of classical mechanics and related physics...Remote jobHourly payWork from home$50 per hour
...fine-tune large language models (like ChatGPT) using your... ...have a solid foundation in Physics, particularly at the... ...you learn how to leverage AI to be a better analyst. This... ...Collaborate with LLM researchers to align problems with evaluation goals, especially in areas...Remote jobContract workFor contractorsFreelance$70 - $100 per hour
...Join a leading AI lab’s cutting-edge research team to be at the core of the AI revolution, where your... ...advanced LLMs. 1. Role Overview Advanced Physics Researchers and PhD Students are... ...to a project supporting a frontier-model evaluation effort focused on physics reasoning...Remote jobWork at office$40 per hour
DataAnnotation is seeking a Scientific Researcher (Physics) to help train AI models by evaluating their outputs on complex physics problems. This role allows flexibility as you choose your projects from home. The ideal candidate should have a solid understanding of classical...Remote jobHourly pay$40 per hour
A leading AI research company is seeking a Postdoctoral Researcher in New York to train AI models by evaluating their performance and logic. This role offers the flexibility of choosing... ...field and a strong understanding of physics concepts. The position is remote with competitive...Remote jobHourly pay$40 per hour
DataAnnotation is seeking an existing Scientific Researcher (Physics) in the United States to assist in training AI models. Responsibilities include giving AI chatbots complex physics problems, evaluating their logic, and improving model quality. This role allows you to...Remote jobHourly pay- A tech company is seeking a Postdoctoral Researcher to evaluate AI chatbots and improve their performance. This role is remote and can be part-time... ...to work on. Candidates must have a strong understanding of physics, particularly classical mechanics and thermodynamics, and a...Remote jobHourly payFull timePart time
$40 per hour
DataAnnotation is seeking a Postdoctoral Associate in Mathematics to contribute to AI model training. The role entails evaluating AI chatbots by providing diverse mathematical challenges and assessing their logical outputs. This position allows for flexibility as it’s...Remote jobHourly payFull timePart time$40 per hour
A technology firm seeks a Graduate Physics Research Intern to improve AI models by evaluating their outputs and solving complex physics problems. This role is remote, allowing you to manage your own schedule and select projects that interest you. Applicants should have...Remote jobHourly payInternship$40 per hour
DataAnnotation is seeking an experienced Scientific Researcher (Physics) to evaluate AI chatbot performance and improve model quality. The role allows you to work on your own schedule from home. Applicants should have a strong understanding of physics, especially in classical...Remote jobHourly pay$40 per hour
A cybersecurity technology company seeks experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. Candidates should have over 2 years of practical cybersecurity experience in areas like penetration testing and incident...Remote jobHourly payFlexible hours$40 per hour
A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and improve AI systems. Candidates should have 2+ years in cybersecurity, including roles like penetration testing and incident response. The position offers flexible hours...Remote jobHourly payFlexible hours$50 - $75 per hour
A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in...Hourly payContract work- An innovative AI training company is seeking a Biology Instructor to assess and enhance AI models by evaluating their responses to complex biology questions. The ideal candidate will possess expert-level knowledge in biology and related fields such as biochemistry. This...Remote jobHourly payContract workFlexible hours
$50 - $60 per hour
A technology company specializing in AI is looking for an Anesthesiologist to join their team remotely. This role involves evaluating AI chatbots and ensuring their medical accuracy. Candidates must have a medical degree, and fluency in English is required. The position...Remote jobHourly payFull timePart time$40 per hour
...leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity... ...and fluency in English. Contribute to innovative AI models while working on impactful projects from anywhere in the U.S.,...Remote jobHourly payFlexible hours$40 per hour
DataAnnotation is looking for a Postdoctoral Biology Associate to help train AI models. You will evaluate AI chatbots' responses to complex biology questions and assess their outputs. The role requires expertise in biology and may also involve related fields such as biochemistry...Remote jobHourly payFor contractorsWork from home$50 - $60 per hour
DataAnnotation is seeking a Staff Accountant in the United States to help train AI models. You will leverage your finance expertise to evaluate AI outputs and improve quality in a remote setting. Ideal candidates have advanced degrees in finance and relevant experience....Remote jobHourly payContract workFor contractors- ...cybersecurity technology firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity... ...and providing feedback to shape future AI security models. Ideal candidates should have over 2 years of hands-on cybersecurity...Remote jobFull timePart time
$40 per hour
A leading AI development firm seeks experienced quantitative professionals to evaluate AI-generated analyses and solve quantitative problems. This fully remote position allows you to work from anywhere in the US and offers flexibility in scheduling. Ideal candidates will...Remote jobHourly pay$40 per hour
A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated analyses and design quantitative challenges for AI systems. This role allows for fully remote work from locations including the US and Canada. Candidates should have...Remote jobHourly payFlexible hours- A technology firm in Pennsylvania is seeking a Physics Expert to train AI models by providing complex physics challenges and evaluating the outputs of these AI chatbots. You must have an expert-level knowledge of physics, particularly in areas like classical mechanics...Remote jobHourly payFlexible hours
$40 per hour
A leading AI development company is seeking experienced quantitative professionals to join their remote team. The role involves evaluating AI-generated work, designing quantitative problems, and providing impactful feedback. Candidates with at least 2 years of quantitative...Remote jobHourly pay$40 per hour
A cybersecurity-focused technology company is looking for experienced professionals to evaluate AI-generated security content and solve technical problems. The role allows for flexible hours and remote work, offering competitive pay starting at $40 per hour. Ideal candidates...Remote jobHourly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physics Researcher for AI Model Evaluation. Be the first to apply!
Related searches