AI Evaluation Scientist (PhD) — Math & Frontiers Benchmarking
Mercor
Mercor is seeking PhD and Master’s scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will source material, craft executable problems, and build the grading criteria to measure model performance on challenging scenarios. You will calibrate prompts against frontier models, ensuring tasks remain difficult where state-of-the-art systems struggle, across two subdomains with a coding focus. #J-18808-Ljbffr Mercor
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist (PhD) — Math & Frontiers Benchmarking in Miami, FL vacancy
- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific computing. You will author original... ...research problems that today's frontier models cannot solve. Domains -...For phdPart timeImmediate start
$70 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... .... Position: Mathematics PhD Coding Experts Type: Contract... ...answers. Calibrate tasks against frontier models, ensuring tasks ship...For phdContract workSummer workImmediate startRemote work$80 - $110 per hour
...the work CritPt is a public benchmark of research-level physics challenges... ..., built to test whether frontier AI models can carry out genuine... ...expansions Who we are looking for A PhD in mathematical physics,... ...researchers, research scientists and junior faculty are the strongest...For phdHourly payImmediate startRemote work10 hours per week$80 - $110 per hour
...the work CritPt is a public benchmark of research-level physics challenges... ..., built to test whether frontier AI models can carry out genuine... ...models Who we are looking for A PhD in gravitation, cosmology,... ...researchers, research scientists and junior faculty are the strongest...For phdHourly payImmediate startRemote work10 hours per week- ...against real market outcomes rather than benchmarks or human raters. The firm trades at a... ...models for domain-specific tasks \n Build evaluation that measures what matters, not what is... ...\n \n \n PREFERRED: \n \n A PhD or Master's in machine learning, computer...For phdContract workRemote workShift work
Thurn Partners
Miami, FL13 days ago - ...Company Intro At Toloka AI we create data that powers leading... ...and innovations. We work with frontier labs, big tech, renowned AI... ...teach AI models to reason and evaluate their efficacy and safety. We... ...models). Advanced degree (MSc/PhD) in AI, CS, or a related field...For phdFull timeFor contractorsRemote workWorldwideFlexible hours
Toloka
Miami, FL1 day ago $85 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Francisco, our investors include Benchmark , General Catalyst , Peter... ...Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure...Contract workSummer workRemote workMercor
Miami, FL12 days ago- ...ambitious experiments and push the frontier Skills and Preferred... ...regimes on the job Masters or PhD degree in mathematics,... ...measurable impact Strong math fundamentals (linear algebra, probability... ...compute, machine learning and AI to power our analytics and...For phd
Citadel
Miami, FL17 hours ago $80 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Position: Mathematical Physicist (PhD) Type: Contract... ...peers to create problems and evaluate AI model performance in physics...For phdContract workSummer workRemote work- ...Data Scientist (Masters) - AI Data Trainer About the Role What if your... ...serve as the definitive benchmark for AI responses Audit AI... ...Generated Code : Critically evaluate AI outputs - including code... ...or holding a Master's or PhD in Data Science, Statistics...For phdHourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
Miami, FL4 days ago - ...located in Miami, FL, for a Senior AI/ML Engineer specializing in... ...on neural networks, and evaluating model performance. Additionally... ...Collaborate with product managers, data scientist, and software engineers to... ...graduate degree (Master's or PhD preferred) in Computer Science...For phdFull timeFlexible hours
Dealer Automation Technologies
Miami, FL4 days ago $120 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...Statistical Bioinformatics Expert (PhD) Type: Contract... ...with a multidisciplinary team of scientists and AI research specialists...For phdContract workSummer workRemote workMercor
Miami, FL12 days ago- ...at the core of how the next generation of AI models learns to work in spreadsheets. 1.... ...write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide... ...Teaching or training experience and/or a PhD is a strong plus. Prior experience in AI...For phdContract workWeekday work
- ...0 countries, and we believe that scaling AI responsibly is what makes it durable. Technology... ...and data governance, privacy, safety evaluations, and human oversight, and build these... ...the ground upYou have a Master's degree or PhD in a relevant field such as Computer...For phdFull timeWork experience placementLive inWork at officeLocal area
Accenture
Miami, FL9 hours ago - ...Applied AI Engineer Shape the future of defense with MANTECH! Join a team dedicated... ...streams, and automating continuous training and evaluation workflows across mission networks.... ...more years of relevant experience OR a PhD and 1+ or more years of relevant experience...For phdWork at officeLocal area
ManTech
Miami, FL4 days ago - ...About the RoleWe’re looking for an Applied Scientist to work on some of the hardest... ...definition and training through deployment, evaluation, and iteration, with a strong foundation... ...business partners.An advanced degree (MS or PhD preferred) in statistics, economics,...For phd
Opendoor
Miami, FL1 day ago $110.7k - $372.9k
...Summary Senior Agentic AI Engineer — Healthcare AI... ...the right time. Reliability, evaluation & safety • Implement observability... ...unreliable outputs. We pair frontier AI research with production-grade... ...current with AI research, benchmarks, and emerging engineering...Local areaVisa sponsorshipDeloitte
Miami, FL1 day ago- ...peers during the summer program. Key work includes developing valuation models, back-testing trading strategies, and turning mathematical insights into code (Python/R/C++). Strong math background and data-driven mindset are essential. #J-18808-Ljbffr Citadel SecuritiesFor phdSummer workInternship
- ...statisticians. Responsibilities include data management, modeling, and contributing to publications. Requirements include a Master’s in Biostatistics or related field, with PhD preferred, and at least seven years of relevant experience. #J-18808-Ljbffr University of MiamiFor phdFull time
$176k - $179.5k
...be on the global Life Sciences AI team, fully integrated with... ...by McKinsey, as a Senior Data Scientist, building AI that transforms Pharma... ...models, design agentic flows, evaluate agentic outputs, write... ...experience.Your backgroundMaster’s or PhD level in a discipline such as...For phdApprenticeshipWorldwideEasy workMcKinsey & Company
Miami, FL1 day ago- ...motivated, career and customer-oriented Data Scientist to join our team in Doral, FL.... ...findings to decision-makers.Conducting model evaluation, baseline testing, and continuous optimization... ...more years of relevant experience.OR a PhD and 1+ or more years of relevant...For phdWork at office
Hackajob
Miami, FL1 day ago $58.49k - $76.04k
...Mater's degree of Science is a minimum requirement, candidates with PhD and MD degrees (especially those who completed their residency... ...Candidates must be highly organized with strong analytical, research, math and statistical skills as well has had previous experience...For phd- ...generalists. Responsibilities: Build, train, evaluate, and deploy computer vision and... ...their accuracy on our tasks Develop and benchmark high-performance image retrieval... ...inference and business constraints BS, MS, or PhD in Computer Science or a related...For phdRemote workFlexible hours
Clearview AI
Miami, FL1 day ago - ...distributed — by humans and AI agents alike. As AI agents begin... ...investment methodologies, evaluate evidence, and continuously improve... ...evaluation frameworks, benchmarking, and continuous experimentation... ...experiences. Stay at the frontier of modern AI, rapidly evaluating...Full timeRemote workFlexible hours
Tilt
Miami, FL2 days ago $210k - $250k
...but not limited to, site identification, evaluation and training, recruitment, and... ...Qualifications and Experience: MD, PharmD, PhD, DO, NP, PA, MS-CGC or other advanced scientific... ...location, and external market benchmarks. Pay Range $210,000 - $250,000 USD...For phdNight shiftKiniksa Pharmaceuticals
Miami, FL1 day ago$125k - $187k
...and outcomes. As a Senior Data Scientist on the Utility team in... ...of 3 years of experience; or a PhD without experience Loves thought... ...including offline and online evaluation Experience with optimization... ...a resume for that opening. AI Notice Indeed is committed...For phdTemporary workWork experience placementLocal areaIndeed
Miami, FL3 days ago$58.49k - $70k
...Mater‘s degree of Science is a minimum requirement, candidates with PhD and MD degrees (especially those who completed their residency... ...Candidates must be highly organized with strong analytical, research, math and statistical skills as well has had previous experience...For phd- ...Graduate student (MS or PhD, returning to your... ...the next generation of AI products will not be defined... ...Counterfactual evaluation Credit assignment over... ...Safety and reliability benchmarks What we're looking for... ...modern infrastructure, frontier models, and substantial...For phdRemote jobInternshipLocal areaFlexible hours
Block
Miami, FL4 days ago - ...Serve as a key contact for our media agency (PHD), reviewing and challenging... ...OTT, OLV, Social, Audio, Search, and OOH. Evaluate media plans with a critical eye—identifying... ...allocation and market‑specific performance benchmarks. What We’re Looking For 5+ years of experience...For phdWork at officeLocal areaShift work
$150k - $250k
...the team. 3Red Partners is committed to leveraging technology and math to implement competitive trading strategies. Our team has... ...existing trades and signals Your skills: A Bachelor’s, Master’s, or PhD degree with an emphasis in a STEM related field (e.g. Mathematics...For phdWork experience placementCasual work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist (PhD) — Math & Frontiers Benchmarking. Be the first to apply!
