AI Evaluation Scientist (PhD) Math & Frontiers Benchmarking
Mercor Inc
Mercor is seeking PhD and Master’s scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will source material, craft executable problems, and build the grading criteria to measure model performance on challenging scenarios.
You will calibrate prompts against frontier models, ensuring tasks remain difficult where state-of-the-art systems struggle, across two subdomains with a coding focus.
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist (PhD) Math & Frontiers Benchmarking in Doral, FL vacancy
$80 - $110 per hour
...work CritPt is a public benchmark of research-level physics challenges... ..., built to test whether frontier AI models can carry out genuine... ...Who we are looking for A PhD in gravitation, cosmology, astroparticle... ...researchers, research scientists and junior faculty are the...For phdHourly payImmediate startRemote work10 hours per weekMercor Inc
Doral, FL5 days ago- ...sure to apply today.At Toloka AI we create data that powers leading... ...and innovations. We work with frontier labs, big tech, renowned AI... ...teach AI models to reason and evaluate their efficacy and safety. We... ...models).Advanced degree (MSc/PhD) in AI, CS, or a related field...For phdFor contractorsRemote workWorldwideFlexible hours
Toloka
Doral, FL1 day ago $15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work... ..., from generating training data to evaluating the performance of models. About the opportunity... ...and feedback loop, your work helps turn frontier research into AI that performs better in...For phdHourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shiftScale AI
Hialeah, FL1 day ago- ...against real market outcomes rather than benchmarks or human raters. The firm trades at a... ...models for domain-specific tasks Build evaluation that measures what matters, not what is... ...to work in the US PREFERRED: A PhD or Master's in machine learning, computer...For phdContract workRemote workShift work
Thurn Partners
Doral, FL1 day ago - ...at the core of how the next generation of AI models learns to work in spreadsheets. 1... ...write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide... ...Teaching or training experience and/or a PhD is a strong plus. Prior experience in AI...For phdContract workWeekday work
Mercor Inc
Doral, FL3 days ago $15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work... ..., from generating training data to evaluating the performance of models. About the opportunity... ...and feedback loop, your work helps turn frontier research into AI that performs better in...For phdHourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shiftScale AI
Hialeah, FL1 day ago$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work... ..., from generating training data to evaluating the performance of models. About the opportunity... ...and feedback loop, your work helps turn frontier research into AI that performs better in...For phdHourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shiftScale AI
Hialeah, FL3 days ago- ...Alignerr is seeking aPopulation Health Informaticist to help evaluate and improve AI systems analyzing large-scale health data. This fully remote, hourly contract role offers flexible hours (10–40 per week) and collaboration with world-leading AI teams.You'll shape how...Hourly payContract workRemote workFlexible hours
Alignerr Corp.
Doral, FL1 day ago - ...Serve as a key contact for our media agency (PHD), reviewing and challenging... ...OTT, OLV, Social, Audio, Search, and OOH. Evaluate media plans with a critical eye—identifying... ...allocation and market‑specific performance benchmarks. What We’re Looking For 5+ years of experience...For phdWork at officeLocal areaShift work
3129 Tim Hortons USA Inc.
Doral, FL1 day ago - ...with portfolio managers and developers to improve how we generate, evaluate, and deploy trading signals. The focus is not just building... ...statistical research applied to real-world or time-series data problems PhD (or equivalent experience) in Mathematics, Statistics, Physics,...For phd
Eka Finance
Doral, FL3 days ago $186.01k - $279.02k
...scientific foundation for clinical AI evaluation and deployment. This... ...environments, direct a team of scientists and engineers, and establish... ...including test harnesses, benchmarks, failure taxonomies, and monitoring... ...Requirements ~ PhD in Machine Learning, Computer...For phd- ...Physicists, responsible for the design optimization, technical evaluation, and precise and accurate delivery of radiation plans, and responsible... .... Additional Qualifications: Masters Degree, DMP or PhD in medical physics from an accredited College or University....For phd
Proton Therapy
Doral, FL4 days ago - ...LLC is seeking a Chemistry SME to join a leading AI lab's research team and help build foundational... ..., design multi-step synthesis tasks, evaluate AI outputs, and help ensure data quality and chemical validity. A PhD in chemistry and 3+ years of hands-on experience...For phdPart time
Mercor Inc
Doral, FL2 days ago - ...platform with the neuro-biotech ecosystem. Candidates should have a PhD in a relevant field and significant experience in biotech/... ...scientific and business development responsibilities, including evaluating CNS technologies and managing strategic partnerships. With a...For phdRemote work
INSIGHTEC
Doral, FL4 days ago $150k
...solutions. Tech Advisory & Delivery Senior AI Tech Consultants at BCG Platinion are:... .../ LLM cost optimization and FinOps. IT Benchmarking and recommendations for IT cost take-out... ...a functional domain. Supporting vendor evaluations and platform assessments for AI product...Work at officeLocal areaBoston Consulting Group
Doral, FL3 days ago$4,500 - $5,800 per week
...data sets, including unconventional and unstructured data sources Back-test models and document research findings Your Skills & Talents PhD degree in mathematics, statistics, physics, computer science, or another highly quantitative field Advanced training and a strong...For phdInternshipCitadel
Doral, FL4 days ago$4,500 - $5,800 per week
...to leverage and tailor the state-of-the-art machine learning and AI algorithms to modernize the quantitative trading industry. We’re... ...test models and document research findings Your Skills & Talents PhD degree in mathematics, statistics, physics, computer science, or...For phdInternshipFlexible hoursCitadel Securities
Doral, FL4 days ago- ...psychometrists, postdocs, or practicum students if desired Qualifications PhD or PsyD in Clinical Psychology or Neuropsychology Completion of... ...conducting and interpreting adult neuropsychological evaluations (pediatric experience a plus) Strong telehealth communication...For phdDaily paidFull timeContract workPart timeInternshipRemote workFlexible hours
Integrated Psych Solutions
Doral, FL1 day ago $4,500 - $5,800 per week
...systems Partner with the Quantitative Research team to define priorities and deliver custom software solutions Your Skills & Talents PhD degree in computer science, mathematics, statistics, physics, or another highly quantitative field Strong programming skills with proficiency...For phdInternshipFlexible hoursCitadel
Doral, FL4 days ago- ...architects, and project leaders to guide system design and deployment. Evaluating legacy IT systems, cloud architectures, and emerging... ...master’s degree and 3 or more years of relevant experience OR a PhD and 1 or more years of relevant experience OR an associate’s degree...For phdWork at office
ManTech
Doral, FL1 day ago - ...interface issues. Conducting root-cause analysis, system diagnostic evaluations, and performance troubleshooting across integrated platforms.... ...’s degree and 3 or more years of relevant experience OR a PhD and 1 or more years of relevant experience OR an associate’s degree...For phdWork at office
ManTech
Doral, FL1 day ago $4,500 - $5,800 per week
...refine monetization systems for trading signals Your Skills & Talents PhD degree in mathematics, statistics, physics, computer science, or... ...and the accelerating power of compute, machine learning and AI to power our analytics and tackle the market's and our clients' most...For phdInternshipFlexible hoursCitadel Securities
Doral, FL5 days ago$4,500 - $5,800 per week
...innovation Conduct research and statistical analysis to build and refine monetization systems for trading signals Your Skills & Talents PhD degree in mathematics, statistics, physics, computer science, or another highly quantitative field Strong knowledge of probability...For phdInternshipFlexible hoursCitadel
Doral, FL4 days ago- ...see your models shape real trading outcomes rather than sit in a benchmark, and want to do that work alongside people who've made that same... .... At least 6 years working in the software industry. A PhD or Master's degree in computer science, machine learning, statistics...For phdImmediate start
Thurn Partners Ltd
Doral, FL3 days ago - ...education and training of new physicians.* Assist radiologists and PhD's in developing new protocols and Ultrasound imaging techniques... ...Assist radiologist with interventional Ultrasound procedures.* Evaluate Ultrasound scans for technical quality, collate processed images...For phdTemporary workWork at office
University of Miami
Doral, FL5 days ago - ...Graduate student (MS or PhD, returning to your... ...the next generation of AI products will not be defined... ...Counterfactual evaluation Credit assignment over... ...Safety and reliability benchmarks What we're looking for... ...modern infrastructure, frontier models, and substantial...For phdRemote jobInternshipLocal areaFlexible hours
Block
Hialeah, FL4 days ago - ...SME) in the field of Generative AI for medical research. The SME... ..., GenAI engineers, data scientists, UX designers, software developers... ..., and qualitative studies. Evaluate and validate GenAI outputs to... ...is highly desirable, such as a PhD, MPH, or MS in Clinical Research...For phdFreelanceFlexible hours
Cactus Communications
Doral, FL5 days ago - ...Medical Science Liaison (MSL) - AI Training We're looking for experienced Medical Science... ...clinical science professionals to help evaluate and improve AI systems trained on... ...medicine, or a related field (MD, PharmD, PhD) Why Join Us Work on cutting-edge AI...For phdHourly payOngoing contractContract workFreelanceRemote workFlexible hours
Alignerr
Doral, FL3 days ago - ...and initiative. **CORE JOB FUNCTIONS*** Assists Radiologists and PhD's in developing new protocols and Radiologic imaging techniques... ...procedures, starting IV's, and injecting contrast, if applicable. Evaluate Radiologic scans for technical quality, collates processed...For phdFull timeTemporary workWork at officeFlexible hoursShift workWeekend workDay shiftAfternoon shift
University of Miami
Doral, FL3 days ago - ...education and training of new physicians. Assist radiologists and PhD's in developing new protocols and Radiologic imaging techniques... .... Assist radiologist with interventional Radiologic procedures. Evaluate Radiologic scans for technical quality, collate processed images...For phdPart timeWork at officeWorldwideShift workNight shiftAfternoon shift
University of Miami
Doral, FL3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist (PhD) Math & Frontiers Benchmarking. Be the first to apply!
