GenAI Evaluation Scientist (Remote, 35h/wk)
Mercor
New York, NY
- Remote job
Cincinnatus LLC is seeking experienced machine learning practitioners to act as ground-truth experts for model evaluation and experimentation on a leading AI lab's GenAI team. You will author complex, multi-step ML tasks and verify where frontier models fall short. This full-time W-2 role is fully remote in the United States, about 35 hours per week, with the opportunity to be placed at a top AI lab as part of the extended workforce. #J-18808-Ljbffr Mercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GenAI Evaluation Scientist (Remote, 35h/wk) in New York, NY vacancy
- Research Scientist, LLM Evaluation & Post-Training page is loaded## Research Scientist, LLM Evaluation & Post-Traininglocations: Remote Work( USA)time type: Full timeposted on: Posted 2 Days Agojob... ...innovation(TM) solutions for GenAI can reduce GenAI costs by up to 80...Remote workFull time
- Johnson & Johnson Innovative Medicine is seeking a postdoctoral researcher to design and apply evaluation methods for GenAI tools in pharmaceutical R&D, focusing on accuracy, evidence grounding, and traceability. You will collaborate with scientific and data science teams...Suggested
- Mercor is seeking specialists to join a leading AI lab's GenAI team as part of an extended workforce placed at a top AI lab in a fully remote role within the United States. You will work on red-teaming frontier AI systems, designing complex multi-step tasks and documenting...Remote job
- ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in... ...measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious... ...for traveling to other offices if you are remote, plus an annual company offsite.How and...Remote workFull timeWork at officeLocal areaHome office
$40 per hour
A biotechnology company is seeking a Biotechnology R&D Scientist to train AI models and evaluate their outputs. This role involves measuring the progress... ...of cell biology and related fields. This is a flexible remote position with hourly pay starting at $40, and the...Remote workHourly payFlexible hoursDataAnnotation
Vermont3 days ago$40 per hour
A leading AI training company is seeking a Biotechnology R&D Scientist to evaluate and improve AI models by posing complex biological questions. This remote position allows candidates to choose projects and work on their own schedule, with rates starting at $40+ per hour...Remote workHourly payDataAnnotation
Sioux Falls, SD1 day ago- University of Chicago is seeking an Evaluation and Research Scientist to lead program evaluation and quantitative/qualitative research in STEM and AI education. The role reports to the Director of Outlier Research and Evaluation and collaborates with senior researchers,...Remote job
$40 per hour
...seeking an R&D Biologist to join their team to train AI models by evaluating chatbot outputs against complex biology questions. Ideal... ...biology or biochemistry. This position allows full-time or part-time remote work, with projects that pay hourly starting at $40+. Strong...Remote workHourly payFull timePart timeDataAnnotation
Oklahoma City, OK3 days ago- Cohere is seeking a Senior Research Scientist, Model Evaluation, to create ambitious evaluation benchmarks and scale evaluation infrastructure for... ..., and collaboration across research and engineering, with remote-friendly policies and opportunities to influence model...Remote work
- Ripple Effect is seeking a Public Health Evaluation Scientist to lead technical components of evaluations and provide methodological guidance. You will independently execute complex research tasks, oversee quality control, and ensure timely, high-quality deliverables....Remote job
$40 per hour
...to join their team. This role involves training AI models by evaluating chatbot outputs on complex biology questions. Applicants should... ...strong expertise in biology and related fields. You will work remotely on your own schedule, with hourly projects starting at $40, along...Remote workHourly payDataAnnotation
New York, NY3 days ago$40 per hour
...AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each... ...Computer Science. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to...Remote workHourly payFull timeContract workPart timeDataAnnotation
Brooklyn, NY4 days ago$40 per hour
...Biologist to train AI models and improve their quality. This position offers remote flexibility and allows you to work on selected projects at your own schedule. Responsibilities include evaluating the performance of AI chatbots on complex biology topics. Candidates...Remote workHourly payDataAnnotation
Brooklyn, NY4 days ago- ...analyze results to determine where models fall short. This full-time, fully remote role within the United States requires a MSc/PhD or equivalent, 1+ years research experience, and strong Python/Git skills, with a focus on RL and LLM evaluation. #J-18808-Ljbffr ObsidianRemote jobFull timePart time
$40 per hour
A leading AI training firm in the United States is seeking an R&D Biologist to join their team. In this remote position, you will evaluate AI chatbots and enhance their models while ensuring the biological accuracy of their outputs. The ideal candidate should have an expert...Remote workHourly payDataAnnotation
Hartford, CT3 days ago- ...LLC is recruiting researchers to design and author multi-step evaluation tasks for frontier AI benchmarks. The role emphasizes translating... ...evaluation, and clear written conclusions. You will work remotely in the United States for approximately 35 hours per week as part...Remote jobFull timePart time
- Knowesis Inc. is seeking a Health Scientist I to support CDC evaluation and performance measurement efforts, with remote work and occasional travel to Atlanta, GA. The role focuses on developing evaluation plans, conducting data collection and analysis, and delivering...Remote job
- Knowesis is seeking a Health Scientist I to provide evaluation and performance measurement support for CDC’s Division of Diabetes Translation and THEEB... ...tools for implementation assessment. The position is remote/contractor with occasional travel to CDC facilities in Atlanta...Remote jobFor contractors
- ...Job DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0122121] for Program Support on a Exempt W2: No... ...identified Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
- ...join their team and train AI models. You will be responsible for evaluating the logic and outputs of AI chatbots, requiring an expert... ...at $40, alongside bonuses for high-quality work. Applicants must be based in the United States and can work remotely. #J-18808-LjbffrRemote workHourly payFull timePart timeFlexible hours
DataAnnotation
Louisiana, MO3 days ago - Alignerr is seeking a Materials Science Specialist for AI training to help train and evaluate models on semiconductor materials and molecular structures. This fully remote contract role leverages your deep domain expertise rather than an AI background. Candidates with...Remote jobContract workFlexible hours
- ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0148147] for Program Support on a Exempt W2: No Overtime... ...Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
$40 per hour
A technology-focused company is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbots based on complex chemistry questions. This remote position allows for flexible scheduling and project selection. Applicants must have a PhD in Chemistry and a strong...Remote workHourly payFlexible hoursDataAnnotation
Raleigh, NC3 days ago$40 per hour
A data solutions company is seeking a Process Development Chemist to join their team remotely. In this role, you will train AI models by evaluating their performance on complex chemistry questions. The position offers flexibility to work on chosen projects at an hourly...Remote workHourly payDataAnnotation
Jackson, MS3 days ago$40 per hour
...AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each... ...Chemical Engineering. Benefits This is a full-time or part-time REMOTE position You’ll be able to choose which projects you want to...Remote workHourly payFull timeContract workPart timeDataAnnotation
Iowa, LA3 days ago$40 per hour
A leading AI research firm is seeking a Postdoctoral Researcher in Chemistry to evaluate AI chatbot outputs and improve their performance. This remote role offers flexibility in project selection and work schedules, along with hourly payment starting at $40+, plus potential...Remote workHourly payDataAnnotation
Helena, MT4 days ago- A leading technology company is seeking part-time Internet Analysts to work from home as Social Media Evaluators. This flexible role requires good English writing skills and the ability to work independently on various language-related tasks, such as data collection and...Remote jobPart timeWork from homeFlexible hours
$85k - $95k
...University a singular intellectual destination. Job Summary The Evaluation and Research Scientist will lead and support program evaluation and research... ...Conditions This position is eligible for a partial remote work arrangement. A fully remote work arrangement may be...Remote workContract workWork experience placement- Knowesis Inc. is seeking a Health Scientist II to provide senior-level evaluation and performance measurement support for CDC THEEB and national evaluation... ...and deliver actionable recommendations while working remotely with occasional travel to CDC facilities in Atlanta,...Remote job
$40 per hour
AIToolboard in the United States is seeking a part-time Remote Chemistry Research Scientist for AI Evaluation to join our expanding AI research team. You will train AI models related to chemical data, test outputs, and provide rigorous evaluation to improve model accuracy...Remote jobHourly payPart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GenAI Evaluation Scientist (Remote, 35h/wk). Be the first to apply!
Related searches
- scientist ii New York, NY
- scientist 1 New York, NY
- image scientist New York, NY
- downstream processing scientist New York, NY
- entry level research scientist New York, NY
- qc scientist New York, NY
- research scientist New York, NY
- analytical scientist New York, NY
- research scientist - biology New York, NY
- genomics scientist New York, NY