GenAI Evaluation Scientist (Remote, 35h/wk)
Mercor
New York, NY
- Remote job
Cincinnatus LLC is seeking experienced machine learning practitioners to act as ground-truth experts for model evaluation and experimentation on a leading AI lab's GenAI team. You will author complex, multi-step ML tasks and verify where frontier models fall short. This full-time W-2 role is fully remote in the United States, about 35 hours per week, with the opportunity to be placed at a top AI lab as part of the extended workforce. #J-18808-Ljbffr Mercor
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the GenAI Evaluation Scientist (Remote, 35h/wk) in New York, NY vacancy
$245k - $315k
...Applied Research Scientist, LLM Evaluation & Post-Training Remote - Canada Innodata is a global data engineering company. We believe that data and Artificial... .... Scope of the Role: Innodata is expanding its GenAI research capability to advance state-of-the-art...Remote workInnodata Inc.
United States2 days ago- Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-... ...training (SFT, RLHF, reward modeling) and evaluation. The role focuses on building benchmarks... ...and multimodal modalities within the GenAI Research Organization. You will develop...Suggested
- Mercor is seeking specialists to join a leading AI lab's GenAI team as part of an extended workforce placed at a top AI lab in a fully remote role within the United States. You will work on red-teaming frontier AI systems, designing complex multi-step tasks and documenting...Remote job
- ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in... ...measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious... ...for traveling to other offices if you are remote, plus an annual company offsite.How and...Remote workFull timeWork at officeLocal areaHome office
- ...analyze results to determine where models fall short. This full-time, fully remote role within the United States requires a MSc/PhD or equivalent, 1+ years research experience, and strong Python/Git skills, with a focus on RL and LLM evaluation. #J-18808-Ljbffr ObsidianRemote jobFull timePart time
$70 per hour
...Develop original, executable scientific computing challenges that help evaluate the limits of advanced AI systems. This remote, part-time opportunity focuses on materials science problems requiring both deep domain expertise and practical coding skills. Role Overview...Remote workHourly payPart timeFor contractorsImmediate startSaidGig
United States12 days ago- ...Job DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0122121] for Program Support on a Exempt W2: No... ...identified Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
- ...DescriptionProSidian Seeks a Scientific Research and Evaluation Specialist (Glass Scientist) [DOE0148147] for Program Support on a Exempt W2: No Overtime... ...Work Site Address (Subject to Change or Working Remotely): 2440 Stevens Center Place, H520 Richland, Washington...Remote workFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hours
- A leading technology company is seeking part-time Internet Analysts to work from home as Social Media Evaluators. This flexible role requires good English writing skills and the ability to work independently on various language-related tasks, such as data collection and...Remote jobPart timeWork from homeFlexible hours
- A leading AI development firm is seeking a Mathematician (PhD) to join their remote AI training project. In this role, you will evaluate AI-generated mathematical responses, ensuring accuracy and clarity. To qualify, you must have a PhD in Mathematics/Statistics, significant...Remote jobWeekly payFlexible hours
$40 per hour
AIToolboard in the United States is seeking a part-time Remote Chemistry Research Scientist for AI Evaluation to join our expanding AI research team. You will train AI models related to chemical data, test outputs, and provide rigorous evaluation to improve model accuracy...Remote jobHourly payPart timeFlexible hours$70 per hour
...Design original, executable biology research problems that help evaluate advanced AI systems in scientific computing. This role combines... ...or research engineering experience. Work Terms Remote, hourly engagement. Six-week project with an immediate start...Remote workHourly payPart timeImmediate startSaidGig
United States12 days ago- ...experienced Tax Professionals and US Tax Law Experts to train and evaluate AI systems. You will interpret US sales and use tax statutes... ...interpreting, and translating tax law into objective criteria. Remote work available as a contract engagement. #J-18808-Ljbffr YO AI...Remote jobContract work
$60 - $80 per hour
...connects mathematicians with AI labs and companies to shape and evaluate cutting-edge AI in mathematics. Experts contribute domain... ...model performance and research outcomes Work independently on remote projects, managing your time to meet project deliverables Typical...Remote workHourly payContract workImmediate startSaidGig
United Statesmore than 2 months ago- ...mathematical reasoning and computational problem solving to improve and evaluate large language models. You will design rigorous math problems,... ...analytical skills, and the ability to work independently in a remote setting. Technical requirements: access to a desktop or...Remote workContract workFor contractorsFreelance
SaidGig
United Statesa month ago $60 - $90 per hour
...rigorous, real-world materials science and engineering tasks that evaluate an AI model’s expert reasoning. You will create prompts,... ...is correct and why an incorrect answer fails. Work Terms ~ Remote, hourly engagement. Compensation ~$60 to $90 per hour....Remote workHourly payWork at officeSaidGig
United States4 days ago- ...Details (if applicable)$142,748.11 - $157,594.00/year. 40 hours/wk full-time. Remote TypeOnsiteWork Location45 Francis StreetEEO Statement:2200... ...and career success. These competencies are used to evaluate performance, make hiring decisions, identify development needs...Remote workFull time
$180.6k - $225.75k
...to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. This role is on the evaluation pod within the GenAI Research...Full time$175.29k - $215.59k
...and for having a great company culture by Comparably.Applied Scientist, GenAI & ML SystemsLocation: Wilmington, MA (US) - Fulltime Onsite... ...for production usage: dataset creation, training workflows, evaluation, and inference serving.Build Advanced RAG pipelines end-to-end...Full time$164k - $225.5k
...for patients. The Safety Scientist is responsible for the ongoing... ...Operations to ensure timely evaluation of safety data, identification... ...a plus. Experience using GenAI or analytics tools to support... ...safety analyses is a plus. #LI-Remote For applicants in the United...Remote workTemporary workWork at officeargenx
United States1 day ago- ...Applied Scientist Caseware is one of Canada's original Fintech companies... ...in experiments, has built evaluations for LLM-based systems, and... ...Location: This is a fully remote position located in Colombia.... ...platform. Translate advances in GenAI (models, retrieval, agent...Remote workHome office
CaseWare
United States2 days ago - ...technology consulting company based in Dallas is seeking a Sr Data Scientist specializing in NLP and Generative AI. The role involves... ...deployment and retrieval systems. This position currently allows for temporary remote work due to COVID-19. #J-18808-Ljbffr Select Minds LLCRemote workTemporary work
$73 per hour
...Our mission is to unlock the potential of GenAI by tapping into real‑world expertise from... ...some understanding of how scoring or evaluation works in agent testing (precision, coverage... ...guidelines. Our freelance role is fully remote so, you just need a laptop, internet...Remote workPermanent employmentPart timeFreelanceMind Rift
Austin, TX2 days ago$290.25k
...innovative Machine Learning Scientists to join our AI team, focusing... ...(MLLMs), ComputerVision and GenAI technologies for law enforcement... ...hardware architectures. Evaluate the performance of LLM, MLLM,... ...work Tuesday through Friday and remote work on Mondays. The above job...Remote work$100k - $140k
...within the Space Materials Laboratory is seeking a well-qualified individual for the role of Materials Physicist - Non-Destructive Evaluation (NDE). In this role, you will work alongside senior technical staff to develop and apply advanced non-destructive inspection (NDI...Remote workFull timeImmediate startRelocation packageFlexible hoursThe Aerospace Corporation
El Segundo, CA19 hours ago$30 - $50 per hour
A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing...Remote jobHourly pay- ...About the Role We are seeking a Health Scientist I to support the Translation, Health Education and Evaluation Branch (THEEB). THEEB translates public health... ...evaluation plans. This is a full-time, fully remote position based in the United States. Some travel...Remote workFull timeContract workFor contractorsWork at officeLocal area
- ...About the Role We are seeking a Health Scientist II to support the Translation, Health Education and Evaluation Branch (THEEB). THEEB translates public health... ...evaluation plans. This is a full-time, fully remote position based in the United States. Some travel...Remote workFull timeContract workFor contractorsWork at officeLocal area
- ...theoretical findings, develop high-quality scientific explanations, and evaluate AI-generated content for accuracy and rigor. The work may cover... ...to improve AI reasoning and output quality. Collaborate remotely with project stakeholders during review cycles. Requirements...Remote work
Gramian Consulting
Brazila month ago - ...theoretical findings, develop high-quality scientific explanations, and evaluate AI-generated content for accuracy and rigor. The work may cover... ...feedback to improve AI reasoning and output quality. Collaborate remotely with project stakeholders during review cycles....Remote work
Gramian Consulting
Remotea month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GenAI Evaluation Scientist (Remote, 35h/wk). Be the first to apply!
Related searches
- materials scientist New York, NY
- cosmetic scientist New York, NY
- scientist assay development New York, NY
- entry level research scientist New York, NY
- health scientist New York, NY
- quality control scientist New York, NY
- deep learning scientist New York, NY
- research associate scientist New York, NY
- application scientist New York, NY
- scientist antibody discovery New York, NY