Remote AI Research Scientist: LLM Evaluation & Experiments
$30 - $50 per hourRex
New York, NY
- Remote job
A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing AI research experiments, performing error analysis, and supporting data quality practices. Ideal candidates will have a fundamental understanding of AI and machine learning, along with experience in NLP or computer vision. Competitive pay ranges from $30 to $50 per hour. #J-18808-Ljbffr REX
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Research Scientist: LLM Evaluation & Experiments in New York, NY vacancy
$245k - $315k
...Applied Research Scientist, LLM Evaluation & Post-Training Remote - Canada Innodata is a global data engineering company... ...and Artificial Intelligence (AI) are inextricably linked. Our mission... ...outcomes, and you will design experiments that produce credible,...Remote workInnodata Inc.
United States2 days ago$130k - $200k
...is a nine-person AI infrastructure startup... ..., traces, evaluations, and human feedback... ...are hiring an AI Research Scientist to advance the frontier... ...ideas into experiments, prototypes, and... ...experience focused on LLM agents or agentic... ...Fully remote within the United...Remote workFull timeH1bRaydar Inc
New York, NY36 minutes ago- ...scientific discovery to powering AI and the technologies... ...ROLE:We are hiring a AI Research Scientist, Reinforcement Learning (LLM) and Post-Training,... ...variance reduction, and evaluation that reflects real constraints... ...the RL roadmapPREFERRED EXPERIENCE:Strong publication...Suggested
- This AI Research Scientist will lead the design and build biological... ...project work. Fully remote applicants will not... ...AI systems (e.g., LLM-based tools, agentic... ...and develop rigorous evaluation frameworks and benchmarks... ...validation experiments. Lead by example in the...Remote work3 days per week
$69.4k - $158k
AI and ML Research ScientistThe Opportunity:As an analytics professional... ...through your experience with programming... ....As an advanced data scientist or researcher on our... ...research questions with evaluation criteriaKnowledge of... ...cameras on during meetings.Remote: If this position is...Remote workFull timeContract workPart timeWork at officeLocal area$295k
...first enterprise AI company. We... ...Cohere is a team of researchers, engineers,... ...!Why this role?Evaluation is critical to... ...infrastructure to measure LLM progress.As a Senior Research Scientist, Model... ...offices if you are remote, plus an annual... ...with your experience, we still encourage...Remote workFull timeWork at officeLocal areaHome office- ...NVIDIA AI Researcher NVIDIA is searching for outstanding AI researchers to join the NVIDIA... ...need to see: ~ Excellent knowledge of LLM and foundation models ~ Publication at... ..., NeurIPS, MLSys, etc) ~4 years of experience. ~ PhD degree in computer science or electrical...Remote work
NVIDIA
United States2 days ago - ...Job Title AI Research Scientist Location Hybrid / Remote Employment Type Full-time Job Summary... ...generative AI. Design, develop, and evaluate client AI models, algorithms,... ...experimentation. Design and execute experiments to evaluate model performance,...Remote workFull time
Ova Technologies
United States1 day ago $117.6k - $176.4k
...Data Scientist At Schneider Electric, we are committed... .... Within our Global AI Hub we combine our... ...fast-moving applied AI research scientist who loves working... ...data preparation, experiment tracking, baselines, ablations... ...baselines, ablations, evaluation protocols) and...Remote workFull timeTemporary workSchneider Electric
United States5 days ago$100 - $120 per hour
Gridnaut Recruiting is hiring a remote LLM Research Scientist (Pre-training & Computer Vision &... ...$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Remote contractor... ...required; Hourly contractor pay; prior professional experience preferred.Remote workHourly payTemporary workFor contractorsGridnaut Recruiting
Remote11 days ago$100 - $120 per hour
...machine learning research across computer vision... ..., improving, evaluating, and deploying deep... ...learning research experience. PhD research counts... ...or comparable AI company, or an equivalent... ...generators. LLM post-training and... ...Work Terms Remote, hourly engagement...Remote workHourly payFlexible hoursSaidGig
United Statesa month ago$69.4k - $158k
...Job Number: R0247767 AI and ML Research Scientist The Opportunity: As an... ...analytics projects through your experience with programming languages... ...research questions with evaluation criteria Knowledge of... ...on during meetings. Remote : If this position is listed...Remote workFull timeContract workPart timeWork at officeLocal area$167.8k - $209.7k
...AI Research Scientist II – Office of the CTO The Allen Institute accelerates... ..., disseminating, and evaluating AI/ML/computational methods... ...Required Education and Experience PhD in Computer Science... ...currently able to work both remotely and onsite in a hybrid work...Remote workWork experience placementWork at officeVisa sponsorshipWork visaRelocation packageThe Allen Institute
Seattle, WA1 day ago$146.6k - $183.25k
...AI Research Scientist - AI BioDesign The Allen Institute accelerates science... ...the AI Research Scientist evaluates model performance, limitations... ...computational frameworks, experiments, and benchmarks Assess... ...is 700 Dexter Ave N.; any remote work must be performed in Washington...Remote workWork at officeLocal areaVisa sponsorshipWork visaRelocation packageAllen Institute
Washington DCmore than 2 months ago- Advance the science of clinical AI and translate research into production systems. New Jersey or Remote Research & Development Full-... ...machine learning Design experiments to validate AI approaches for... ...understanding and reasoning Evaluation benchmarks for healthcare AI...Remote jobFull time
$159.75k - $255.6k
...skilled and innovative Senior AI Research Scientist to join a new team focusing... ...to Protect Life but your experience doesn’t align perfectly... ...with the flexibility to work remotely on Mondays, unless there is... ...through model development, evaluation, deployment, and iteration...Remote workWork experience placementWork at office- ...AI Research Scientist Docugami uses powerful artificial intelligence to unlock the information... ...opportunities, and team sessions You have experience managing a team to perform to their... ...in France and will primarily be remote, with the ability to work from anywhere...Remote workImmediate start
Docugami
United States1 day ago $136.5k - $276.5k
HPE Labs - AI/ML Research Scientist IIIThis role has been designed as ‘’Onsite’... ...research in areas including LLM reasoning and agents,... ...across HPE by identifying, evaluating, and shaping emerging technology... ...Learning.Extensive research experience with Large Language Models...Full timeWork experience placementWork at officeLocal areaImmediate start- ...contribute to world‑class research in artificial... ...Laboratory has over 50 years of experience developing... ...both basic and applied AI/ML, our group is shaping... ...relevance: we design and evaluate AI/ML systems using realistic... ...learning, deep-learning, LLM/agentic AI, multimodal...
- ...contribute to world-class research in artificial... ...Laboratory has over 50 years of experience developing... ...national missions.Group 52 AI Technology & Systems Group... ...relevance: we design and evaluate AI/ML systems using realistic... ...- exposure to agentic/LLM-oriented toolkits (e.g....
$199k - $325k
...enterprises orchestrate AI-powered work. Our... ...About the roleAI research at WRITER isn't... ...As an AI research scientist, you'll be at the... ...Enterprises are moving from experimenting with AI to deeply... ...model training, evaluation, and production... ...— including LLM-as-judge frameworks...Full timeWork at officeLocal area$100 - $120 per hour
...LLM Research Scientist (Pre-training & Computer Vision & Adversarial Robustness) is a remote red-team track for stress-testing AI systems against adversarial prompts.... ...matters Adversarial evaluation is how AuraOne... ...Qualifications Demonstrated experience red-teaming AI...Remote jobFor contractors10 hours per week$100 - $120 per hour
...scoped, empirical ML research projects that... ...projects and iterate on experiments to reach... ...training and TRADES. Evaluating robust accuracy under... ...counts. LLM Post-Training and... ...FAANG or comparable AI company, or an equivalent... ...Work Terms Remote role. Hourly, project...Remote workHourly payTemporary workFlexible hoursSaidGig
United States3 days ago$100 - $120 per hour
...LLM Research Scientist (Pre-training & Post-Training) is a remote review track for evaluating AI outputs across research science reasoning, calculations, and research workflows... ...Graduate-level training or equivalent applied experience in research science or a closely related...Remote jobFor contractors10 hours per week$188k - $215k
...Collate is an AI document generation... ...of Lever. Our AI researchers, engineers, and designers... ...an AI Research Scientist to push the... ...'ll DoExplore new LLM prompt optimization... ...production. Develop evaluation frameworks to... ...publications or equivalent experience. Ability to...Collate
San Francisco, CA3 days ago$180k
...professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate... ...and guardrails that make advanced LLM features safe to ship. You’ll... ...background (TypeScript a plus) Deep experience with OpenAI API or similar LLM...Remote workFull timeDeepRec.ai
Denver, CO4 days ago- Outlier is hiring an AI Research Scientist to join a fully remote team delivering high-quality data for AI models. You will evaluate AI outputs, craft prompts, and contribute to data annotation projects with a focus on reliability and safety.Ideal candidates have a Bachelor...Remote jobWeekly payFull timeFlexible hours
- ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment Type Full-time... ...with AI engineers, data scientists, and product teams to improve... ...reliability and user experience. Key... ...learning fundamentals LLM evaluation methodologies...Remote workFull time
Ova Technologies
New York, NY1 day ago - ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a... ...support AI training datasets. LLM evaluation: reviewing AI-generated... ...across time zones. Preferred Experience Familiarity with MQM/LQA concepts...Remote workHourly payFor contractorsFlexible hours
CNTXT AI
Brooklyn, NY6 days ago $60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Machine Learning Engineer — Model Evaluation & Experimentation... ...90/hour Location: Remote Commitment: 35 hours... ...multi-step tasks. Run experiments by implementing changes, executing...Remote workHourly payWeekly payFull timeContract workFor contractorsSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Research Scientist: LLM Evaluation & Experiments. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- scientist ii New York, NY
- regulatory scientist New York, NY
- principal scientist New York, NY
- graduate scientist New York, NY
- manufacturing scientist New York, NY
- analytical scientist New York, NY
- senior research scientist New York, NY
- genomics scientist New York, NY