Remote AI Research Scientist: LLM Evaluation & Experiments
$30 - $50 per hourRex
New York, NY
- Remote job
A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing AI research experiments, performing error analysis, and supporting data quality practices. Ideal candidates will have a fundamental understanding of AI and machine learning, along with experience in NLP or computer vision. Competitive pay ranges from $30 to $50 per hour. #J-18808-Ljbffr REX
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote AI Research Scientist: LLM Evaluation & Experiments in New York, NY vacancy
- ...Working remotely in a full-time capacity, the AI Research Scientist will focus on developing next-generation... ...criteria for evaluating systems Optimize prompts... ...modern research papers Experience in training generative... ...solid understanding of LLM training fundamentals...Remote workFull time
Virtual Vocations Inc
United States2 days ago $130k - $200k
...AI Research Scientist Our client is a nine-person AI infrastructure... ...failures, traces, evaluations, and human feedback... ...research ideas into experiments, prototypes, and production... ...focused on LLM agents or agentic systems... ...be available Fully remote within the United...Remote workFull timeH1bNine-person AI infrastructure startup
United States2 days ago- ...scientific discovery to powering AI and the technologies... ...ROLE:We are hiring a AI Research Scientist, Reinforcement Learning (LLM) and Post-Training,... ...variance reduction, and evaluation that reflects real constraints... ...the RL roadmapPREFERRED EXPERIENCE:Strong publication...Suggested
AMD
Santa Clara, CA4 days ago $125k - $225k
...world’s most advanced AI-native platform.... ...for a Data Scientist to help build the... ...Intelligence and Threat Research Work closely with... ...systems — evals, LLM-as-judge pipelines... ...current papers Experience training... ...concepts #LI-Remote #LI-RC1 Benefits...Remote workPermanent employmentWork experience placementWork at officeLocal areaRemote13 days ago- ...real time, prevent AI-driven attacks,... ...However, we maintain a remote-first work... ...looking for an applied research scientist that brings their... ...design rigorous experiments, and execute on... .... Own the evaluation bar for foundation... ...building and evaluating LLM-based agents in...Remote workFull timeWorldwideHome officeFlexible hours
Sardine
United States24 days ago - This AI Research Scientist will lead the design and build biological... ...project work. Fully remote applicants will not... ...AI systems (e.g., LLM-based tools, agentic... ...and develop rigorous evaluation frameworks and benchmarks... ...validation experiments. Lead by example in the...Remote work3 days per week
$60 - $120 per hour
...ML Engineer (MSc. or PhD) (Remote | $60–$120/hr) Position:... ...Engineers to contribute to AI training projects involving... ...components, data pipelines, evaluation systems, and numerical methods... .... Strong professional or research experience in machine learning. Practical...Remote workPart timeFor contractorsImmediate startWorldwideFlexible hoursSynthires
United States1 day ago$69.4k - $158k
AI and ML Research ScientistThe Opportunity:As an analytics professional... ...through your experience with programming... ....As an advanced data scientist or researcher on our... ...research questions with evaluation criteriaKnowledge of... ...cameras on during meetings.Remote: If this position is...Remote workFull timeContract workPart timeWork at officeLocal areaBooz Allen Hamilton
Hyattsville, MD5 days ago$295k
...-first enterprise AI company. We build... ...Cohere is a team of researchers, engineers,... ...us!Role Overview:Evaluation is critical to making... ...infrastructure to measure LLM progress.Key... ...role can be based remotely or from one of our... ...exactly with your experience, we still encourage...Remote workFull timeWork at officeLocal areaHome officeCohere
New York, NY4 days ago- ...NVIDIA AI Researcher NVIDIA is searching for outstanding AI researchers to join the NVIDIA... ...need to see: ~ Excellent knowledge of LLM and foundation models ~ Publication at... ..., NeurIPS, MLSys, etc) ~4 years of experience. ~ PhD degree in computer science or electrical...Remote work
NVIDIA
United States4 days ago - ...building mechanistic AI models to predict how... ...are looking for an AI Research Scientist to help advance the modeling... ..., design and run experiments, develop novel model architectures... .... Develop and evaluate novel deep learning... ...depth. Flexible remote or hybrid work...Remote workFlexible hours
Absentia Labs
Boston, MA2 days ago $100 - $120 per hour
Gridnaut Recruiting is hiring a remote LLM Research Scientist (Pre-training & Computer Vision &... ...$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Remote contractor... ...required; Hourly contractor pay; prior professional experience preferred.Remote workHourly payTemporary workFor contractorsGridnaut Recruiting
Remotea month ago- ...Job Title AI Research Scientist Location Hybrid / Remote Employment Type Full-time Job Summary... ...generative AI. Design, develop, and evaluate client AI models, algorithms,... ...experimentation. Design and execute experiments to evaluate model performance,...Remote workFull time
Ova Technologies
United States3 days ago $100 - $120 per hour
...machine learning research across computer vision... ..., improving, evaluating, and deploying deep... ...learning research experience. PhD research counts... ...or comparable AI company, or an equivalent... ...generators. LLM post-training and... ...Work Terms Remote, hourly engagement...Remote workHourly payFlexible hoursSaidGig
United Statesmore than 2 months ago$69.4k - $158k
...Job Number: R0247767 AI and ML Research Scientist The Opportunity: As an... ...analytics projects through your experience with programming languages... ...research questions with evaluation criteria Knowledge of... ...on during meetings. Remote : If this position is listed...Remote workFull timeContract workPart timeWork at officeLocal area$130k - $200k
...hires, flexible by experience. San Francisco compensation... ...of living. Apart Research is hiring a Research Scientist for Manipulation... ...and publish novel evaluations of AI harmful... ...frameworks like Inspect, LLM APIs); comfortable... ...of living. Fully remote, EU-compatible time...Remote workWork at officeLocal areaHome officeFlexible hours$167.8k - $209.7k
...AI Research Scientist II – Office of the CTO The Allen Institute accelerates... ..., disseminating, and evaluating AI/ML/computational methods... ...Required Education and Experience PhD in Computer Science... ...currently able to work both remotely and onsite in a hybrid work...Remote workWork experience placementWork at officeVisa sponsorshipWork visaRelocation packageThe Allen Institute
Seattle, WA3 days ago- UL Research Institutes is seeking a Research Scientist IV for a remote-based opportunity focused on designing, developing, and evaluating advanced AI safety systems across NLP, CV, DP, and AI reasoning.... ...Bachelor’s with substantial experience. #J-18808-Ljbffr UL Research...Remote jobWorldwide
$55 - $80 per hour
...technical talent with leading AI research labs. Headquartered in San... ...55–$80/hour Location: Remote Role Responsibilities... ...problems in your domain. Evaluate and improve AI model performance... ...(or equivalent industry experience) in Medicine , Healthcare...Remote workContract workSummer workMercor
San Francisco, CA13 days ago$130k - $200k
...About the Role Advance research and practical methods for making AI agents reliable in production... ...in agent behavior, evaluation, and optimization with systems... ...10+ years of relevant experience; recent PhD graduates... .... Location Remote within the United States...Remote workFull timeVisa sponsorship$90 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Machine Learning Engineer — Model Evaluation & Experimentation Type:... ...60–$90/hour Location: Remote Commitment: 35 hours/... ..., multi-step tasks. Run experiments by implementing changes,...Remote jobContract workSummer workMercor
New York, NY5 days ago$119.26k - $163.98k
...exciting opportunity for a Research Scientist IV atUL Research Institutes. This is a remote-based opportunity. The... ..., developing, and evaluating advanced artificial intelligence (AI) safety systems across specialty... ...sound What you’ll experience working at UL Research Institutes...Remote workFull timeWorldwideFlexible hours- Key Talent Solutions seeks a Research Scientist - Post Training to advance how training data shapes LLM capabilities, generalisation... ...-on role blends research, evaluation and collaboration with external... ...You will design SFT and RL experiments, build reproducible...
$90 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Machine Learning Engineer — Model Evaluation & Experimentation Type:... ...60–$90/hour Location: Remote Commitment: 35 hours/... ..., multi-step tasks. Run experiments by implementing changes,...Remote jobHourly payWeekly payContract workFor contractorsSummer workMercor
New York, NY14 days ago- ...Description This is a remote position. Lucas... ...recruiting on behalf of UL Research Institutes.We have an... ...for a Lead AI Research Scientist II at UL Research Institutes... ...independent test and evaluation research programs to... ...What you’ll experience working at UL Research...Remote workFlexible hours
Lucas James Talent Partners
Evanston, IL17 days ago $55 - $80 per hour
...technical talent with leading AI research labs. Headquartered in San... ...55–$80/hour Location: Remote Role Responsibilities... ...problems in your domain. Evaluate and improve AI model performance... ...(or equivalent industry experience) in Medicine , Healthcare...Remote workContract workSummer workMercor
Atlanta, GA14 days ago- ...fixed I'm developing a proprietary AI-assisted story evaluation system for film, television and... ...literature. I need an experienced Python/LLM evaluation engineer to implement and... ...: - Strong Python and LLM API experience. - Experience with LLM evaluation,...
House of Scribes
Seattle, WA1 day ago - Zillow Group Inc. is looking for a Senior Applied Scientist to lead LLM post-training and reward modeling within the Agentic Foundations... ..., and post-training into scalable impact for home-shopping experiences across a remote U.S. workforce. #J-18808-Ljbffr Zillow GroupRemote work
$159.75k - $255.6k
...skilled and innovative Senior AI Research Scientist to join a new team focusing... ...to Protect Life but your experience doesn’t align perfectly... ...with the flexibility to work remotely on Mondays, unless there is... ...through model development, evaluation, deployment, and iteration...Remote workWork experience placementWork at officeAxon
Seattle, WA3 days ago$25 - $30 per hour
...Bilingual Italian AI Evaluation Specialist is a remote Italian specialist track for evaluating italian evaluation... ...Specialist work. Demonstrable experience editing, translating, or evaluating... ...QA frameworks. Familiarity with LLM evaluation rubrics and inter-rater agreement...Remote workFor contractors10 hours per weekAuraOne Human Data
Remotemore than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Research Scientist: LLM Evaluation & Experiments. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- research scientist machine learning deep learning New York, NY
- image scientist New York, NY
- health scientist New York, NY
- regulatory scientist New York, NY
- scientist biology New York, NY
- drug safety scientist New York, NY
- research associate scientist New York, NY
- lead scientist New York, NY