Applied Research Scientist, LLM Evaluation & Post-Training
Full-time
Innodata
Innodata is expanding its GenAI research capability to advance state-of-the-art evaluation and post-training methods for LLM and multimodal systems. As an Applied Research Scientist, LLM Evaluation & Post-Training , you will lead research and experimentation on how evaluation design, measurement strategies, and feedback signals influence model improvement. This role is ideal for a technically rigorous researcher who is deeply fluent in modern LLM evaluation and post-training, and who can turn research insight into practical methods for customer solutions and internal platform innovation. You will work across human-in-the-loop and AI-augmented workflows, partnering with Language Data Scientis...
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Applied Research Scientist, LLM Evaluation & Post-Training in Remote vacancy
$175k - $225k
Role Description Innodata is expanding its GenAI research capability to advance state-of-the-art evaluation and post-training methods for LLM and multimodal systems. As an Applied Research Scientist, LLM Evaluation & Post-Training, you will lead research and experimentation...TrainingFull timeInnodata Inc.
Remote6 days ago$142.8k - $193.2k
...individual customers, building evaluation frameworks for model... ...designing data‑driven guardrails for LLM‑generated content. The work... ...architecture design and deep learning training and optimization and model... ...If the country/region you’re applying in isn’t listed, please...TrainingLocal areaWorldwideFlexible hoursAmazon Science
Seattle, WA1 day ago$171.6k - $222.2k
...You will design, train, and optimize generative... ...involves building LLM-based classifiers... ...data engines, and post-generation content... ...metrics, defining evaluation frameworks that... ...-knit group of scientists and engineers who... ...country/region you’re applying in isn’t listed,...TrainingLocal areaFlexible hoursAmazon
Palo Alto, CA1 day ago$167.1k - $226.1k
...scalable and reliable evaluation of state-of-the-art Conversational... ..., and resourceful Applied Scientist in the field of Large... ...with LLMs, including LLM‑as‑a‑Judge (LLMaaJ),... ...expertise to set the research agenda for how we... ...sources, and design, train, and maintain the evaluation...TrainingLocal areaFlexible hoursAmazon
Sunnyvale, CA1 day ago$126.2k - $264.1k
...As our Principal Applied Scientist, you will play a key... ...drive projects from research POC to production.... ...including data, model, training, and evaluation, employing best practices... ...technologies in LLM and generative AI, such... ...provided in this posting are specific to the...TrainingTemporary workRemote workFlexible hoursLl Oefentherapie
Montgomery, AL3 days ago$100 - $120 per hour
...LLM Research Scientist (Pre-training & Post-Training) is a remote review track for evaluating AI outputs across research science reasoning, calculations, and research workflows.... ...Graduate-level training or equivalent applied experience in research science or a closely...TrainingRemote jobFor contractors10 hours per week$167.1k - $226.1k
...responsibilities As an Applied Scientist on LPEX, you will be a technical... ..., translating research advances into measurable business... ...development, offline and online evaluation, and reliable production... ...architecture design and deep learning training and optimization and model...TrainingWorldwideFlexible hoursNight shiftAmazon.com Services LLC
Seattle, WA8 hours ago$167.1k - $226.1k
...innovative and customer-focused applied scientist to help us make the world's... ...at the frontier of AI research, and rapidly implement and... ...multimodal data with rigorous evaluation frameworks. Define research... ...Experience with training and deploying machine learning...TrainingWorldwideFlexible hoursAmazon
Seattle, WA1 day ago$149k - $350k
...join us! We’re looking for applied scientists with a Machine Learning and... ...fundamental and applied research in this area. You will be combining... ...for AI systems Build evaluation systems to measure and... ...HuggingFace etc ~ Experience training LLMs with Reinforcement...TrainingFull timeTemporary workRemote workWork from homeFigma
New York, NY1 day ago- ...The Role We're looking for an Applied Scientist who thrives at the intersection of applied research and real-world products. You'll... ...in data, interaction, and evaluation with both creativity and engineering... ...of data modeling for training and how curation decisions shape...TrainingFlexible hours
Adaption Labs
San Francisco, CA3 days ago $112k - $151k
...power grids, buildings, trains, hospitals. Industrial... ...major opportunity in applied AI, and one of the... ...intersection of machine learning research, real world data, and... .... As Applied Scientist, you work on the science... ...control, planning, or evaluation Take problems from ambiguous...TrainingLocal areaSiemens Mobility
New York, NY2 days ago$80 - $110 per hour
...expertise to the development and evaluation of next-generation AI systems that must reason about pure and applied mathematics at the level of a working research mathematician. You will help ensure... ...research-level mathematics problems to train and evaluate frontier AI models....TrainingHourly payPart timeImmediate startRemote workSaidGig
United States1 day ago$80 - $110 per hour
...Contribute frontier research expertise to the development and evaluation of AI systems that... ...supports model training and assessment across... ...member, principal scientist, or industry... ...are encouraged to apply, the depth of research... ...application through the posting you are viewing,...TrainingHourly payPart timeImmediate startRemote workSaidGig
United States1 day ago- ...skilled and driven Senior Applied Scientist with 7+ years of industry experience... .... Responsibilities ~Research and engineer NLP solutions... ...and implement algorithms, train state of the art large language models (LLM) on large data, and evaluate their performance. ~...TrainingFull time
Black Ore
Remote18 hours ago $40 per hour
...We are looking for an Applied Mathematician to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of...Hourly payFull timeContract workPart timeRemote workDataAnnotation
Brooklyn, NY4 days ago$88.6k - $150.8k
Join to apply for the Research Scientist role at The Henry M. Jackson Foundation for... ...clinical tool development and training, cognitive monitoring and... ...on employee performance evaluations. Qualifications Education... ...Learning Scientist, NLP/LLM San Francisco, CA $140,000...TrainingFull timeContract workFor contractorsFixed term contractInternshipWork at officeLocal areaRemote workFlexible hours$150k - $173k
...join a small but world-class Applied Research and AI team and work on... ...in practice. * Simulation & Evaluation: Build simulation environments... ...operations — and can be used to train, evaluate, and iterate on... ...and retraining RL systems post-deployment, including...TrainingBi-weekly payFull timeShift work$150k - $230k
...Engineer to drive the post-training of our large language... ...large GPU clusters , applying distributed-training... ...Build and maintain evaluation and reward/verifier pipelines... ...with post-training research and turn promising... ...Requirements Hands-on LLM post-training...TrainingFull timeLocal areaWork from homeNews Break
Remote18 hours ago$200k - $270k
...looking for a Staff Research Scientist to join Cognitiv’... ...the AdTech and LLM landscape well... ...embeddings, and applied deep learning to... ...including large‑scale training, fine‑tuning, and... ...of a launch—blog posts, talks, demos, or... ...candidate evaluation or hiring decisions...TrainingWork at officeRemote workWork from homeCognitiv Corp
Bellevue, WA1 day ago$75 per hour
...Role Overview AI & Machine Learning Researchers evaluate AI-generated content and create expert-level training data to improve AI systems'' understanding of advanced computer... ...(cs), and the ability to interpret and apply findings from recent preprints. Strong written...TrainingHourly payContract workPart timeFor contractorsRemote workFlexible hoursSaidGig
United States1 day ago$311.85k - $370k
...Wayve AI Platform Scientist Or Engineer Founded in... ...we curate, enrich, and evaluate the real-world driving... ...are hiring at either Applied Scientist or Machine Learning... ...into high-signal training data through (semi-)... ...record of taking ML from research into production...TrainingFull timeWork at officeWork from homeWayve
Sunnyvale, CA4 days ago- ...growth. If you are ready to apply your skills to the... ...robotics stack. We're training state-of-the-art AI models... ...As a Machine Learning Research Engineer, you will work... ...to model training, evaluation, and on-robot deployment... ...model training pipelines (LLM/VLM/VLA) At...Training
Sunday
Redwood City, CA4 days ago - A leading data services company is seeking an Applied Mathematician to evaluate AI models by providing complex mathematical problems to chatbots and assessing their outputs for quality and performance. This role offers flexibility with fully remote work and allows you to...Remote jobHourly pay
$200k - $250k
...'ll have the compute power to train large models to solve this challenge. Your role as Applied Scientist is to build next-generation AI... ...fall short. Your focus: Applied research from research to data to model... ...and evals. Training (pre & post-training) and fine-tuning Large...TrainingRemote workFlexible hourstechire ai
Seattle, WA3 days ago$183.8k - $248.7k
...the full ML lifecycle, from exploratory research and offline modeling to online experimentation... ...analyze large-scale A/B experiments, applying causal inference techniques to measure... ...fundamentals, including architecture, training/inference lifecycles, and optimization of...TrainingFlexible hoursShift workAmazon
New York, NY3 days ago$125k - $225k
...FutureSearch is looking for exceptional Research Scientists to evaluate and improve state-of-the-art forecasting and agentic LLM web research. We are an elite team of engineers... ...frontier labs on research, evaluation, and training. You are a talented researcher with...TrainingRemote workFlexible hoursFuture Research Corp
New York, NY1 day ago- ...frontier of machine learning research. Founded by leading... ...systems, and advanced training methodologies. These... ...large-scale pre-training, post-training, reinforcement... ...and data curation. Evaluation, benchmarking, reward modeling... ...used at scale. Why Apply You’ll gain access to opportunities...TrainingCurrently hiring
Alexander Chapman
California, MO18 hours ago $290.25k
...Machine Learning Scientists to join our AI team... ...AI applications (LLM and Computer Vision... ...key member of our research and development efforts... ...architectures. Evaluate the performance of... ...architectures, train/evaluate/tune models... ...less likely to apply to jobs unless they...TrainingWork experience placementWork at officeRemote workAxon
Seattle, WA18 hours ago$60 - $80 per hour
...Overview Contribute mathematical expertise to cutting-edge AI research by joining a talent network that connects mathematicians... ...assignments matched on a rolling basis. Key Responsibilities Train and evaluate AI models on mathematics-related tasks. Create tasks,...TrainingHourly payContract workRemote workSaidGig
United States18 hours ago$204k - $259k
...service and can also be applied to a range of vehicle... ...with other research teams in Alphabet. AI... ...learning, and robust evaluation. Role Summary In this... ...report to a Principal Scientist. Responsibilities Participate... ...World Model post‑training and evaluation Research...TrainingTemporary workRemote workWaymo
San Francisco, CA18 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied Research Scientist, LLM Evaluation & Post-Training. Be the first to apply!
