Senior ML Research Engineer: LLM Training & Evaluation Lead
The SeventhHire LLC
The SeventhHire LLC in New York, NY seeks a senior ML researcher to lead LLM evaluation and post-training improvements. You will own experimental design, benchmarks, and data quality as core inputs to model training. Ideal candidates have 6–10 years of AI/ML research, PhD in a relevant field, and industry or lab experience, with fluency in Python and PyTorch to build eval infrastructure and ship quantitative analyses end-to-end. #J-18808-Ljbffr
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior ML Research Engineer: LLM Training & Evaluation Lead in New York, NY vacancy
- ...team is looking for exceptional researchers/scientists to develop the... ...tasks. You will tackle core training challenges in instruction following... ...coverage, and advance evaluation methodologies.Passionate about... ...role shaping the future of our LLM efforts, specifically in transforming...Senior
Apple
New York, NY4 days ago $165k - $310k
...Senior Research Engineer, LLM Training & Post-Training New York, New York, United States; Remote; San Francisco... ...together. Build Great Teams: We lead by example, empower others, and... ...language models are trained, fine‑tuned, evaluated, and deployed across Lightning AI’s...SeniorFor contractorsFor subcontractorWork at officeRemote workWork from homeFlexible hours2 days per weekLightning AI
New York, NY1 day ago- ...reads well today. As a Senior Applied AI / ML Engineer, you'll own AI problems end to end — research, prototyping, production, and the evaluation that keeps... ...you'll do Build LLM systems that turn complex... ...to avoid leakage and train/serve skew ~ Strong...SeniorLocal areaRelocation packageWeekend work
Confido
New York, NY1 day ago $227.2k - $284k
...decisions. As the leading AI data foundry... ...rigorous evaluation with full‑stack... ...paired with applied ML research, design, and... ...Learning Research Engineer, you will... ...This could mean training and fine‑tuning... ...direction, mentor senior and staff‑track... ...training methods, LLM alignment, or...SeniorFull timeScale AI
New York, NY4 days ago$218k - $273k
About the Role As a Senior/Staff Machine Learning Engineer on the General... ...design to evaluation, deployment, and... ...systems that combine LLM reasoning, tool... ...spaces, balancing research‑driven... ...Experience deploying ML systems in cloud... ...relevant education or training. Scale employees...SeniorFull time$235k - $295k
...that lets us understand, evaluate, and continuously... ...experimentation systems, contribute research ideas, and carry... ...partnership with platform engineers. The profile is engineering-first, ML-strong, and research-capable... ...: Experience with LLM agents: tool calling,...Nodi
New York, NY14 hours ago- ...AssemblyAI is seeking a Senior Technical Recruiter to own the full hiring cycle for research and senior engineering roles, including researchers and ML engineers. This role emphasizes building outbound pipelines and close collaboration with technical leaders to define...SeniorRemote work
AI Voice Base
New York, NY3 days ago $189.6k - $237k
...Scale’s ML platform (RLXF) team builds our internal... ...large language model training and inference. The... ...been powering MLEs, researchers, data scientists and... ...training and evaluation of LLM's, as well as evaluation... ...systems Strong software engineering skills, proficient in...Full timeScale AI, Inc.
New York, NY14 hours ago- ...Senior ML Eng Location: NYC (onsite only... ...Alliance is the leading accelerator for... ...Learning Engineer to join our in-... ...extraction, scoring, evaluation, and AI-assisted research. Develop models... ...Improve our LLM systems including... ...data exploration, training code,...SeniorRelocation
DeFi Alliance LLC
New York, NY14 hours ago $300k - $375k
...self-directed Senior Machine Learning Engineer to join their... ...learning and LLM-based systems... ...Own Applied ML End-to-End: Translate... ..., model evaluation, and AI-assisted research workflows.... ...exploration, training pipelines, application... ...within a leading startup ecosystem...SeniorFull timeWork at officeRelocationMLabs Ltd
New York, NY4 days ago$152k - $228k
...Senior ML Engineer About Invoca Invoca is an AI-powered revenue... ...lifecycle at Invoca, from model training and fine-tuning through... ...artifacts, including automated evaluation, versioning, and deployment.... ...Push the Limits of SLM/LLM Deployment Own inference...SeniorCurrently hiringRemote workFlexible hoursInvoca
New York, NY4 days ago- ...Waymo LLC seeks an experienced ML/AI specialist to lead cutting-edge deep learning and ML model development for evaluation systems powering autonomous driving. You will drive end-to-end ML initiatives, build Gen AI LLM/VLM solutions, and collaborate with cross-functional...
Waymo
New York, NY3 days ago $184.05k - $262.93k
...learning, platform engineering, and regulatory... ...rearchitecture and ML-driven systems to... ...scale Own and lead key technical initiatives... ..., and policy evaluation systems Develop... ...including multimodal and LLM-based systems... ...experienced with training, evaluating, and maintaining...SeniorRemote workWork from homeFlexible hoursSpotify
New York, NY14 hours ago$157.95k - $259.48k
...Senior ML/Data EngineerCatapult is building the future... ...for a Senior ML / Data Engineer to build the data... ...transform, serve, and evaluate athlete performance data... ...relationships between athletes, training loads, injuries,... ....Experience with LLM or AI evaluation frameworks...SeniorFull timeTemporary workInternshipCatapult Sports
New York, NY5 days ago- ...than $500 million raised from leading investors including Khosla... ...level will vary depending on the seniority of the role. What you’ll be... ...improvement of our AI agents and other LLM-powered products; Integrate... ...and build the benchmarks to evaluate them; Own agent real-time...Senior
- ...Cohere is the leading security-first... ...problems. We’re training and deploying... ...is a team of researchers, engineers, designers, and... ...looking for a senior engineer to... ...full stack of ML systems, this... ...for large-scale LLM training. Design... ...with evaluation and serving frameworks...SeniorFull timeWork at officeLocal areaRemote workHome office
Cohere
New York, NY5 days ago $200k - $300k
...focus on expanding our ML research platform to benchmark,... ...test both the training and inference environments... ...validated insights to assist engineering teams with platform... ...of how to train, evaluate, and deploy models at... ...: Familiarity with LLM tooling, agentic frameworks...Career Techniques
New York, NY14 hours ago$127k - $235k
...DescriptionAs a Senior Machine Learning Engineer, you will build... ...language model (LLM) systems that extract... ...built, trained, evaluated, and deployed machine... ...machine learning, research engineering, or... ...and operating ML or LLM systems at... ...knowledge to grow, lead, and thrive in...SeniorFull timeWork at officeLocal areaRemote workFlexible hoursThomson Reuters
New York, NY1 day ago$160k - $200k
...ML Research EngineerBoston or NYCLayer Health was founded in 2023 by leading machine learning researchers from MIT and... ...everywhere in healthcare. Our LLM-powered platform is... ...an exceptional ML Engineer to join our team (... ...ML systems (design, training, inference, deployment...Work at officeLayer Health
New York, NY1 day ago$200k - $280k
...ranking and recommendation engine you'll build has to serve both... ...the Role We're hiring a Senior AI/ML Engineer for the Discovery... ..., learning-to-rank, LLM-powered contextual and conversational... ...to end, from features and training through evaluation, deployment, and monitoring...SeniorRemote workFlexible hoursRiverPark Ventures
New York, NY2 days ago$157.95k - $259.48k
...solutions have been leading the way in sports... ...are on the training ground and in the... ...knowledge graph, and the evaluation framework that makes... ...highest-leverage engineering position in Phase... ...Familiarity with LLM evaluation frameworks... ...on the planet! Research shows that while men...Senior$350k
...ML/Research Engineer, SafeguardsSan Francisco, CA | New York City, NYAbout AnthropicAnthropic's mission... ...developing synthetic data pipelines for training classifiers and methods to automatically source representative evaluations to iterate onBuild systems to monitor for...Work at officeVisa sponsorshipFlexible hoursanthropic
New York, NY5 days ago- ...monitoring. In this research role, you’ll... ...with Machine Learning Engineers and Data Scientists... ...signals, explore and evaluate innovative modeling... ...s network. As a Senior Research Scientist, you will lead applied research to... ...Experience with large-scale training, graph systems, and...SeniorWork experience placementLocal area
PLAID
New York, NY1 day ago - ...Machine Learning Engineer - MLOps Hybrid - NYC We... ...own the infrastructure, evaluation, and monitoring that... ...Operate production LLM workloads using Temporal... ...Develop and fine-tune ML models and LLMs while improving... ...model development, training, and fine-tuning experience...SeniorFull time
kadence
New York, NY14 hours ago $180k - $200k
...Insurance Companies is a leading insurance and... ...Starr. The Senior AI/ML engineer is an important,... ...model fine-tuning, evaluation, and... ...manner. Conduct research and stay up-to-date... ...experience working with LLM. ~ Expertise in... ...: experience and training: licensure and certifications...SeniorStarr Insurance Companies
New York, NY3 days ago- ...looking for an experienced Senior Fullstack Data... ...combines Data Science, Python engineering and GenAI solution... ...a strong focus on RAG, LLM applications and AI agents... ...and SFT. Implement LLM evaluation, validators, guardrails... ...development within AI/ML projects. 2+ years of commercial...SeniorContract workRemote work
Senovo IT
New York, NY4 days ago - ...ML Research Engineer InternAt Dynamo AI, an ML Research Engineer Intern will work at the intersection of machine learning research and production... .... You will help design, prototype, and deploy advanced evaluation, guardrailing, and agent security mechanisms across Dynamo...Internship
Dynamo AI
New York, NY5 days ago - ...intersection of cutting‑edge research and real enterprise... ...Design, build, and deploy ML models for demand forecasting... ...data preprocessing, feature engineering, model training, evaluation, and production deployment... ...Architect RAG systems and LLM integrations that power...SeniorImmediate startHome officeVisa sponsorshipFlexible hours3 days per week
Merciv
New York, NY1 day ago - ...seeking a Machine Learning Engineer to join a high-... ...on designing end-to-end ML pipelines, building scalable... ...pipelines for model training, deployment, monitoring... ...Large Language Model (LLM) solutions where applicable... ...Participate in model evaluation, performance tuning, and...Senior
GCS Recruitment
New York, NY3 days ago $220k - $300k
...across the globe to extend our engineering capacity on their behalf. The Role You will own evaluation of a complex multi-agent... ..., the instrument that tells a research-driven team whether their identity... ...3+ years designing and owning LLM evaluation systems ~ Experience...Full timeWork at officePEPOLTek LTD
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Research Engineer: LLM Training & Evaluation Lead. Be the first to apply!
Related searches
- senior ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- machine learning engineer New York, NY
- graduate machine learning engineer New York, NY
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- research assistant engineering New York, NY