ML Research Engineer: End-to-End AI Evaluation & Experiments
Full-time
24-Mag Llc
24-MAG LLC is offering a fully remote, full-time opportunity for machine learning engineers and research practitioners to design, implement, and evaluate end-to-end ML benchmarks.
You will transform real ML ideas into multi-step tasks, run experiments in Python notebooks, analyze training behavior, and assess model-generated solutions for correctness. Collaboration with researchers and task authors is expected, with ~35 hours/week and competitive hourly rates.
#J-18808-LjbffrVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Research Engineer: End-to-End AI Evaluation & Experiments in New York, NY vacancy
$189.6k - $237k
Scale’s ML platform (RLXF) team builds... ...powering MLEs, researchers, data... ...automatic training and evaluation of LLM's, as... ...of the field of AI as an... ...evaluation data and end-to-end solutions... ...systemsStrong software engineering skills,... ...related skills, experience, qualifications...SuggestedFull time$264.8k - $331k
Scale AI is the data foundation for... ...Learning Engineer (MLE) on the General... ...design to evaluation, deployment, and... ...and implement end-to-end agent systems... ...:5+ years of experience building and deploying... ..., balancing research-driven... ...Experience deploying ML systems in cloud...SuggestedFull time- ...world-class scientists, ML researchers, and engineers to work together to... ...architectures for AI x Chemistry:... ...own impactful work end-to-end, from ideation... ...to flexibly conduct experiments at scale, pushing the... ...generation, training, and evaluations for our machine learning...SuggestedWork at office
Achira
New York, NY20 hours ago - ...Sciemo builds AI for consumer goods:... ...deployment of complex ML systems reporting to... ...and Machine Learning Engineer, you will play a... ...Design and implement end-to-end AI workflows... ...engineering, modeling, evaluation, and deployment.... ...data collection, experiment design, and roadmap...SuggestedFull timeWork at officeRemote work
Sciemo
New York, NY20 hours ago $197.3k - $313.7k
...best candidate experience, please consider... ...is the #1 AI CRM, where humans... ...software and platform engineers to embed in our... ...world-class research and products... ...pipelines to support ML and AI efforts.... ..., UIs, agentic evaluators, and more.Roll... ....Help with end-user requirements...SuggestedFull time$110.7k - $379.2k
Position Summary Research Engineer — Post-Training &... ...Models (SLMs), Healthcare AI Three hundred fifty... ...you will design, train, evaluate, and align the models... ...clinical reasoning models end to end — from data and... ...- Required Skills and Experience • Bachelor’s degree in...Local areaVisa sponsorship- ...At Maple, we're building AI agents that work for restaurants... ...About the Role As an ML Research Engineer at Maple, you'll be a part... ...production inference. Lead evaluations, error analysis, and... ...PyTorch or JAX; optimization experience with CUDA/Triton preferred....Work at officeLocal area
Maple AI, Inc
New York, NY4 days ago $300k - $375k
...Senior Machine Learning Engineer to join their in-house engineering... ...Own Applied ML End-to-End: Translate ambiguous... ...problems into datasets, experiments, models, and production systems... ..., scoring, model evaluation, and AI-assisted research workflows. Model Design...Full timeWork at officeRelocationMlabs, Inc.
New York, NY20 hours ago$100k - $250k
...Radical AI, Inc. is an artificial... ...accelerating scientific research & development.... ...blends AI, engineering, and materials... ...As an ML Engineer at Radical... ...development of an end-to-end AI-... ...automation. Experiment with cutting-edge... ...Continually evaluate model performance...Full timeRadical Ai
New York, NY20 hours ago$77k - $202k
...skills, knowledge, and experiences you need to lead and deliver... ...experience in software engineering or data engineeringWhat... ...- Designing AI agent systems for development... ...RequirementsUp to 80%Job Posting End DateThe salary range... ...with team members. We evaluate these factors...Full timeH1b- ...ML Engineer New York, New York, United States About... ...teams work. Their AI technology captures and... ...their in-person customer experiences. About Us... ...grade ML systems with end-to-end ownership of the... ...for model training and evaluation. Familiarity with FastAPI...Full time
Catalyst Labs, LLC
New York, NY20 hours ago - ...AI Agent Pipeline Engineer Triomics is building the agentic AI layer... ...extraction agents, evaluating accuracy, deploying to... ...Own accuracy end-to-end: define evaluation... ...~2+ years building ML/AI systems in production... ...scripts ~ Practical LLM experience: prompt engineering,...
Triomics
New York, NY1 day ago $101.49k - $132.09k
...education, scientific research, and direct... ...Research Engineer. The newly... ...multimodal ML systems for musculoskeletal... ...navigate open-ended scientific... ...and experience. You will work... ...lifecycle of our early AI initiatives. You... ...and rigorously evaluate model performance...NYU Grossman School of Medicine
New York, NY4 days ago$270k - $380k
...first enterprise AI company. We build... ...foundation AI models and end-to-end products... ...is a team of researchers, engineers, designers, and... ...model training and evaluation. You will own the... ...with the ML modeling team to... ...statistical skills and experience evaluating scientific...Work at officeLocal areaRemote workHome office$124k - $335k
...individuals combine technical experience with creative thinking... ....Those in software engineering at PwC will focus on... ...of tax services through AI-enabled capabilities, collaborating... ...to 20%Job Posting End DateThe salary range... ...with team members. We evaluate these factors...Full timeH1b$150k - $300k
...structural, and MEP engineering firms with applied AI. We’re an AI laboratory... ...‑parsing pipeline end-to-end—ingestion of... ...acquisition Build the evaluation harness this all... ...computer vision and VLM experience, ideally on... ...engineering role, not a research‑only one Has the rigor...Work at officeeagle as
New York, NY4 days ago- ...first enterprise AI company. We build... ...foundation AI models and end-to-end products... ...is a team of researchers, engineers, designers, and... ...the full stack of ML systems, this... ...HaveStrong engineering experience in large-scale... ...Familiarity with evaluation and serving frameworks...Full timeWork at officeLocal areaRemote workHome office
$198.2k - $420k
...build, and operate AI-native enterprise... ...cloud-native software engineering with production-... ...delivery end-to-end — from problem... ...engineering practices, evaluation frameworks, and... ...years of hands-on experience in software and application... ...in widely used AI/ML Python libraries...Permanent employmentFull timeWorldwideFlexible hours- ...Information Job Title ML Staff Engineer - LLM & Production... ..., cultures, experiences, perspectives, and skills... ...the next generation of AI- and machine learning-... ...planningOwn ML Platforms End-to-EndLead the design,... ...monitoring practicesBuild evaluation frameworks including...Permanent employmentFull timeWork at officeLocal area1 day per week
$99k - $266k
...individuals combine technical experience with creative thinking... ....Those in software engineering at PwC will focus on... ...build, and run innovative AI- and data-intensive tax... ...to 20%Job Posting End DateThe salary range for... ...with team members. We evaluate these factors thoughtfully...Full timeH1b$216k - $270k
...is to develop reliable AI systems for the world’... ..., combining rigorous evaluation with full-stack deployment... ..., paired with applied ML research, design, and... ...Machine Learning Research Engineer, you will operate across... ...validate them with rigorous experiments before they ship,...Full time$146.8k - $272.6k
...We are seeking a Lead Research Engineer who will bring expertise in AI and ML and is interested in building... ...Reuters Labs do? We experiment, we build, we deliver.... ...and be accountable for end-to-end deliveries. Be... ...research scientists to evaluate, prototype and...Full timeWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week$197.2k - $266.8k
...problems, running countless experiments (300+ at a time!)... ...looking for a Senior AI Research Engineer to join our Duolingo... ...levels of the ML stack, including feature... ...reinforcement learning, quality evaluations, deployment, and... ...use an email that ends in @duolingo.com or @...Work experience placement$264.8k - $331k
AI is becoming vitally important in every function of our society... ...the world. The Enterprise ML Research Lab works on the front lines... ...including job-related skills, experience, qualifications, interview... ...to ensure a fair and thorough evaluation of all applicants.About Us:At...Full time$180k - $250k
...building the future of AI-driven defense -... ...software engineers, AI researchers, security engineers... ...for exceptional AI/ML Engineers to help... ...build, and ship end-to-end features and... ...decisions – Evaluate trade-offs across... ...Qualifications Experience training, deploying...Full timeArtemis
New York, NY20 hours ago- ...This is applied AI at its most impactful... ...of cutting-edge research and real... ...build, and deploy ML models for demand... ...preprocessing, feature engineering, model training, evaluation, and production... ...performance end-to-end:... ...of applied ML/AI experience with models deployed...Full timeImmediate start
Decircle
New York, NY20 hours ago $170k - $230k
...fast-growing, AI-native consumer... ...cutting-edge AI research and real... ..., high-caliber engineering team, with direct... ...build, and deploy ML models for demand... ...training, evaluation, and production... ...model performance end-to-end: monitoring... ...~5+ years of experience in Machine...Full timeWork at officeRelocationClera
New York, NY20 hours ago$245k - $272k
...Rewards philosophy.AI is a... ...technology evolves. AI experience requirements... ...decisions, and mentor engineers across the... ...impact group of ML engineers and... ...guardrails, and evaluation infrastructure.... ...current with AI/ML research; rapidly... ...and deploying end-to-end AI/ML systems...Full timeWork at officeLocal areaRemote work2 days per week3 days per week$189.3k - $320.7k
...create vehicles and experiences that are designed... ...the Embodied AI team at General Motors... ....As a Staff AI/ML Future Sensing Engineer in the Embodied... ...contributor driving end-to-end technical... ...help define and evaluate machine learning... ...will help translate research into scalable...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$140k - $200k
...Most companies don’t end in acquisition —... ...span the top AI labs, RL environment... ...is seeking an AI/ML Engineer to turn Asset Hub’... ...agentic task suites, evaluations and verifiers, and... ...nice-to-have. Experience: 4–8 years of engineering... ...to lab and RLE researchers. Nice to have:...Full timeFor contractorsWork at officeLocal areaImmediate startFlexible hours2 days per weekSimpleClosure
New York, NY20 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Research Engineer: End-to-End AI Evaluation & Experiments. Be the first to apply!
Related searches
- senior ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- engineering business analyst New York, NY
- deep learning research engineer New York, NY