Frontier AI ML Engineer — Evaluation & Production Systems
Obsidian
Obsidian is seeking contributors to evaluate frontier AI coding models through structured technical assessments. You will work on realistic ML engineering workflows, model evaluation, and production-ready deployment considerations.
The role emphasizes hands-on use of frontier agents, reviewing model-implemented systems, and applying engineering judgment to complex ML scenarios. Collaboration and rapid iteration are key.
#J-18808-LjbffrVacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Frontier AI ML Engineer — Evaluation & Production Systems in New York, NY vacancy
- ...Scale AI is shaping the future of enterprise AI with frontier agents deployed across diverse... .... You will design, evaluate, and deploy intelligent systems that combine frontier... ...retrieval, and traditional ML, working directly... ...You will build production-grade AI systems,...Suggested
Front Door Defense
New York, NY8 hours ago $152k - $241.5k
...models are foundational to American AI leadership and cybersecurity, and that... ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps find,... ...first. We are looking for an Evaluation/ML-Systems Engineer to own how we measure the...SuggestedFull timeRemote work- ...Mercor is hiring an ML Engineer (Coding Agent Experience) to work on frontier AI coding agents and production ML tasks in a remote capacity. You will review model-generated implementations... ...workflows, and help improve AI-powered systems. The role requires 2+ years in ML...SuggestedContract workRemote work
Mercor
New York, NY8 hours ago - ...comPhone: (***) ***-****Applied AI / Machine Learning... ...-throughput retrieval systems directly driving... ...generative models and production-grade execution in a fast... ...model routing, automated evaluation frameworks, and low-... ...)6+ years of software engineering and machine learning...Suggested
$235k - $260k
...is building advanced AI and data platforms to... ...organization.The Principal AI/ML Engineer, Semantic Data will... ...workflows across MLS systems.This role combines... ...engineering to build grounded, production-grade AI capabilities.... ..., Evaluation & ReliabilityDesign evaluation...SuggestedWork at officeLocal areaRemote work1 day per week- General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas... ...teams to build the next generation of AI- and machine learning-powered... ...contracts and monitoring practicesBuild evaluation frameworks including dashboards,...Permanent employmentFull timeWork at officeLocal area1 day per week
$139k - $243k
As a Lead DevOps Engineer reporting to the AVP - Systems and Network Administration, you'll play a critical role... ...operating intelligent automation platforms, AI agents, and orchestration frameworks... ..., and develop proofs of concept to evaluate new capabilities. Required...Full timeTemporary workWork at officeHome officeFlexible hours3 days per week- ...Duties Build agentic AI systems: Design and implement... ...MCP protocol. Engineer robust guardrails for... ...Productionize LLMs: Build evaluation framework for open‑source... ...correction loops tailored to production operations.... ...launching production ML systems, including model...Hourly payRemote work
NTT DATA North America
New York, NY4 days ago - ...Confido is the AI infrastructure powering CPG brands from deduction to production plan. We unify cash application, deductions, disputes, trade... ...our momentum. As a Senior AI / ML Engineer , you will help build the core AI systems powering the Confido platform—from...Full timeLocal areaRelocation packageNight shift
Confido
New York, NY1 day ago $180k - $240k
...Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was Anthropic... ...build and deploy production AI systems for complex... ...vector stores) and frontier agentic AI... ...systems, and LLM evaluation architectures. This... ...statistics, or applied ML (M.S./Ph.D. or equivalent...Full timeFlexible hoursIndicium Ai
New York, NY1 day ago- ...the world: leading AI labs, aerospace... ...companies pushing the frontier in chemicals,... ...The Role As AI/ML Engineer, you will build and... ...at the core of our product: models, pipelines, and agent systems that allow Linero... ...sources Build evaluation frameworks, benchmarks...Permanent employmentFull timeImmediate startRemote workRelocationRelocation package
Linero
New York, NY1 day ago - ...landscape — internal systems, social signals,... ...This is applied AI at its most impactful... ...build, and deploy ML models for demand forecasting... ..., feature engineering, model training, evaluation, and production deployment Architect... ...Stay at the frontier of AI research and...Full timeImmediate start
Decircle
New York, NY1 day ago $100 per hour
...’s fastest-growing AI startups. At... ...still using on-premise systems, and the industry... ...As our Applied AI Engineer , you'll design and ship production AI systems that... ...LLMs to. Build the evaluation frameworks and experimentation... ...to push the frontier of what AI can do...Full timeImmediate startWeekend workDualentry
New York, NY1 day ago$140k - $200k
...way. Our buyers span the top AI labs, RL environment providers... ...problems, and building the products and processes that guide founders... ...is seeking an AI/ML Engineer to turn Asset Hub’s one-of-a-... ...environments, agentic task suites, evaluations and verifiers, and training datasets...Full timeFor contractorsWork at officeLocal areaImmediate startFlexible hours2 days per weekSimpleClosure
New York, NY1 day ago$170k - $200k
...real world is the next frontier, and at Metropolis, we... ...is seeking a Senior AI Engineer to join our Applied AI... ...enormous scope: you will own systems end-to-end, from the... ...layer through to production deployment, working side... ...quality over time Evaluate and integrate emerging...Full timeTemporary workWork at officeLocal areaImmediate startMetropolis Corp
New York, NY1 day ago- Chakra Labs in New York, NY is seeking an engineer to tackle frontier problems by building high‑fidelity environments, evaluation tasks, and datasets for frontier AI research. You will push the boundaries of what agents can do, shipping practical deliverables. You will...
$150k - $160k
...mission-critical systems running... ...productionization of AI capabilities across... ...AI-powered products at scale and now... ...a Senior AI Engineer (Full-Stack / Applications... ...systems: from evaluating and optimizing... ...knowledge of frontier AI models,... ...processes within an AI/ML team context,...Full timeContract workTemporary workWork at officeLocal areaRemote work$200k - $300k
Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow... ...for someone capable of building production-grade voice AI infrastructure and conversational... .... Create scalable testing and evaluation frameworks incorporating A/B testing,...Permanent employmentFull timeRelocationVisa sponsorship- ...agentic software products in the industries... ...management, design, and engineering together with the... ...an exceptional AI-native software engineer... ...product judgment, systems thinking, and a... ...tests and evaluations, and review generated... ...genuine interest in frontier AI and a consistent...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
$400 per month
Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience...- ...A leading AI solutions provider in New York is seeking a talented ML Engineer to design, build, and deploy innovative ML systems. The role involves collaborating with cross-functional teams and engaging directly with customers to deliver impactful AI solutions. Candidates...
Catalyst Labs, LLC
New York, NY4 days ago - Finch is building AI to streamline legal workflows for U.... ...own the full lifecycle of AI systems—from prototype to production—solving real production... ...You’ll ship production-grade ML solutions, collaborate with... ...product and legal teams, and evaluate new research to stay ahead....Work at office
- ...first enterprise AI company. We... ...and end-to-end products that are designed... ...and deploying frontier models for enterprises... ...building AI systems. We believe... ...of researchers, engineers, designers, and... ...full stack of ML systems, this role... ...with evaluation and serving frameworks...Full timeWork at officeLocal areaRemote workHome office
$180k - $275k
...a senior applied AI engineering role focused on building the AI systems layer behind a B2B... ...platform. You'll own the production systems that... ...retrieval, orchestration, evaluation, and model... ...on top of hosted frontier LLM APIs (OpenAI,... ...production software, ML systems, or...Full timebareinsights
New York, NY3 days ago$170k - $230k
...Join a fast-growing, AI-native consumer... ...brands. As a Senior ML/AI Engineer , you'll work at... ...designing intelligent systems that drive measurable... ..., model training, evaluation, and production deployment Architect... ...Stay at the frontier of AI research and bring...Full timeLocal areaRelocationClera
New York, NY6 days ago$190.2k - $360.5k
...are looking for a Principal AI Systems Engineer with deep C++ expertise to... ...next generation of AI-enabled product and platform capabilities.... ...integration layers, evaluation systems, and reliability mechanisms... ...Experience with frontier model APIs such as GPT, Claude...Full timeTemporary workLocal areaRemote workWorldwide- ...Wealth.com seeks a Software Engineer, AI to build the next generation of AI-powered applications. This is a builder role delivering production-grade, agentic systems. You will operate at the intersection of AI, product, and engineering, turning ambiguous ideas into scalable...
Wealth Inc.
New York, NY8 hours ago $180k - $225k
...Wealth.com is looking for a Software Engineer specializing in AI/ML to create next-generation applications that deliver value to users... ..., and C#. The role involves designing and deploying production-grade AI systems and collaborating across the tech stack. Candidates...Wealth.com
New York, NY8 hours ago- DescriptionBuild an automated evaluation harness covering correctness, prompt stability, hallucination... ..., and guardrail enforcement across all production agents.Stand up an LLM-as-judge... ...evaluation frameworks to validate AI agent correctness, stability, hallucination...Full time
$140k - $300k
...part of R1 and its AI innovation engine, R37 Lab , bringing Phare’s frontier clinical reasoning... ...Revenue Operating System : a connected... ...systems already power production workflows across 9... ...it. The Role As a ML Engineer, you’ll... ...defining the right evaluation datasets, metrics,...Work at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI ML Engineer — Evaluation & Production Systems. Be the first to apply!
Related searches
- ai ml engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer New York, NY
- ai research engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai engineer remote New York, NY
- senior ml engineer New York, NY
- computer vision machine learning engineer New York, NY