Frontier AI ML Engineer — Evaluation & Production Systems
Obsidian
Obsidian is seeking contributors to evaluate frontier AI coding models through structured technical assessments. You will work on realistic ML engineering workflows, model evaluation, and production-ready deployment considerations. The role emphasizes hands-on use of frontier agents, reviewing model-implemented systems, and applying engineering judgment to complex ML scenarios. Collaboration and rapid iteration are key. #J-18808-Ljbffr Obsidian
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Frontier AI ML Engineer — Evaluation & Production Systems in New York, NY vacancy
- Scale AI is shaping the future of enterprise AI with frontier agents deployed across diverse workflows... .... You will design, evaluate, and deploy intelligent systems that combine... ..., and traditional ML, working directly with... .... You will build production-grade AI systems,...Suggested
$152k - $241.5k
...models are foundational to American AI leadership and cybersecurity, and that... ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps find,... ...first. We are looking for an Evaluation/ML-Systems Engineer to own how we measure the...SuggestedFull timeRemote work- Mercor is hiring an ML Engineer (Coding Agent Experience) to work on frontier AI coding agents and production ML tasks in a remote capacity. You will review model-generated implementations... ...workflows, and help improve AI-powered systems. The role requires 2+ years in ML...SuggestedRemote jobContract work
- ...comPhone: (***) ***-****Applied AI / Machine Learning... ...-throughput retrieval systems directly driving... ...generative models and production-grade execution in a fast... ...model routing, automated evaluation frameworks, and low-... ...)6+ years of software engineering and machine learning...Suggested
$235k - $260k
...is building advanced AI and data platforms to... ...organization.The Principal AI/ML Engineer, Semantic Data will... ...workflows across MLS systems.This role combines... ...engineering to build grounded, production-grade AI capabilities.... ..., Evaluation & ReliabilityDesign evaluation...SuggestedWork at officeLocal areaRemote work1 day per week- General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas... ...teams to build the next generation of AI- and machine learning-powered... ...contracts and monitoring practicesBuild evaluation frameworks including dashboards,...Permanent employmentFull timeWork at officeLocal area1 day per week
$139k - $243k
As a Lead DevOps Engineer reporting to the AVP - Systems and Network Administration, you'll play a critical role... ...operating intelligent automation platforms, AI agents, and orchestration frameworks... ..., and develop proofs of concept to evaluate new capabilities. Required...Full timeTemporary workWork at officeHome officeFlexible hours3 days per week- ...seeking an Entry-Level Engineer in Tinton Falls, NJ, to join our AI development team. You will... ...driven features within production-grade systems and collaborate with... ...data preprocessing, model evaluation, and continuous... ...framework, using modern ML frameworks and cloud platforms...
- Chakra Labs in New York, NY is seeking an engineer to tackle frontier problems by building high‑fidelity environments, evaluation tasks, and datasets for frontier AI research. You will push the boundaries of what agents can do, shipping practical deliverables. You will...
- ...the world: leading AI labs, aerospace... ...companies pushing the frontier in chemicals,... ...The Role As AI/ML Engineer, you will build and... ...at the core of our product: models, pipelines, and agent systems that allow Linero... ...sources Build evaluation frameworks, benchmarks...Permanent employmentFull timeImmediate startRemote workRelocationRelocation package
Linero
New York, NY22 hours ago $180k - $240k
...Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was Anthropic... ...build and deploy production AI systems for complex... ...vector stores) and frontier agentic AI... ...systems, and LLM evaluation architectures. This... ...statistics, or applied ML (M.S./Ph.D. or equivalent...Full timeFlexible hoursIndicium Ai
New York, NY22 hours ago$140k - $200k
...way. Our buyers span the top AI labs, RL environment providers... ...problems, and building the products and processes that guide founders... ...is seeking an AI/ML Engineer to turn Asset Hub’s one-of-a-... ...environments, agentic task suites, evaluations and verifiers, and training datasets...Full timeFor contractorsWork at officeLocal areaImmediate startFlexible hours2 days per weekSimpleClosure
New York, NY22 hours ago$100 per hour
...’s fastest-growing AI startups. At... ...still using on-premise systems, and the industry... ...As our Applied AI Engineer , you'll design and ship production AI systems that... ...LLMs to. Build the evaluation frameworks and experimentation... ...to push the frontier of what AI can do...Full timeImmediate startWeekend workDualentry
New York, NY22 hours ago- ...landscape — internal systems, social signals,... ...This is applied AI at its most impactful... ...build, and deploy ML models for demand forecasting... ..., feature engineering, model training, evaluation, and production deployment Architect... ...Stay at the frontier of AI research and...Full timeImmediate start
Decircle
New York, NY22 hours ago - ...Confido is the AI infrastructure powering CPG brands from deduction to production plan. We unify cash application, deductions, disputes, trade... ...our momentum. As a Senior AI / ML Engineer , you will help build the core AI systems powering the Confido platform—from...Full timeLocal areaRelocation packageNight shift
Confido
New York, NY22 hours ago $170k - $200k
...real world is the next frontier, and at Metropolis, we... ...is seeking a Senior AI Engineer to join our Applied AI... ...enormous scope: you will own systems end-to-end, from the... ...layer through to production deployment, working side... ...quality over time Evaluate and integrate emerging...Full timeTemporary workWork at officeLocal areaImmediate startMetropolis Corp
New York, NY22 hours ago$200k - $300k
Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow... ...for someone capable of building production-grade voice AI infrastructure and conversational... .... Create scalable testing and evaluation frameworks incorporating A/B testing,...Permanent employmentFull timeRelocationVisa sponsorship$150k - $160k
...mission-critical systems running... ...productionization of AI capabilities across... ...AI-powered products at scale and now... ...a Senior AI Engineer (Full-Stack / Applications... ...systems: from evaluating and optimizing... ...knowledge of frontier AI models,... ...processes within an AI/ML team context,...Full timeContract workTemporary workWork at officeLocal areaRemote work- ...agentic software products in the industries... ...management, design, and engineering together with the... ...an exceptional AI-native software engineer... ...product judgment, systems thinking, and a... ...tests and evaluations, and review generated... ...genuine interest in frontier AI and a consistent...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
$400 per month
Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience...€30k per year
...Build the Next Generation of AI Products with TensorOps TensorOps is an applied machine... ...design, train, and deploy production-grade ML systems. Our clients range from NASDAQ-listed... ...use: Python APIs: FastAPI Data Engineering: Pandas, Polars LLM Frameworks:...InternshipRemote workWorldwideTensorOps
New York, NY1 day ago- ...the machine-learning systems at the core of a live, AI-native fashion product (self-hosted and frontier models, computer... ...a real, production ML system running our own... ...our first handful of engineers, working shoulder-to... ...shot calibration, the evaluation harnesses, and the...Remote workFlexible hoursShift work
Andreessen Horowitz
New York, NY3 days ago - Finch is building AI to streamline legal workflows for U.... ...own the full lifecycle of AI systems—from prototype to production—solving real production... ...You’ll ship production-grade ML solutions, collaborate with... ...product and legal teams, and evaluate new research to stay ahead....Work at office
- ...A leading AI solutions provider in New York is seeking a talented ML Engineer to design, build, and deploy innovative ML systems. The role involves collaborating with cross-functional teams and engaging directly with customers to deliver impactful AI solutions. Candidates...
Catalyst Labs, LLC
New York, NY22 hours ago - ...insight. Rillet is the AI-native ERP built for... ...As an Applied AI Engineer on Rillet's AI & ML team, you'll design and ship production AI systems that transform how... ...to. Build the evaluation frameworks and experimentation... ...experts to push the frontier of what AI can do...Work at officeRemote workRelocationFlexible hours1 day per week
Rillet
New York, NY5 days ago - ...first enterprise AI company. We... ...and end-to-end products that are designed... ...and deploying frontier models for enterprises... ...building AI systems. We believe... ...of researchers, engineers, designers, and... ...full stack of ML systems, this role... ...with evaluation and serving frameworks...Full timeWork at officeLocal areaRemote workHome office
$190.2k - $360.5k
...are looking for a Principal AI Systems Engineer with deep C++ expertise to... ...next generation of AI-enabled product and platform capabilities.... ...integration layers, evaluation systems, and reliability mechanisms... ...Experience with frontier model APIs such as GPT, Claude...Full timeTemporary workLocal areaRemote workWorldwide$180k - $225k
Wealth.com is looking for a Software Engineer specializing in AI/ML to create next-generation applications that deliver value to users.... ..., and C#. The role involves designing and deploying production-grade AI systems and collaborating across the tech stack. Candidates...- DescriptionBuild an automated evaluation harness covering correctness, prompt stability, hallucination... ..., and guardrail enforcement across all production agents.Stand up an LLM-as-judge... ...evaluation frameworks to validate AI agent correctness, stability, hallucination...Full time
- A rapidly growing startup in New York is seeking an experienced ML Engineer to design, develop, and deploy production-grade machine learning systems. The candidate will work with state-of-the-art AI technology to convert audio data into actionable insights. Responsibilities...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Frontier AI ML Engineer — Evaluation & Production Systems. Be the first to apply!
Related searches
- ai research engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- senior ai engineer New York, NY
- ai engineer New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- ai engineer remote New York, NY
- data scientist machine learning engineer New York, NY
- computer vision machine learning engineer New York, NY