AI Systems Engineer: Frontier Model Evaluator
$400 per monthObsidian
Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks. Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours. #J-18808-Ljbffr Obsidian
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer: Frontier Model Evaluator in New York, NY vacancy
- Chakra Labs in New York, NY is seeking an engineer to tackle frontier problems by building high‑fidelity environments, evaluation tasks, and datasets for frontier AI research. You will push the boundaries of what agents can do, shipping practical deliverables. You will...Suggested
$190.2k - $360.5k
...are looking for a Principal AI Systems Engineer with deep C++ expertise to help... ...service integration layers, evaluation systems, and reliability... ...powered services, agents, and model-backed workflows. Define... ...Qualifications Experience with frontier model APIs such as GPT, Claude...SuggestedFull timeTemporary workLocal areaRemote workWorldwide- ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred... ...infrastructure powering large-scale model training and inference. This role sits... ...cost, latency, and scalability of frontier AI models High autonomy-own entire...SuggestedFull timeNew York, NYmore than 2 months ago
- Reflection, based in New York, is seeking an experienced professional to build and scale distributed training systems for frontier model pre-training. You will work closely with research teams to design large-scale training runs and optimize training efficiency across...Suggested
$20 per hour
...technical talent with leading AI research labs. Headquartered in... .... Generate high-quality human evaluation data by identifying response... ...completeness of responses. Ensure model responses align with expected conversational behavior and system guidelines. Work independently...SuggestedRemote jobContract workPart timeSummer work$105.9k - $231k
## Model-Based Systems EngineerApplylocations: Penn State University Parktime type: Full timeposted on: Posted Todayjob requisition id: REQ\... ...POSITION SPECIFICS**We are searching for highly motivated Systems Engineers with experience in Model‐Based Systems Engineering (MBSE) to...For contractorsWork experience placementWork at officeRemote workWork from homeFlexible hours- ...human intelligence to power the AI economy. We're a leading AI... ...between human expertise and frontier models. Millions of domain experts on... ...the forefront of shaping the systems that are redefining society.... ...architecture is not set. Early engineers will decide what it becomes,...Full timeWork at officeRelocation package
Mercor
New York, NY13 hours ago - Watershed is seeking an experienced GTM Engineer to architect and operate the systems, AI, and data infra powering our GTM org. You will design Salesforce data models, lead integrations, and deploy automation that accelerates pipeline velocity and sales efficiency across...Work at office
- ...About the Team API Frontiers turns OpenAI’s frontier models into production APIs that developers... ...for a backend software engineer to build and operate the... ...work combines distributed systems engineering with product judgment... ...OpenAI OpenAI is an AI research and deployment...Full time
OpenAI
New York, NY13 hours ago $100 per hour
...s fastest-growing AI startups. At... ...using on-premise systems, and the industry... ...As our Applied AI Engineer , you'll design and... ...end-to-end, from model integration to infrastructure... ...to. Build the evaluation frameworks and... ...to push the frontier of what AI can do...Full timeImmediate startWeekend workDualentry
New York, NY13 hours ago$200k - $300k
...Farsight is the agentic AI platform for... ...refining their decks, models, and pitches. We... ...by scalable engineering and AI skills from... ..., and own agentic systems that produce client... ...output. Build the evaluation and quality systems... ...current fluency with frontier model APIs and...Full timeLocal areaRemote workFarsight Ai
New York, NY13 hours ago$166.6k - $218.7k
...company-wide bet on AI. Frontier users are already pushing... ...connect internal systems and data sources into... ...interface for agents and engineers. Expand and... ...Build playgrounds and evaluation harnesses so internal... ...AI deployments: cost modeling, observability, latency...Full timeShift workMercury
New York, NY13 hours ago$180k - $240k
...Deployed Software Engineer — US / NYC About Indicium AI Indicium AI was... ...deploy production AI systems for complex... ...vector stores) and frontier agentic AI execution... ...retrieval systems, and LLM evaluation architectures.... ...impact as they do about model accuracy, protocol...Full timeFlexible hoursIndicium Ai
New York, NY13 hours ago- ...About Build AI for the Built World: Build has created the agentic AI stack for institutional... ...and even governments to push the frontier of what's possible. We're backed by c-suite... ...the underlying capability Build the evaluation harness that proves whether a change made...Full timeLive in
Build Technologies
New York, NY13 hours ago $175k - $275k
...pulls, and disconnected systems, spending more time... ...building the agentic AI platform designed exclusively... ...'re looking for an AI Engineer to help build the... ...reliable Fine-tune and evaluate models - fine-tune in-house... ...them against frontier baselines, and make the...Full timeWork at officeTranslucent Inc
New York, NY13 hours ago$90k - $95k
...Are you someone who builds AI agents and thinks about how... ...looking for a full-time AI Engineer to help shape and execute Fanatics... ...and agentic workflows using frontier models (Claude, GPT, Gemini) and... ...best practices, including tool evaluation, security and InfoSec...Full timeTemporary workWork at officeFanatics Inc
New York, NY13 hours ago- ...Founding AI Engineer (AI + Production) New York City (5 days on-site) · Top of market... ...from evals to fine-tuning. Push the frontier on physics models, world models, and AI-accelerated simulations... ...breakthroughs into production systems that ship—and push beyond LLMs into physics...Full timeImmediate startWeekend work
Everstar
New York, NY13 hours ago $170k - $200k
...real world is the next frontier, and at Metropolis, we... ...Metropolis is seeking a Senior AI Engineer to join our Applied AI... ...scope: you will own systems end-to-end, from the... ...maintain quality over time Evaluate and integrate emerging AI tooling (models, frameworks, APIs) to...Full timeTemporary workWork at officeLocal areaImmediate startMetropolis Corp
New York, NY13 hours ago$405k
...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...systems, tooling, and evaluation infrastructure that... ...that measure model capabilities across diverse... ...infrastructure—and get to the frontier quickly Care deeply...Full timeWork at officeVisa sponsorshipFlexible hoursAnthropic
New York, NY13 hours ago$200k - $300k
...Job Description Job Description Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot... ..., and agent behavior. Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing,...Permanent employmentFull timeRelocationVisa sponsorshipHireNow Staffing
New York, NY18 days ago$184k - $259.44k
...Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic... ..., you will own the model inference layer - enabling... ...scalable backend systems for Public Sector... ...a fair and thorough evaluation of all applicants....Full timeWork at office3 days per weekEarly shiftScale Ai, Inc.
New York, NY13 hours ago- CNN is seeking a Senior Design Technologist to bridge design, engineering, and AI capabilities. The role emphasizes creating scalable UI and... ...and be proficient in Figma, with a strong grounding in design systems and UX principles. The position offers a competitive salary...
$200k
...with mission-critical systems running royalties,... ...productionization of AI capabilities across... ...ROLEAs a Senior AI Engineer (Full-Stack / Applications... ...systems: from evaluating and optimizing models, to integrating them... ...-depth knowledge of frontier AI models, evaluation...Full timeContract workTemporary workWork at officeLocal areaRemote work- ...creating the agentic AI stack for the... ...drawings, financial models, market data, approvals... ...looking for an AI engineer, product to build... ...build AI-powered systems that help experts... ..., observability, evaluation, and developer... ...will build at the frontier of agentic AI, product...Full time
Build Technologies
New York, NY13 hours ago $240k - $320k
...ambitious companies go from AI-absent to AI-native. We... ...of strategy and engineering, embedding elite AI SWAT... ...’ll ship production AI systems — walking into client codebases... .... You’ll build with frontier AI tools (Claude Code,... ...operators • Test new models and tools as they...Full timeFlexible hoursTenex Llc
New York, NY13 hours ago$200k - $245k
...leading research accelerator for frontier AI labs and a trusted partner... ...to deploy advanced AI systems. Turing accelerates frontier... ...with a team of other Turing engineers across different skill sets.... ...deployment of large language models, leveraging techniques like prompt...Full timeFlexible hoursTuring
New York, NY13 hours ago$136k - $207.08k
...organization, we're building the AI behind dentsu's next-generation platform — frontier AI and real production engineering applied to media,... ...deliver scalable AI systems for content... ...Improvement: Monitor, evaluate, and iterate on AI models using real-world data...Full timeTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week- ...management, design, and engineering together with the... ...an exceptional AI-native software... ...product judgment, systems thinking, and a high... ...tests and evaluations, and review generated... ...architecture, data models, backend services,... ...genuine interest in frontier AI and a consistent...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
$150k - $300k
...transforms civil, structural, and MEP engineering firms with applied AI. We’re an AI laboratory dedicated to... .... By arming designers with frontier technology, our ambition is to build... ...initial iterations of our operating system that will power this transformation....Full timeWork at officeEagle
New York, NY13 hours ago- ...operates. We build AI-first, agent-driven... ...its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG), evaluation frameworks, and traditional... ...seeking an AVP, AI Engineering to lead the design... ...specialized models and agents to solve...Full timeTemporary workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer: Frontier Model Evaluator. Be the first to apply!
Related searches
- ai research engineer New York, NY
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai engineer remote New York, NY
- ai developer New York, NY
- ai prompt engineer New York, NY
- machine learning ai engineer New York, NY
- ai engineer New York, NY
- system support engineer New York, NY
- healthcare systems engineer New York, NY