AI Systems Engineer: Frontier Code Agents Evaluator
$400 per monthObsidian
Obsidian is seeking systems engineers to join a project in partnership with a leading AI research lab. Candidates will utilize frontier AI coding agents to assist in evaluating complex engineering tasks and model performance. Responsibilities include reviewing code, identifying issues, and applying engineering judgment to enhance systems design.
The role offers competitive compensation of $400 per accepted task, requiring an estimated 2–3 hours of work. Applicants should have over 2 years of relevant experience in systems engineering.
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer: Frontier Code Agents Evaluator in New York, NY vacancy
$400 per month
...contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks. Contributors will review code,... ...outputs from different models. Strong systems engineering experience is essential,...Suggested$400 per month
Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience...Suggested- ...San Francisco, is seeking a Software Engineering evaluator to join as a contractor in the United States. You will curate code examples, evaluate AI-generated code, and collaborate with... ...Rust, Go, Java, JavaScript) focusing on systems-level code, performance, and...SuggestedFor contractorsFlexible hours
$200k - $300k
...Job Description Job Description Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot... ..., and agent behavior. Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing,...SuggestedPermanent employmentFull timeRelocationVisa sponsorshipHireNow Staffing
New York, NY21 days ago$143.2k - $243.4k
...Description It all started when engineer Fred Luddy wrote code that automated a tedious... .... Today, ServiceNow is the AI control tower for business... ...the Role : As a Senior AI Agent Engineer / Federal at... ...ServiceNow Platform with enterprise systems (ITSM, HRIS, identity,...SuggestedPermanent employmentWork at officeImmediate startRemote workFlexible hours$200k - $225k
...fully customizable operating system built to help local media... ...evolution of local media. AI Code Engineering Lead Madhive is seeking... ...and building-block templates, evaluation frameworks, and... ...across the full SDLC (AI coding agents, eval/observability frameworks...Work at officeLocal area3 days per weekMadHive
New York, NY3 days ago- ...intelligence to power the AI economy. We're a... ...expertise and frontier models. Millions of... ...directly back into agents. Mercor is creating... ...of shaping the systems that are redefining... ...can't be captured in code alone. Today, more... ...is not set. Early engineers will decide what it...Full timeWork at officeRelocation package
Mercor
New York, NY1 day ago - ...Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-site preferred) Comp: Competitive + equity (Series... ...) Direct impact on cost, latency, and scalability of frontier AI models High autonomy-own entire subsystems (kernel...Full timeNew York, NYmore than 2 months ago
- ...About the Team API Frontiers turns OpenAI’s... ...reliable products and agents. We own the core path... ...a backend software engineer to build and... ...combines distributed systems engineering with product... ...efficient systems code, and persistent connections... ...OpenAI is an AI research and...Full time
OpenAI
New York, NY1 day ago $170k - $200k
...real world is the next frontier, and at Metropolis, we... ...is seeking a Senior AI Engineer to join our Applied AI... ...enormous scope: you will own systems end-to-end, from the... ...quality over time Evaluate and integrate emerging... ...clean, maintainable code and are comfortable...Full timeTemporary workWork at officeLocal areaImmediate startMetropolis Corp
New York, NY1 day ago- Reflection, based in New York, is seeking an experienced professional to build and scale distributed training systems for frontier model pre-training. You will work closely with research teams to design large-scale training runs and optimize training efficiency across...
$90k - $95k
...you someone who builds AI agents and thinks about how... ...looking for a full-time AI Engineer to help shape and... ...agentic workflows using frontier models (Claude, GPT,... ...practices, including tool evaluation, security and InfoSec... .... Comfort working in code (Python preferred) and...Full timeTemporary workWork at officeFanatics Inc
New York, NY1 day ago$166.6k - $218.7k
...company-wide bet on AI. Frontier users are already... ...—building agents, automating workflows... ...connect internal systems and data sources into... ...interface for agents and engineers. Expand and... ..., and policy-as-code so teams can move... ...Build playgrounds and evaluation harnesses so...Full timeShift workMercury
New York, NY1 day ago$190.2k - $360.5k
...looking for a Principal AI Systems Engineer with deep C++... ...integration layers, evaluation systems, and reliability... ...architecture, production code, AI system design,... ...AI-powered services, agents, and model-backed workflows... ...Experience with frontier model APIs such as GPT...Full timeTemporary workLocal areaRemote workWorldwide$405k
...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...on the Claude Code team. In this role, you... ...systems, tooling, and evaluation infrastructure that determine... ...—and get to the frontier quickly Care deeply...Full timeWork at officeVisa sponsorshipFlexible hoursAnthropic
New York, NY1 day ago$240k - $320k
...ambitious companies go from AI-absent to AI-native.... ...of strategy and engineering, embedding elite AI... ...ll ship production AI systems — walking into client... ...publicly. You’ll build with frontier AI tools (Claude Code, Codex, Gemini,... ...reliable, auditable agent systems with humans in...Full timeFlexible hoursTenex Llc
New York, NY1 day ago$200k - $245k
...research accelerator for frontier AI labs and a trusted... ...to deploy advanced AI systems. Turing accelerates frontier... ...thinking, reasoning, coding, multimodality, and... ...team of other Turing engineers across different skill... ...industry leading multi-agent LLM systems, RAG...Full timeFlexible hoursTuring
New York, NY1 day ago- ...Description Job Description AI Automation & Agent Engineer We are hiring someone to... ...that connect the systems we already run on: Salesforce... ...integrations, and building the glue code that makes those systems... ...outputs, retrieval, and evaluating whether output quality is...
Sportsdigita
New York, NY2 days ago $161.3k - $241.9k
...end. By combining frontier agentic AI, an enterprise-grade... ...leadership to engineers — and work together... ...Software Engineer, Agents, you'll build the systems that make our AI agents... ...using practical evaluations to drive task... ...and libraries for coding agents. What...Full timeHarvey
New York, NY1 day ago- ...move at the speed of AI, deliver better... ...attention to detail. Our engineering team is elite, our lawyers ship code every day, and we... ...-native operating system for in-house legal... ...make that possible: agents that reason over... ...about when to use frontier models, smaller models...Full timeContract workWork at officeFlexible hoursDay shift
Sandstone
New York, NY1 day ago - ...institutions with applied AI. We care that... ...) benefit from frontier technology. To... ...deployed expertise in engineering, product, and... ...ship production AI systems into environments... ...still be writing code. Expect to be in a... ...engineering surface: Agents, tools, context,...Full timeImmediate startShift work
Percepta
New York, NY1 day ago - ...As the Lead AI Engineer for our next-generation TCO Agent Platform, you will serve as the technical lead and multi-agent system architect for a greenfield, proactive FinOps AI platform.... ...Technical Leadership & Standards: Set coding, testing, and formatting standards across...
EPAM Systems
New York, NY1 day ago - ...result is 10-100× more AI inference per dollar, per... ...stack: AI-native EDA systems in production with the... ...and built by scientists, engineers, and operators from the... ...systems that allow AI agents to perform long-running... ...environments, execute code and tools securely, preserve...Full time
Normal Computing
New York, NY1 day ago $200k - $250k
..., and use it to power agents that take on the work... ...requires multi-level agent systems that discover... ...space is operating at. Frontier . AI is moving so fast. Our... ...own tools with Claude Code! The architecture has... ...customers. We are hiring engineers who can build on the...Temporary workFlexible hoursPetsApp
New York, NY2 days ago$200k - $320k
...Applied AI Engineer, Enterprise Tech San Francisco... ...and steerable AI systems. We want AI to be... ..., developing evaluation frameworks, and guiding... ...closer to the frontier, while maintaining... ...technical workshops and code reviews with... ...prompt engineering, agent development and...Work at officeVisa sponsorshipFlexible hours3 days per weekAnthropic
New York, NY2 days ago- ...Role: Applied AI Engineer Location: New York... ...hands on experience coding within Python... ...OpenAI or Claude Agent SDK and other agentic... ...Good exp in frontier CodingTools: ClaudeCode... ...working on complex systems and building complex... ...more Agentic Evaluation is also a big component...Contract workWork experience placementLocal area
Pride Global
New York, NY1 day ago $150k - $250k
...We’re using generative AI to automate debt collection... ...the US alone. Our AI agents are already... ...now hiring an AI Agent Engineer to help us reach $10 million... ...infrastructure, prompting systems, and core architecture... ...and maintain testing and evaluation frameworks for voice agent...Immediate startSocket
New York, NY1 day ago- ...institutions with applied AI. We care that... ...) benefit from frontier technology. To... ...deployed expertise in engineering, product, and... ...deliver high-impact AI systems. We don't build... ...-grade AI agents and workflows that... ...and know how to get code written and shipped...
Percepta
New York, NY5 days ago $220k - $300k
...Senior Applied AI Engineer - Applied AI Sant... ...the #1 operating system for local retailers... ...bookkeeping, and AI Agents — so the owners of... ...data Build the evaluation harness for both... ...experience using agentic coding tools for large-... ...or post-training frontier open-source models...Local areaAfternoon shiftSanté
New York, NY3 days ago$143.67k - $215.5k
Senior AI Engineer Greater Boston, MA; Los Angeles... ...and build the agents at the core of our... ...You'll own the AI systems that set our product... ...You're comfortable evaluating new frameworks,... ...-on. You'll write code daily while contributing... ...-on work at the frontier of applied AI,...Permanent employmentRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer: Frontier Code Agents Evaluator. Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- ai engineer New York, NY
- ai engineer remote New York, NY
- ai developer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- application system engineer New York, NY
- sr systems engineer New York, NY