AI Systems Engineer: Frontier Model Evaluator
$400 per monthObsidian
Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks. Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours. #J-18808-Ljbffr Obsidian
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer: Frontier Model Evaluator in New York, NY vacancy
- ...seeking contributors to support a Frontier Code Agents project focused on evaluating and improving frontier AI coding models within realistic data engineering workflows. You will assess complex... ...data warehouses, and distributed systems, using leading AI coding agents to...Suggested
- AI Trainer Jobs is seeking a remote contractor to evaluate people ops / recruiting prompts and responses against a evolving quality rubric. You will compare model outputs, label edge cases, and provide structured feedback for retraining. Responsibilities include evaluating...SuggestedRemote jobFor contractors
- Scale AI is shaping the future of enterprise AI with frontier agents deployed across diverse workflows. You will design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, and traditional ML, working directly with...Suggested
$159.2k - $301.6k
...We are looking for a Senior AI Systems Engineer with deep C++ expertise to help... ...service integration layers, evaluation systems, and reliability... ...powered services, agents, and model-backed workflows. Define... ...Qualifications Experience with frontier model APIs such as GPT, Claude...SuggestedFull timeTemporary workLocal areaRemote workWorldwideAdobe Systems
New York, NY7 days ago- Fluidstack in New York, NY, is seeking engineers who will ship production-grade software for frontier AI infrastructure. You will own from design to deployment, building systems that automate capital workflows, hiring, and operational dashboards as the company scales....Suggested
- Scale AI is seeking a Staff Frontier Agent Engineer (Applied AI) to bridge cutting-edge AI research with enterprise deployment. You will design and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, and enterprise software. You...
- ...intelligence to power the AI economy. We're a... ...between human expertise and frontier models. Millions of domain... ...of shaping the systems that are redefining society... ...THE ROLE As a Software Engineer on Applied AI, you’ll... ...data, post‑training, and evaluation needs Build and...Work at officeRelocation package
- ...Google DeepMind is seeking a Product Manager to lead Frontier Model Protection, shaping the strategy and governance needed to defend foundation... ...stakeholders and peer labs to set safety benchmarks and drive responsible AI innovation at scale. #J-18808-Ljbffr Jobleads-US
- Scale AI, Inc. is seeking a Senior Frontier Agent Engineer (Applied AI) to bridge cutting‑edge research and production deployment... ...in New York. You will design, evaluate, and deploy intelligent systems that combine frontier models with structured data and traditional...
- Scale AI, Inc. is seeking a Frontier Agent Engineer to bridge frontier AI research and production deployment for enterprise customers. You will design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, and traditional...
$300k - $333k
...domain experience in AI security, model defense, anti-distillation... ...production-hardened systems. About the job... ...closely with creative engineers, designers, marketers... ...product strategy for Frontier Model Protection. As... ...safety benchmarks and evaluation standards....Google LLC
New York, NY3 days ago- Ode With Anthropic in New York is seeking an experienced engineering leader or founder turned IC to own end-to-end technical outcomes while... ...a small team, write code, and set direction for challenging AI projects. You’ll spend roughly 75% of your time in code and 25%...
$197.3k - $225.1k
...AI Engineer 4 (Vision model (VLM) customization experience) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an... ...similarity search, guardrails, model evaluation, experimentation, governance,...Full timePart timeLocal areaCapital One
New York, NY2 days ago$15 - $20 per hour
...technical talent with leading AI research labs. Headquartered in... .... Generate high-quality human evaluation data by identifying response... ...completeness of responses. Ensure model responses align with expected conversational behavior and system guidelines. Work independently...Contract workSummer workRemote work$150.8k - $280k
...experienced infrastructure and platform engineer to help build and operate the AI Factory, an enterprise platform... ...to train, deploy, and run AI/ML systems.• Improving platform reliability... ...verification and procedures for test and evaluation requirements in collaboration with...Full timeTemporary workWork experience placementCasual workFlexible hoursLockheed Martin
New York, NY5 days ago- Mercor connects elite creative and technical talent with leading AI research labs. The company is headquartered in San Francisco,... ...for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and policy compliance...Remote jobContract workSummer work
- Obsidian is seeking Insurance domain SMEs to join a cutting-edge AI training program. You will evaluate AI model outputs against real underwriting practice and rubrics, guiding research and engineering teams to close knowledge gaps in underwriting, claims, and risk assessment...
- SaidGig is seeking a remote, part-time software engineer to help improve AI systems through rigorous technical review, prompt development, evaluation, and high-quality training content. Prior AI experience is not required; your software engineering domain knowledge and...Remote jobPart time
$200k - $300k
...Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot HireNow Staffing is actively... ..., and agent behavior. Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing,...Permanent employmentFull timeRelocationVisa sponsorshipHireNow Staffing
New York, NY2 days ago- ...the BragDev network for U.S.-based technical professionals. Senior AI Infrastructure Engineer (GPU and Model Serving) Senior Full-time Remote, U.S. Python AWS PyTorch MLOps Distributed Systems You run the infrastructure behind AI workloads: GPU clusters, model...Full timeRemote work
- Fluidstack is building civilization-scale AI infrastructure, from power and data... ...define interactions with external vendor systems, and empower AI agents with tooling, guardrails... ..., and audit trails. We seek adaptable engineers who can turn messy, unstructured data into...
$85 per hour
...talent with leading AI research labs.... ...DevOps / SRE / Cloud Engineer (Coding Agent Experience... ...Use frontier AI coding agents to complete and evaluate complex infrastructure... ...engineering tasks. Review model-generated... ...Kubernetes , CI/CD systems , observability...Contract workSummer workRemote work- Forgepoint is seeking a hands-on senior individual-contributor with deep experience at the intersection of applied AI, product, and distributed systems in New York City. You will translate ambiguous customer problems into concrete architectures, ship reliable systems,...
- Revin is hiring a Senior Software Engineer to build the production systems behind our AI agents that handle SMS, voice, and email conversations for $100M+ home-service operators. You will own end-to-end development across a Python/FastAPI backend, a Next.js/TypeScript...
- Amigo in New York is seeking engineers and domain specialists who build complex technical systems and work directly with customers to ship real AI solutions in healthcare. We value hands-on contributors who care about delivering safe, effective care and welcome those who...
- Conduct in New York City is seeking exceptional builders to design and ship AI-powered systems for the world’s largest enterprises. This is not a conventional engineering role: you’ll own end‑to‑end scope from research to deployment, solving hard problems with fast iteration...
- ...building the secure identity company of the future. You will design, build, and deploy AI-powered systems across internal workflows and customer experiences, partnering across Product, Engineering, Data, Security, Legal, and Operations. You will own end-to-end use cases from...
- Capital One is seeking a Sr. Lead AI Engineer (FM Hosting, LLM Inference) to advance responsible AI across banking. You will partner with... ...and infrastructure. The role focuses on foundation models, inference, guardrails, and observability, using PyTorch, Hugging...
- Sweep360 is building humanity’s defense layer for the AI age and seeks an exceptional machine learning engineer to build the AI decision system that turns raw signals into trusted operational decisions across device, cloud, and offline environments. If you would have joined...
$152k - $241.5k
...for us! We believe open-weight models are foundational to American AI leadership and cybersecurity,... ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling that helps... ...looking for an Evaluation/ML-Systems Engineer to own how we measure...Full timeRemote workNvidia
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer: Frontier Model Evaluator. Be the first to apply!
Related searches
- machine learning ai engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- senior ai engineer New York, NY
- ai research engineer New York, NY
- ai engineer New York, NY
- data systems engineer New York, NY
- director systems engineering New York, NY