Remote Senior Software Engineer: AI Agent Evaluation
YO AI Labs
YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization.
No prior AI experience is required.
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote Senior Software Engineer: AI Agent Evaluation in Washington DC vacancy
- ...working with frontier AI labs to accelerate... ...quality training data, evaluations, and engineering talent. We are staffing... ...and evaluate AI agents. You will be assigned... ...understand and execute software engineering tasks.... ...systems. Fully remote opportunity. Collaborate...Remote workSeniorFull timeContract workTemporary workFlexible hours
Turing
Remote6 days ago $180k - $220k
...Senior Backend Engineer - Agents Location : Remote (US) or Hybrid (Boston) About Us Nebulock... ...like a teammate: a 24/7 AI threat hunter that investigates... ...Continuous iteration, evaluation, and cross-team... ...Qualifications ~4+ years software engineering experience with...Remote workSeniorFull timeNebulock
United States1 day ago$202.5k - $247.5k
...localhost or running AI workloads in... ...! We like software that’s serious and... ...About the Agent Team Our Agent... ...entirely on AWS. Engineers develop by using remote development tools... ...Compensation Senior Software Engineer... ...will be evaluated based on factors...Remote workSeniorPermanent employmentFull timeWork at officeLocal areaImmediate startHome officeFlexible hoursNgrok
Remote12 hours ago$170k - $220k
...Scientific Data and AI Company building Tetra... ...seeking a highly skilled Senior .NET Engineer to join our dynamic... ...and operating software in both on-premises/customer... ...arrangements - Remote work ~ Company paid... ...determined by a thorough evaluation of factors including...Remote workSeniorFull timeContract workImmediate startVisa sponsorshipFlexible hoursTetrascience
Remote12 hours ago$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars that...SeniorFull time$204k - $259k
...of-the-art Generative AI to create a training... ...Driver. The Simulator Evaluation team faces the... ...We are looking for a Senior Software Engineer to build the metrics... ...or experience with agent-based modeling and behavioral... ...role can be performed remote, the specific salary...Remote workSeniorFull timeWaymo
San Francisco, CA12 hours ago$80 - $100 per hour
...build the coding benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design coding... ...residence. Nice to have Senior or Lead-level profile with a... ...Logistics Location: Fully remote — work from anywhere on the accepted...Remote jobSeniorFull timeContract workFor contractorsG2i
Miami, FL1 day ago$224k - $356.5k
...autonomous driving, and evaluation is how we know the drive... ...our organization develops AI drivers!We are looking for a senior engineer to own the engine that... ...experience).12+ years building software, with significant time... ..., Santa Clara; US, GA, Remote; US, DC, Remote; US, NC,...Remote workSeniorFull time$144.7k - $221.4k
...Organization The Evaluation team builds and evolves... ...feedback for engineering and leadership, and... ...autonomous driving software performance at... ...Background in modeling agent interaction and... ...Experience leveraging AI-assisted... ...evaluation coverage.Hybrid/Remote: This role can be...Remote workSeniorFull timeLocal areaWork from homeRelocationRelocation packageFlexible hours- ...Job Title: Senior Software Engineer , LLM Evaluation & Repository Validation About the projects... ...world’s fastest-growing AI companies accelerating the... ...developer tools or automation agents. Perks of Freelancing... ...: Work in a fully remote environment. Opportunity...Remote workSeniorTemporary workFor contractorsFreelance
Turing
Remote6 days ago - ...-quality datasets and evaluation pipelines that improve... ...for code generation and software engineering tasks. You will curate... ..., evaluate and refine AI-generated solutions... ...languages, build verification agents to detect errors and... ...Terms Location: Remote. Engagement type:...Remote workSeniorFull timeFor contractors10 hours per weekFlexible hours
SaidGig
United Statesmore than 2 months ago - ...Overview Design and evaluate high-quality datasets... ...multiple languages, assess AI-generated... ...help build verification agents that detect errors and... ...capabilities across the software engineering lifecycle. Key Responsibilities... ...and fit. Location: Remote, candidates must be...Remote workSeniorFor contractors10 hours per weekFlexible hours
SaidGig
Canadamore than 2 months ago $152k - $241.5k
...unlimited potential of AI to define the next era... ...reliable systems software for cloud-scale GPU infrastructure... ...We are looking for a Senior Software Engineer to join our DGX Cloud... ...team and build agent-side systems that collect... ...Santa Clara; US, NY, Remote; US, RemoteType: Full...Remote workSeniorFull timeLocal area- ...world's fastest-growing AI companies,... ...feedback, and rigorous evaluation frameworks. Our contributors... ...reasoning, agentic workflows, software engineering, and multimodal AI,... ...realistic coding-agent benchmark tasks using... ...: Work in a fully remote environment. Opportunity...Remote workSeniorContract workTemporary workFor contractorsFreelanceWorldwide
Turing
Remote6 days ago $136.9k
...role We are hiring a Senior Software Engineer to lead the development of our internal AI platform and orchestration... ...the deployment of intelligent Agents and RAG pipelines across the organization... ...Unprotected. We have built a remote-first, highly inclusive culture...Remote workSeniorFull timeFixed term contractWork experience placementWork at officeHome officeFlexible hoursCoalition, Inc.
Remote2 hours ago$99.6k - $174k
Senior Full Stack Engineer, AI Platform & AgentsBuild the GenAI platform... .../Canada, Hybrid or Remote-Work Hours: Must have... ...deployment of AI agents. We also drive the development... ...of professional software engineering... ...production, including safety evaluations, iterative testing (...Remote workSeniorFull timeWork at office2 days per week- ...company and a leading AI platform for... ...people, money, and agents, we’re shaping the... ...the enterprise. By engineering seamless data ingestion... ...YouBasic Qualification (Senior P4)8+ years experience in software development... ...in-person time and remote. Our approach enables...Remote workSeniorFull timeWork experience placementWork at officeImmediate startHome officeFlexible hours
- ...competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent... ...We are looking for strong backend engineers who want to work at the intersection... ...stipend to help you succeed in a remote environment Lunch reimbursement...Remote workSeniorFull timeWork at officeLocal areaWork from homeHome office
Cresta
Remote5 days ago $193.4k - $290k
...combining frontier agentic AI, an enterprise-grade... ...— from leadership to engineers — and work together... ...Overview As a Software Engineer, Agents, you'll build the systems... ...in using practical evaluations to drive task... ...this role across Mid, Senior, and Staff levels....SeniorFull timeHarvey, Inc.
San Francisco, CA12 hours ago$200k - $400k
...leading conversational AI platform empowering... ...Douglas to deploy AI agents that power personalized... ...experimental, frontier-style engineering. The team continuously... ...loops through offline evaluation and online... ...About the Role As a Senior Software Engineer on the Agent...SeniorFull timeWork at officeLocal areaDecagon
New York, NY1 day ago- ...the data and action layer for AI agents. We give agents fast,... ...now includes AI agents. Engineering Hiring Sprint: We're growing... ...orchestration, routing, retrieval, evaluation, evidence generation,... ...You’ll Need: ~7+ years of software engineering experience building...SeniorFull timeWork at officeLocal areaFlexible hours
Airbyte
San Francisco, CA12 hours ago $200k - $400k
...leading conversational AI platform empowering... ...Douglas to deploy AI agents that power personalized... ...the Team The Agent Engineering team at Decagon deploys... ...Experiment with and run evaluations on the latest text and... ...experience in software engineering Proficiency...SeniorFull timeWork at officeLocal areaDecagon
San Francisco, CA12 hours ago$216k - $270k
...mission is to develop reliable AI systems for the world’s... ...matters most, combining rigorous evaluation with full-stack deployment... ...About the Role As a Software Engineer on Agent Oversight, you will build... ...mentoring engineers at a senior/staff level Compensation...SeniorFull timeScale Ai, Inc.
New York, NY1 day ago$200k - $240k
...Traba is building the AI operating system for... ...expanded our suite of AI agents to help logistics... ...seeking an entrepreneurial Senior AI Agent Engineer to join as a founding... ..., you scope, build, evaluate, and ship without... ...Have ~5+ years of software engineering, with 1+...SeniorFull timeTemporary workLocal areaDay shiftTraba
New York, NY1 day ago- ...partner is looking for a Senior Automation Engineer (Python, AI Agents & Automation) based in... ...throughout the documentation and software development lifecycle,... .... Benefits ~100% remote work within the... ...process your personal data to evaluate your candidacy and share...Remote workSeniorFull time
jobgether
United States9 days ago $200k - $320k
...a product-minded Software Engineer with strong technical... ...and a passion for AI-driven product... ...work closely with senior leadership and a small... ...is a full-time remote opportunity, with... ...pipelines and AI agent systems Develop... ...initiatives Evaluate and recommend AI architectures...Remote workFull timeVisa sponsorshipVirco Talent
Remote12 hours ago$185k - $230k
The OpportunityWe are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You... ...AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate...SeniorPermanent employment- ...with deep expertise in AI and machine learning. Our... ...and Craft Ventures.The Agent Team @ PaveThis role... ...Pave's existing workflow engine. Think: autonomous... ...retrieval systems, and evaluation frameworksStrong product... ...compensation decision.We build software that transforms how...SeniorFlexible hours3 days per week
- ...?As a member of the Enterprise AI and Emerging Technology organization... .... - We’re looking for a Sr. Software Engineer in the Enterprise AI Platforms... ...deployment experience. Evaluating generative AI applications experience. OSS agent frameworks such as Strands Agents...SeniorFull timeWork experience placementLocal area
$119.8k - $234.7k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline:... ...generation of intelligent agents and generative AI systems. Within CoreAI, the... ...traces and continuously evaluate and optimize agents.As a Senior Software Engineer within Foundry Agents, you will...SeniorOngoing contractLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior Software Engineer: AI Agent Evaluation. Be the first to apply!
Related searches
- software developer positions Washington DC
- senior software engineer remote Washington DC
- software engineer contract Washington DC
- IT software developer Washington DC
- cybersecurity software engineer Washington DC
- part time software developer remote Washington DC
- junior software developer internship Washington DC
- junior software engineer Washington DC
- software system engineer Washington DC
- software engineer remote Washington DC