Remote Senior Software Engineer: AI Agent Evaluation
YO AI Labs
Washington DC
- Remote job
YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required. #J-18808-Ljbffr YO AI Labs
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Senior Software Engineer: AI Agent Evaluation in Washington DC vacancy
- YO AI Labs is seeking a Senior Software Engineer contractor to help build reinforcement learning environments evaluating AI models on software tasks. The role focuses on creating... ..., while evaluating agents' reasoning with MCP tools. Remote, ~15 hours/week. #J-18808-...Remote jobSeniorFor contractors
$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Architecture and Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars...SeniorFull time$152k - $241.5k
We are now looking for a Senior Software Engineer for Agent Simulation & Evaluation! Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars that...SeniorFull time$2,000 per month
...their revenue. We're a remote-first crew of 150+,... ...Role We're building an AI assistant that helps... ...can pull real-time data, evaluate experiments, debug... ...intermediated or automated by our agent. We're a team that's... ..., and we need an engineer who can build the...Remote workSeniorFlexible hoursRevenueCat
United States1 day ago- Role Description As a Senior Software Engineer, Agents on our Delivery team, you make that... ...specific customers: ~Own AI agents for your assigned... ...discovery, design, build, evaluation, launch, and live operation... ...courses — we’ll fund them. ~Remote by design: Distributed work...Remote workSeniorFull timeFlexible hours
Replicant
Remote25 days ago $224k - $356.5k
...autonomous driving, and evaluation is how we know the drive... ...our organization develops AI drivers!We are looking for a senior engineer to own the engine that... ...experience).12+ years building software, with significant time... ..., Santa Clara; US, GA, Remote; US, DC, Remote; US, NC,...Remote workSeniorFull time$161.3k - $274.2k
...areMoveworks: the Agentic AI Assistant platform that... ...Moveworks’ Reasoning Engine and natural language... ...DescriptionThe RoleMoveworks' AI agents don't just generate... ...layer of our agent evaluation platform: the rubrics,... ...Work personas (flexible, remote, or required in office)...Remote workSeniorContract workWork at officeFlexible hours- ...to automate simulation, evaluation, and performance analysis for AI workloads across GPU and... ...characteristics and automate critical engineering workflows like capacity... ...and over 5 years of software development experience,... ...building AI agents. Candidates must be proficient...Senior
$202.5k - $247.5k
...or production AI workloads. We’re... ...time. About the Agent Team Our Agent... ...team builds the software that sits at... ...integrations, remote management) that... ...entirely on AWS. Engineers develop by using... .... Compensation Senior Software... ...compensation will be evaluated based on factors...Remote workSeniorPermanent employmentFull timeWork at officeLocal areaImmediate startHome officeFlexible hours$144.7k - $221.4k
...Organization The Evaluation team builds and evolves... ...feedback for engineering and leadership, and... ...autonomous driving software performance at... ...Background in modeling agent interaction and... ...Experience leveraging AI-assisted... ...evaluation coverage.Hybrid/Remote: This role can be...Remote workSeniorFull timeLocal areaWork from homeRelocationRelocation packageFlexible hours$143.2k - $243.4k
...all started when engineer Fred Luddy wrote code... ...ServiceNow is the AI control tower for... ..., and reusable software components with a... ...production — multi‑agent orchestration, tool... ...outputs, and model evaluation in production settings... ...(flexible, remote, or required in office...Remote workSeniorWork experience placementWork at officeImmediate startFlexible hours$124k - $329.2k
...partner is looking for a Senior Software Engineer, CoPilot Agent Platform based in United States... ...the next generation of AI-powered, agentic software... ...teams to define requirements, evaluate technical constraints, and... ...depending on the role. Remote-first work environment,...Remote workSeniorFull timeWork from homejobgether
United States8 days ago- ...Overview Design and evaluate high-quality datasets... ...multiple languages, assess AI-generated... ...help build verification agents that detect errors and... ...capabilities across the software engineering lifecycle. Key Responsibilities... ...and fit. Location: Remote, candidates must be...Remote workSeniorFor contractors10 hours per weekFlexible hours
SaidGig
Canadamore than 2 months ago - ...-quality datasets and evaluation pipelines that improve... ...for code generation and software engineering tasks. You will curate... ..., evaluate and refine AI-generated solutions... ...languages, build verification agents to detect errors and... ...Terms Location: Remote. Engagement type:...Remote workSeniorFull timeFor contractors10 hours per weekFlexible hours
SaidGig
United Statesmore than 2 months ago - ...Description We're building a dataset to evaluate AI coding agents - how well a model handles real-... ...involvement. Qualifications ~Strong software engineering experience: 8+ years in any modern... ...platform. ~Flexible, fully remote schedule (40 hours per week). ~You...Remote workSeniorTemporary workFreelanceFlexible hours
Toloka
Remote18 days ago $152k - $241.5k
...unlimited potential of AI to define the next era... ...reliable systems software for cloud-scale GPU infrastructure... ...We are looking for a Senior Software Engineer to join our DGX Cloud... ...team and build agent-side systems that collect... ...Santa Clara; US, NY, Remote; US, RemoteType: Full...Remote workSeniorFull timeLocal area- ...is for one of the Weekday's clients Now Hiring: Senior AI Agent Engineer Remote – United States Contract Position | 6+ Months An innovative... ...and manage Agent Skills, SKILL.md workflows, and evaluation suites • Contribute to Managed Agents, Claude Cowork...Remote workSeniorContract workImmediate startWeekday work
Weekday AI
United States3 days ago - ...Senior AI Agent Engineer Argentina based Remote Senior AI Agent Engineer Wizeline is a global AI-native technology... ...-edge LLM techniques with solid software-engineering discipline. In this... ...calling, model selection, and evaluation ~ Retrieval-Augmented Generation...Remote workSeniorFlexible hours
Wizeline
United States1 day ago $230k
Location Remote Employment Type Full time Department Engineering This role blends traditional software engineering, agent management, and system-building. Gravity... ...more than ever. AI demand is driving dirty... ...it again. The team is senior and full‑stack. Everybody...Remote workSeniorFull timeWork at officeVisa sponsorship$116k - $195k
Senior Software Engineer (AI Specialization)Skip to main contentWe use data collected by cookies and JavaScript... ...experiences using intelligent AI agents. You’ll be at the forefront of... ...meaningful in-person collaboration.#LI-REMOTE#LI-GC1**(Pay Transparency Range: $116,00...Remote workSeniorWork at officeLocal area3 days per week$99.6k - $174k
Senior Full Stack Engineer, AI Platform & AgentsBuild the GenAI platform... .../Canada, Hybrid or Remote-Work Hours: Must have... ...deployment of AI agents. We also drive the development... ...of professional software engineering... ...production, including safety evaluations, iterative testing (...Remote workSeniorFull timeWork at office2 days per week$116k - $195k
Senior Software Engineer (AI Agents)Skip to main contentWe use data collected by cookies and JavaScript libraries, which are necessary for website functioning... ...work with meaningful in-person collaboration.#LI-REMOTE#LI-GC1(Pay Transparency Range: $116,000.00 - $195,000.00)#...Remote workSeniorWork at officeLocal area3 days per week$124k - $186k
Senior Software Engineer, AI Products & Agents 45696 New York, NY, US, 10036 Technology New York Full-Time Fully Remote #WeAreParamount on a mission to unleash the power of content… you in? We’ve got the brands, we’ve got the stars, we’ve got the power to achieve...Remote workSeniorFull timeImmediate start$79.8k - $178.1k
Senior Software Engineer - NetSuite AI Agent Senior Software Engineer - NetSuite AI Agent 1 week ago Be among the first 25 applicants Get AI-powered advice... ...Senior Full Stack Software Engineer - Creators, Poe (Remote) Austin, TX $155,656.00-$278,361.00 10 months ago...Remote workSeniorFull timeTemporary workFlexible hours- ...leading security-first enterprise AI company, is seeking a Member... ...Staff in the Safety for Agents team to advance safer LLMs through... ...post-training algorithms, and evaluation methods. You'll collaborate with... ...across global offices, while remote-friendly policies support...Remote workSeniorFlexible hours
- ...company and a leading AI platform for... ...people, money, and agents, we’re shaping the... ...the enterprise. By engineering seamless data ingestion... ...YouBasic Qualification (Senior P4)8+ years experience in software development... ...in-person time and remote. Our approach enables...Remote workSeniorFull timeWork experience placementWork at officeImmediate startHome officeFlexible hours
$205k - $270k
Role Description As a Senior Software Engineer, your goal will be to ensure that our AI Agents are backed by the most reliable and scalable server solutions. This includes... ...plan to help you plan for the future. ~Remote work setup budget to help you create a productive...Remote workSeniorFull timeWork at officeHome officeFlexible hoursCresta
Remotea month ago$143.2k - $243.4k
...It all started when engineer Fred Luddy wrote code... ...Today, ServiceNow is the AI control tower for business... ...the Role : As a Senior AI Agent Engineer | Federal at... ...Engineer, or Software Engineer. ~ Experience... ...Work personas (flexible, remote, or required in office...Remote workSeniorPermanent employmentFull timeWork at officeImmediate startFlexible hours- ...competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent... ...We are looking for strong backend engineers who want to work at the intersection... ...stipend to help you succeed in a remote environment Lunch reimbursement...Remote workSeniorFull timeWork at officeLocal areaWork from homeHome office
Cresta
Remote21 days ago $50 per hour
...specialists with project-based AI opportunities for... ..., focused on testing, evaluating, and improving AI... ...to evaluate AI coding agents - how well a model handles... .... Not prompt engineering. Not writing code from... ...Qualifications ~5+ years in software development. ~Core...SeniorPermanent employmentTemporary workPart timeMindrift
Remotea month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior Software Engineer: AI Agent Evaluation. Be the first to apply!
Related searches
- software engineer internship Washington DC
- software development engineer aws Washington DC
- software developer internship no experience Washington DC
- real time software engineer Washington DC
- financial software developer Washington DC
- part time software developer Washington DC
- graduate software developer Washington DC
- software engineer travel Washington DC
- experienced software developer Washington DC
- remote entry level software developer Washington DC