Software Engineer, Agent Evaluation and Quality
Repovive, Inc.
##### ###### ##### ### # # ### # # ######## ## ## ## ## ## ## # # # # # ####### #### ##### # # # # # # # ###### # ## ## ## ## # # # # # #### # ###### ## ### # ### # ###### $ curl repovive.com/jobs/69ed18d7682d4cf1d9e87166 ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ █████████████████████████████████████████████████ ##### ###### ##### ### # # ### # # ######## ## ## ## ## ## ## # # # # # ####### #### ##### # # # # # # # ###### # ## ## ## ## # # # # # #### # ###### ## ### # ### # ###### ##### ###### ##### ### # # ### # # ######## ## ## ## ## ## ## # # # # # ####### #### ##### # # # # # # # ###### # ## ## ## ## # # # # # #### # ###### ## ### # ### # ###### $ curl repovive.com/jobs/69ed18d7682d4cf1d9e87166 ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ █████████████████████████████████████████████████ ##### ###### ##### ### # # ### # # ######## ## ## ## ## ## ## # # # # # ####### #### ##### # # # # # # # ###### # ## ## ## ## # # # # # #### # ###### ## ### # ### # ###### $ curl repovive.com/jobs/69ed18d7682d4cf1d9e87166 ░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ █████████████████████████████████████████████████ Repovive © 2025 Repovive, Inc. All rights reserved. Back to Jobs Apply Now Compensation Not listed Posted April 25, 2026 Required Skills AI evaluation data pipelines agent instrumentation Requirements Mid/Senior Visa Sponsorship Not mentioned Relocation Not mentioned About the Role Build evaluation and quality systems for Cursor's coding agents. Interested in this role? Apply directly on Cursor's website Apply for this Position #J-18808-Ljbffr
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer, Agent Evaluation and Quality in New York, NY vacancy
- ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design...QualityFull timeWork at office
Anysphere
New York, NY3 days ago $190k - $270k
...Databricks Inc. is seeking a Staff Software Engineer - Agent Quality in New York, NY. This role focuses on building evaluation infrastructure for AI Agents, ensuring quality and continuous improvement. The ideal candidate will have over 6 years of experience, strong Python...QualityDatabricks
New York, NY1 day ago$161.3k - $241.9k
...customers — from leadership to engineers — and work together to solve real... ...started. Role Overview As a Software Engineer, Agents, you'll build the systems that... ...experienced in using practical evaluations to drive task completion quality and customer delight. Representative...QualityHarvey
New York, NY16 hours ago$250k - $330k
...Hunter Douglas to deploy AI agents that power personalized, deeply... ...model reasoning, evaluating agent behavior, and ensuring... ...About the Role As a Senior Software Engineer on the Agent Orchestration team... ...performance, reliability, and quality. You will have significant autonomy...QualityWork at officeDecagon
New York, NY15 hours ago$50 - $150 per hour
...growing AI company in New York is seeking a contractor for a software engineering role focused on improving LLM performance.... ...strong background in building scalable applications and evaluating code quality. The position offers flexible engagement of 10 to 40 hours...QualityHourly payFor contractors10 hours per weekFlexible hoursTuring Inc
New York, NY3 days ago- ...fastest-growing industries—our agents already reach over 50% of U.S... ...been a founder or founding engineer—you know what it means to balance... ...our accountability, empathy, quality, and responsiveness. We build... ...description. We strive to evaluate all applicants consistently...QualityFull timeFlexible hours
Sierra
New York, NY1 day ago - ...Senior Software Engineer, Endpoint Agent (Windows) Remote, US Description Keeper Security is hiring a Senior... ...elevation workflows, local policy evaluation, telemetry and audit logging, and hardened... ...and Security to ship high‑quality releases and continuously strengthen...QualityTemporary workLocal areaRemote work
Keeper Security
New York, NY4 days ago $200k - $400k
...Douglas to deploy AI agents that power personalized... ...experimental, frontier-style engineering. The team continuously... ...loops through offline evaluation and online... ...iterates quickly to improve quality, reliability, and... ...the Role As a Senior Software Engineer on the Agent...QualityFull timeWork at officeLocal areaDecagon
New York, NY3 days ago$200k - $240k
...entrepreneurial Senior Applied Agent Engineer to join as a founding member... ...deadline. You scope, build, evaluate, and ship without waiting... ...Have 5+ years of professional software engineering experience, with... ...focused on delivering high-quality products and services that...QualityTemporary workLocal areaFlexible hoursShift workDay shiftTraba
New York, NY17 hours ago$175k - $245k
...Senior Software Engineer II - Applied AI and Evaluations (Remote Eligible) -REMOTE, USA- For over 20 years, Smartsheet... ...through SmartAssist, our intelligent agent platform. As we scale from early demos to production-grade agents, quality is the critical frontier and we...QualityFull timeTemporary workLocal areaImmediate startRemote workSmartsheet
New York, NY3 days ago$80 per hour
...leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...expert QA reviewers who score your work on 7 quality criteria What We Look For Degree in Computer Science, Software Engineering or related fields 5+ years in software development...QualityPermanent employmentTemporary workFreelanceMind Rift
Brooklyn, NY1 day ago$60 - $100 per hour
...Position: Software Engineering, Data Science, and Systems Design Experts, Swift (5+ YOE) Type: Hourly... ...on project work Role Responsibilities Evaluate AI-generated responses to coding and... ...issues, and inaccuracies Assess code quality, readability, and algorithmic...QualityHourly payFull timeContract workPart timeRemote workFlexible hoursCrossing Hurdles
New York, NY4 days ago$50 - $70 per hour
...management, agentic workflow evaluation, and structured technical QA.... ...journey evaluation, storage agent testing, transfer planning assessment... ...outcome reporting, and high-quality project execution. Selected... ...management, infrastructure engineering, cloud engineering, platform...QualityRemote jobHourly payWeekly payJob sharingContract workPart timeFor contractorsFlexible hours24-MAG
New York, NYa month ago- ...Kake is looking for a Senior Software Engineer in Chile to contribute to AI training data development for a leading human data platform for AI agents. You will create coding tasks, write high-quality solutions, and evaluate AI-generated code. The ideal candidate has 5...Quality
KAKE
New York, NY3 days ago - ...role We’re seeking a highly skilled fullstack software engineer to join our engineering team building advanced AI‑driven agent systems that execute autonomous workflows,... ...participate in rigorous code reviews to uphold quality and maintainability. What you need 3+ years of...QualityFull timeLocal areaFlexible hours
Writer Corporation
New York, NY16 hours ago - ...About the Role At Commure, our Ambient Agents team is at the forefront of... ...workflows. We’re looking for talented engineers to scale our agent stack to the next... ...challenges in building efficient and scalable software, delivering quality features and a great customer...QualityWork experience placement
Commure
New York, NY17 hours ago - ...Agent Software Engineer Title of Role: Agent Software Engineer Location: New York, New York, onsite Company Stage of Funding: Secondary... ...experience, focusing on rapid development and high-quality standards. What You Will Do Design, build, and maintain...QualityFull timeWork at office
Recruiting from Scratch
New York, NY1 day ago $180k - $192k
...Role Overview AI Agents at Owner is a team with a singular mandate... ...up. We are looking for engineers who have shipped production agentic... ...Raise the bar for agent quality through rigorous evals, thoughtful... ...'re looking for 3+ years of software engineering experience, with...QualityImmediate startRemote workOwner
New York, NY4 days ago$124k - $186k
...Senior Software Engineer, AI Products & Agents 45696 New York, NY, US, 10036 Technology New York Full-Time Fully Remote #WeAreParamount on a mission... ...Define and champion engineering standards around code quality, testing, and system design Shape the technical roadmap...QualityFull timeImmediate startRemote workParamount Pictures
New York, NY5 days ago- ...to get your help as we're hiring several extremely talented software engineers across the stack. In This Role, You Will... Build the... ...rapidly iterating based on customer feedback Improve the quality and performance of AI features You Might Be A Fit If...QualityWork at officeRelocation
Pylon
New York, NY5 days ago $210k - $230k
...philosophy Most small business software makes owners do the work to... ...having a team of great operators, engineers, and marketers working for... ...to run their business. AI Agents at Owner is a team with a singular... ...Raise the bar for agent quality through rigorous evals, thoughtful...QualityWork at officeLocal areaImmediate startRemote workOwner
New York, NY4 days ago$1,000 per month
...About this Role As founding engineer at Headstarter, you are a full-stack generalist... ...projects. About Headstarter Nearly all software engineering jobs will be impacted by AI... ...implementation to deliver fast, high-quality iterations to customers Nice to Haves...QualityFull timeSummer workInternshipRelocationHeadstarter
New York, NY4 days ago- ...generation, semantic search, RAG, and agents. We believe that our work is... ...is a team of researchers, engineers, designers, and more, who are... ...team is looking for a Senior Software Engineer to create autonomous... ..., fitness and well-being, quality time, and workspace...QualityFull timeWork at officeRemote workFlexible hours
Cohere
New York, NY3 days ago $240k - $300k
...Staff Applied Agent Engineer Traba is the AI operating layer for the industrial... ...calls on how agents are built, evaluated, and deployed at Traba; set the bar for quality and reliability; and bring the... ...~7+ years of professional software engineering experience, with 2+...QualityTemporary workStart working todayLocal areaFlexible hoursShift workTraba
New York, NY9 days ago$190k - $270k
...Staff Software Engineer - Agent Quality P-1215 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems... ...you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You...QualityLocal areaWorldwideDatabricks
New York, NY2 days ago- ...We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent. You’ll own core backend systems and... ...reliability and autonomy, building evaluation pipelines, and shipping... ...production (chunking, retrieval quality, freshness strategies) Redis,...QualityImmediate startFlexible hours
The General Intelligence Company of New York
New York, NY17 hours ago - ...looking for a skilled AI / Agent Engineer to build, integrate, and operate... ...engineers to deliver high-quality agentic solutions. KEY... ...frameworks to evaluate agent performance and model... ...EXPERIENCE • 8+ years of software engineering experience with...Quality
Qode
New York, NY3 days ago - ...founding team, we build multi-agent AI systems that can automate... ..., we're looking for a top-quality AI engineer with a strong focus on AI agents... ...with critical enterprise software platforms. Ensure AI... ...Implement and manage training and evaluation pipelines for LLMs....Quality
Tessera Labs
New York, NY4 days ago $185k - $275k
...AI Agent Software Engineer Step into a high-impact AI Agent Software Engineer opportunity with a confidential client, where you will... ...solving, and cross functional coordination. • Drive high quality outcomes for projects based in NEW YORK CITY, New York, USA...QualityImmediate startTop Engineer
New York, NY4 days ago- ...AI Platform Engineer We require people to be on-site, four days... ...System (ADS), our proprietary AI agent designed to enhance every... ...and inference, RAG pipelines, evaluation harnesses and the APIs and infrastructure... ...eval pipelines to measure quality regressions, hallucination...QualityTemporary workWork at officeLocal areaRelocation package
LG Ad Solutions
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Agent Evaluation and Quality. Be the first to apply!
Related searches
- software sales engineer New York, NY
- software engineer internship remote New York, NY
- IT software developer New York, NY
- new grad software engineer New York, NY
- software engineer staff New York, NY
- integration software engineer New York, NY
- machine learning software engineer New York, NY
- software engineer part time New York, NY
- facebook software engineer New York, NY
- senior robotics software engineer New York, NY