Staff Software Engineer, Agent Quality & Evaluation
$190k - $270kDatabricks Inc.
Databricks Inc. is seeking a Staff Software Engineer - Agent Quality in New York, NY. This role focuses on building evaluation infrastructure for AI Agents, ensuring quality and continuous improvement. The ideal candidate will have over 6 years of experience, strong Python skills, and the ability to handle complex infrastructure challenges. The role includes designing systems and collaborating across teams to drive data-driven improvements. Compensation ranges from $190,000 to $270,000, reflecting our commitment to fair pay. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Agent Quality & Evaluation in New York, NY vacancy
$231k - $340k
...getting started. Role Overview As a Software Engineer, Agents, you'll build the systems that... ...experienced in using practical evaluations to drive task completion quality and customer delight.... ...this role across Mid, Senior, and Staff levels. Proficiency in Python and...QualityHarvey
New York, NY18 hours ago$200k - $400k
...Douglas to deploy AI agents that power personalized... ..., frontier-style engineering. The team continuously... ...loops through offline evaluation and online experimentation... ...quickly to improve quality, reliability, and... ...About the Role As a Staff Software Engineer on the Agent...QualityFull timeWork at officeLocal areaDecagon
New York, NY5 days ago$240k - $300k
...Staff Applied Agent Engineer Traba is the AI operating layer for the industrial supply... ...on how agents are built, evaluated, and deployed at Traba; set the bar for quality and reliability; and bring the... ...~7+ years of professional software engineering experience, with...QualityTemporary workStart working todayLocal areaFlexible hoursShift workTraba
New York, NY9 days ago$190k - $270k
...Staff Software Engineer - Agent Quality P-1215 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems... ...will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You...QualityLocal areaWorldwideDatabricks
New York, NY2 days ago$251k - $310k
...across 15+ U.S. states. The Planner Evaluation team works on one of the key... ...driving: measuring and improving the quality of the software that drives the car. We are looking for experienced data-minded software engineers and data scientists to help us improve...QualityFull timeRemote workWaymo
New York, NY5 days ago$190k - $270k
Databricks is seeking a Staff Software Engineer - Agent Quality in New York to lead efforts in evaluating AI Agents. You will create infrastructure for benchmarking and quality measurement in a collaborative environment. Ideal candidates have 6+ years of experience and...QualityLocal area- ...Compensation Not listed Posted April 25, 2026 Required Skills AI evaluation data pipelines agent instrumentation Requirements Mid/Senior Visa Sponsorship... ...Not mentioned About the Role Build evaluation and quality systems for Cursor's coding agents. Interested in this role...QualityRelocationVisa sponsorship
Repovive, Inc.
New York, NY19 hours ago - ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York Our mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design...QualityFull timeWork at office
Anysphere
New York, NY3 days ago $80 per hour
...leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...expert QA reviewers who score your work on 7 quality criteria What We Look For Degree in Computer Science, Software Engineering or related fields 5+ years in software development...QualityPermanent employmentTemporary workFreelanceMind Rift
Brooklyn, NY1 day ago$180k - $220k
...We're looking for a Senior/Staff Backend Engineer to architect and build large... ...power Actively's GTM AI agents. These agents continuously... ...maintainable, and reliable software. Strong backend engineer... ...faster without sacrificing quality. Curious about AI systems...QualityFull timeWork at officeShift workActively AI
New York, NY4 days ago$50 - $70 per hour
...management, agentic workflow evaluation, and structured technical QA.... ...journey evaluation, storage agent testing, transfer planning assessment... ...outcome reporting, and high-quality project execution. Selected... ...management, infrastructure engineering, cloud engineering, platform...QualityRemote jobHourly payWeekly payJob sharingContract workPart timeFor contractorsFlexible hours24-MAG
New York, NYa month ago- ...Overview As part of your Staff Software Engineer - Data AI Agent role, you will focus on building and maintaining Data AI agent - a tool designed to... ...execution. Develop the foundations of code architecture and quality. Mentor and coach engineers. Set and uphold the...QualityTemporary work
Aledade, Inc.
New York, NY4 days ago - ...critical workstreams - the agent runtime and backend... ...house infrastructure. This is staff-level ownership from architecture... ...Scanner gateway and rules engine - YAML-configurable evaluation layer between signals and... ...of autonomous financial software, this is your role....
Siza Buso Consulting
New York, NY1 day ago $300k - $430k
...Health, and Hunter Douglas to deploy AI agents that power personalized, deeply... ...responsible for coordinating model reasoning, evaluating agent behavior, and ensuring that... ...of interactions. About the Role As a Staff Software Engineer on the Agent Orchestration team, you will...Work at office- ...brands. We are looking for a Staff Software Engineer to lead the AI Platform... ...into sound engineering plans. Evaluate build‑vs‑buy decisions, new... ...and enforce technical quality standards Lead design reviews... ...of the AI platform Develop agent orchestration, tool systems...Quality
STORD
New York, NY2 days ago - ...supported. We're looking for Staff Software Engineers to balance the role of an individual contributor... ...and coding standards Write high quality, well tested code to meet the needs of... ...period. We encourage you to carefully evaluate how your skills and interests align...QualityLocal area
Coinbase Global
New York, NY1 day ago $101.5k - $195k
...automakers. How you’ll make an impact: As a Staff Software Engineer, you will help make SiriusXM’s massive... ...search systems that retrieve high‑quality results at scale. You’ll drive... ...pipelines from prototype to production. Evaluate, fine‑tune, and integrate off‑the‑shelf...QualityTemporary workLocal areaShift workAdswizz
New York, NY1 day ago$180k - $215k
...The Opportunity As a Staff Engineer at Pearl Health, you will serve as... ...enable Pearl Health to deliver quality healthcare technology at... ...Leadership Mentor engineers at Software Engineer I, II, and III... ...or live assessment meant to evaluate relevant technical skills. Engineering...QualityTemporary workShift workPearl Health
New York, NY19 hours ago- ...Staff Software Engineer page is loaded## Staff Software Engineerlocations: US... ...connect with licensed insurance agents. This is all powered by our... ...continuously thinks about quality and modern engineering... ...quality, or governance.* Can evaluate AI tools for practical impact...QualityLocal areaImmediate startRemote work
Polly Insurance Agency, LLC
New York, NY4 days ago $157k - $208k
...Location Type Hybrid Department Engineering Compensation Senior Product... ...$172K - $228K Offers Equity Staff Product Engineer 1 (L6) - $18... ...5. We’re improving access to quality healthcare for everyone, everywhere... ...as well as interview evaluation. Ranges are market‑dependent...QualityFull timeINSIDER
New York, NY18 hours ago$180k - $225k
...are excited to grow our internal Engineering team as we are seeking a Staff Software Engineer to join our dynamic and... ...a direct impact on Engineering. Evaluate and recommend tools, technologies... ...processes to ensure the highest quality of performance for the Engineering...QualityFull timeFor contractorsWork at officeRemote workFlexible hoursLuna Physical Therapy
New York, NY4 days ago- ...We are looking for a Staff or Senior Fullstack Engineer to work on developing and scaling... ...with a focus on speed, quality, and iteration. This is... ...direction for large projects. Evaluate, strengthen, and document... ...processes. Champion software quality, implement...Quality
Spartan Technologies
New York, NY3 days ago $188k - $230k
...place for you. About the Role As a Staff Android Software Engineer in our Hospitality group, you are a... ...You will set the standard for code quality, documentation, and automated testing... ...Product, Design, and leadership to evaluate feasibility, shape roadmap decisions...QualityLocal areaImmediate startNight shiftSpotOn
New York, NY4 days ago- ...capabilities in digital experience engineering (Mobile and Web), marketing... .... We are seeking a Staff Software Engineer to provide... ...strategies. Define data quality, consistency, and lineage expectations... ...tooling. Experience evaluating vendors, leading build vs buy...QualityContract workVisa sponsorship
American Express
New York, NY3 days ago - ...Staff Software Engineer (Full Stack, Backend-Leaning) The Opportunity Our client is hiring... ...by improving standards, code review quality, observability, incident readiness, and... ...powered features with real guardrails (evaluation, monitoring, fallback paths) You’...Quality
NxT Level
New York, NY1 day ago $196k - $245k
...innovative and forward-thinking Staff Software Developer passionate about... ...and modern software engineering, delivering scalable, reliable... ...that improve overall code quality Champion engineering best practices... ...technical design and code evaluations Cross-Functional Impact:...QualityFull timeSeasonal workWork at officeLocal areaWorldwideFlexible hoursBlockchain Capital
New York, NY18 hours ago$210k - $280k
...Staff Software Engineer New York About Us Harmonic is the startup discovery engine. It pains... ..., research, analyze, compare, and evaluate across the entire universe of startups... ...deliver highly personalized and high quality results. Create architectural patterns...QualityWork at officeShift workHarmonic
New York, NY3 days ago- ...Staff AI/ML Engineer The Growth Engineering team builds world-class products... ...Build, train, and evaluate models Deploy and serve... ...ranking Implement AI data quality and monitoring frameworks to... ...Will Need ~7+ years of software engineering experience, including...QualityWork at officeImmediate start3 days per week
MyHealthTeam
New York, NY4 days ago $281k - $356k
...to address complex long-tail evaluation needs. You Will:... ...temporary mitigations and permanent software fixes, as well as preventing... ...with Data Science, Systems Engineering and operations teams to streamline... ...architecture, and high-quality software development, acting...QualityPermanent employmentFull timeTemporary workRemote workWaymo
New York, NY3 days ago- ...revenue About the Role We’re hiring a Staff Software Engineer to lead the architecture and... ...observability, performance, and data quality Mentor engineers and elevate engineering... ...infrastructure, simulation systems, or evaluation frameworks Background supporting applied...QualityFull timeFreelanceInternshipWork at officeFlexible hours
Handshake
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Agent Quality & Evaluation. Be the first to apply!
Related searches
- booking agent New York, NY
- sourcing agent New York, NY
- commissioning agent New York, NY
- recovery agent New York, NY
- cruise agent New York, NY
- state farm agent New York, NY
- transfer agent New York, NY
- telemarketer - state farm agent team member New York, NY
- airport agent New York, NY
- executive protection agent New York, NY