Staff Software Engineer - Agent Quality
$190k - $270kDatabricks Inc.
Staff Software Engineer - Agent Quality
P-1215 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI platform so our customers can focus on the high-value challenges that are central to their own missions. The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. We believe a company's data is its greatest competitive advantage, and we're building the models and agents that unlock it. Our work spans the full stack, from model training to advanced multi-agent systems.
As a Staff Software Engineer - Agent Quality, you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure, tooling, and developer workflows that let researchers and engineers evaluate agents rigorously - driving a flywheel where evaluation results feed directly back into agent improvement across the full lifecycle, from development and training to production.
The impact you will have
P-1215 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI platform so our customers can focus on the high-value challenges that are central to their own missions. The Databricks AI Research organization is pushing the frontier of next-generation enterprise AI. We believe a company's data is its greatest competitive advantage, and we're building the models and agents that unlock it. Our work spans the full stack, from model training to advanced multi-agent systems.
As a Staff Software Engineer - Agent Quality, you will be a founding member of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure, tooling, and developer workflows that let researchers and engineers evaluate agents rigorously - driving a flywheel where evaluation results feed directly back into agent improvement across the full lifecycle, from development and training to production.
The impact you will have
- Stand up the foundational evaluation infrastructure for Genie Agents, enabling rigorous benchmarking, regression detection, and quality measurement across research and product teams.
- Build the flywheel that connects evaluation results back into agent improvement - closing the loop between production signals, training, and iterative development.
- Shape the long-term technical direction for agent quality infrastructure, with real influence over how Databricks measures and improves its first-party agents and agent development platform.
- Help shape the long-term technical direction for agent quality infrastructure as Databricks expands its first-party agents and agent development platform.
- 6+ years industry experience building software systems
- Strong Python programming skills, with experience building production or research infrastructure
- Experience building or operating distributed systems, data pipelines, or large-scale infrastructure with a focus on reliability, correctness, and operational maturity
- Ability to design pragmatic but rigorous systems that produce trustworthy, reproducible signals for complex applications
- Comfort working across ambiguous research and product boundaries, and partnering with both researchers and engineers to turn ideas into robust internal platforms
- A high bar for technical quality, strong ownership, and the ability to influence roadmap and execution across multiple teams
- Experience with devtools, CI/CD platforms, testing frameworks, observability tooling, or benchmarking infrastructure
- Familiarity with how LLM or agent quality is measured - whether through evals, experimentation platforms, or production monitoring
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer - Agent Quality in New York, NY vacancy
- ...Staff Software Engineer (Voice Agent) Title of Role: Staff Software Engineer (Voice Agent) Location: New York, New York, onsite Company Stage... ...standards organization-wide, emphasizing code quality, scalability, and maintainability. Mentor and develop...QualityWork at office
$200k - $400k
...Hunter Douglas to deploy AI agents that power personalized, deeply... ..., frontier-style engineering. The team continuously analyzes... ...iterates quickly to improve quality, reliability, and capability... ...About the Role As a Staff Software Engineer on the Agent Orchestration...QualityFull timeWork at officeLocal area$240k - $300k
...Staff Applied Agent Engineer Traba is the AI operating layer for the industrial supply chain. We started... ...deployed at Traba; set the bar for quality and reliability; and bring the... ...Have ~7+ years of professional software engineering experience, with 2+ years...QualityTemporary workStart working todayLocal areaFlexible hoursShift work$160k - $180k
...The Role: SnapLogic is seeking a Staff Software Engineer to join our Agent Creator Team. This pivotal role will have you leading the development and enhancement... ...simultaneously ensuring the highest standards of code quality. Debug and Troubleshoot Complex Issues : Quickly...QualityFull timeRemote work2 days per week$180k - $220k
...We're looking for a Senior/Staff Backend Engineer to architect and build large... ...power Actively's GTM AI agents. These agents continuously... ...maintainable, and reliable software. Strong backend engineer... ...faster without sacrificing quality. Curious about AI systems...QualityFull timeWork at officeShift work$190k - $270k
Databricks Inc. is seeking a Staff Software Engineer - Agent Quality in New York, NY. This role focuses on building evaluation infrastructure for AI Agents, ensuring quality and continuous improvement. The ideal candidate will have over 6 years of experience, strong Python...Quality$231k - $340k
...customers — from leadership to engineers — and work together to... ...started. Role Overview As a Software Engineer, Agents, you'll build the systems that... ...to drive task completion quality and customer delight.... ...role across Mid, Senior, and Staff levels. Proficiency in Python...Quality$190k - $270k
Databricks is seeking a Staff Software Engineer - Agent Quality in New York to lead efforts in evaluating AI Agents. You will create infrastructure for benchmarking and quality measurement in a collaborative environment. Ideal candidates have 6+ years of experience and...QualityLocal area- ...Overview As part of your Staff Software Engineer - Data AI Agent role, you will focus on building and maintaining Data AI agent - a tool designed to... ...execution. Develop the foundations of code architecture and quality. Mentor and coach engineers. Set and uphold the...QualityTemporary work
- ...OKX Wallet, OKLink and more. Job Summary We are seeking a Quality Assurance Engineer to take technical ownership of system-level quality, resilience... ..., and reliability across OKX’s core platforms. This is a Staff-level role with responsibility beyond individual test...Quality
- ...two critical workstreams - the agent runtime and backend... ...house infrastructure. This is staff-level ownership from architecture... ...Scanner gateway and rules engine - YAML-configurable evaluation... ...category of autonomous financial software, this is your role. Required...
- ...A leading tech company is seeking a Staff Software Engineer to join their Copilot API team. In this role, you'll be responsible for designing... ...systems, and a proven track record of leadership and code quality. The position offers a competitive salary and the opportunity...QualityRemote work
- ...A tech company in ag tech is looking for a Staff Software Engineer to join their fully remote team. The ideal candidate will have over 8 years... ...to problem-solving. Responsibilities include writing high-quality code, leading projects, and collaborating with cross-functional...QualityRemote work
- ...Stord Inc. is seeking a Staff Software Engineer to join our innovative team and drive technical excellence in building scalable systems. You... ...and collaborate with Product and Design teams to ensure high-quality deliverables. Your expertise in Elixir and large-scale systems...QualityRemote work
- ...We are looking for a Staff or Senior Fullstack Engineer to work on developing and scaling the the company'... ...concept to release with a focus on speed, quality, and iteration. This is an... ..., tools, and processes. Champion software quality, implement automation, drive...Quality
$180k - $230k
...Role: Senior/Staff Software Engineer Employment Type: Full-Time Location: Remote (North America — ET to PT time zones) Compensation: $180,000... ...’ll join a small, high‑impact team where craftsmanship and quality matter. What You’ll Do Build scalable, secure backend services...QualityFull timeRemote workFlexible hours- ...knowledge work. With a strong engineering culture and a cross-... ...The Role We’re looking for a Staff Fullstack Engineer who’s passionate... ...continuous improvements in UX, code quality, and developer tooling What... ...building production-grade software Expertise in frontend development...Quality
- .... Be the liaison between product and engineering leadership, translating business objectives... ...team, raising the bar for engineering quality and process in mission-critical... ...Experience: 8+ years of professional software engineering experience, with a strong track...QualityWork at office3 days per week
- ...AI-powered conversational agents handle every high-value inbound... ...We're looking for a Staff Product Engineer to operate at the highest... ...engineering standards across code quality, testing, monitoring, and... ...All core tools and software provided Why Avoca...QualityFull timeInternshipWork at officeImmediate startFlexible hours
- ...Staff Software Engineer Adaptive is a rapidly growing vertical AI company building an AI-native ERP for real estate and construction. We have... ...our engineering efforts and ensuring the delivery of high-quality software. Reporting to the VP of Engineering, you will...QualityWork at officeLocal areaFlexible hours
- ...Staff Software Engineer Hybrid - New York, NY Company Description Farther is a rapidly growing RIA that combines expert advisors with... ...leverage AI tools to accelerate development, improve code quality, and multiply team effectiveness. You'll help the organization...Quality
- ...collaboration and AI-powered workflow software designed specifically for military staffs. By transforming this work,... ...role We're hiring Staff Software Engineers to take on some of the most challenging... ...-facing surfaces Improve system quality and dev experience by cleaning up...QualityRemote work
$189k - $290.7k
...Assistance Systems and Automated Driving) Software Organization within General Motors, we... ...seeking an experienced platform software engineer to design and develop platform software... ...using C and C++14+, ensuring high software quality standards. Create automation scripts in...Quality- ...(Hybrid Schedule) We are seeking a passionate Senior / Staff Software Engineer with extensive experience in architecting and building highly... ...Terraform and Crossplane. ~ Experience in producing high-quality software designs to support long-term maintainability and...Quality
- ...Staff Software Engineer (Insights) Title of Role: Staff Software Engineer (Insights) Location... ...teams to build, manage, and scale AI agents for omnichannel customer support. Their... ...rapidly, validate ideas, and deliver high-quality user experiences. Provide technical...QualityWork at officeVisa sponsorship
- ...Manager: Andrew Rosen, Head of Engineering About Arc Arc is... ...native financial platform. As a Staff Software Engineer , you will own... .... Contribute to Arc's AI agent, Archie, evolving from... ...engineers and elevate engineering quality across the team. What You...QualityFull timeWork at officeWork from home
$200k - $230k
...Staff Software Engineer New York, New York, United States Courier Health is on a mission to solve one of the biggest and most meaningful... ...experience with object oriented programming and a high bar for code quality ~ Experience with AWS services, such as DynamoDB, API...Quality- ...technology capabilities in digital experience engineering (Mobile and Web), marketing and... ...customer experience. We are seeking a Staff Software Engineer to provide technical... ...vendor fallback strategies. Define data quality, consistency, and lineage expectations...QualityContract workVisa sponsorship
- ...Staff Engineer Opportunity Cobalt ID is building the business identity infrastructure for the financial internet. While others focus... ...'s where they do their best work. You'll set the engineering quality bar, mentor other engineers, and shape how we scale the team...QualityFull time
$206.7k - $289.4k
...is one of the internet’s largest sources of information. For more information, visit redditinc.com . The Quality Engineering (QE) team is seeking a Staff Software Development Engineer in Test who can work in a highly collaborative environment, design/develop tools, test...QualityWork experience placementRemote workHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer - Agent Quality. Be the first to apply!
Related searches

