Senior Engineer, AI Agent Quality & Platform
ACM CAIS 2026
Databricks is building a new Staff Software Engineer – Agent Quality to lead the design and scaling of infrastructure, tooling, and workflows that rigorously evaluate AI agents across development, training, and production. You will stand up foundational evaluation infrastructure for Genie Agents, enabling benchmarking, regression detection, and quality measurement across research and product teams, driving a cutting-edge open feedback loop for agent improvement. #J-18808-Ljbffr ACM CAIS 2026
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Engineer, AI Agent Quality & Platform in New York, NY vacancy
$202k - $230k
...team works directly with Engineering, Design, Experience... ...the Product Manager for Agent Context in NYC, you will... ...knowledge across Asana’s AI experiences. Your... ...enterprise. Optimize retrieval quality and performance across... ...a more context-aware platform. About You 5+ years...PlatformQualitySeniorWork at officeWork from homeWorldwide- ...Compliance to perform risk analysis and leads efforts to resolve quality issues as necessary Requirements 6+ years’ experience in... ...insights, including the use of A/B testing and analytics platforms Understanding of AI system behavior and limitations (accuracy, latency, cost)...PlatformQualitySenior
- ...that at a company where the AI is the product, this is worth... ...behind the product and hiring a senior engineer to help lead that. This is... ...a research role. It's not a platform team role. It's for someone who... ...shipping, reliability + product quality in equal measure. The role...PlatformQualitySenior
HartleyCo
New York, NY1 day ago $124.9k - $228.9k
The Trade Desk is seeking an experienced software engineer to join their team developing internal AI solutions. You will work with large language models and platforms like Microsoft Copilot to enhance productivity and streamline workflows. The ideal candidate has 8-10+...PlatformSenior- AI Delivery Lead At Gradient Labs, we’re... ...love). Our AI agent helps businesses handle... ...that embed our platform deeply into their... ...and ensuring a high-quality outcome. Conduct... ...with internal AI, Engineering, and Sales teams ,... ...technical teams and senior leadership....PlatformQualitySeniorWork at office2 days per week3 days per week
- ...an experienced QA Automation Engineer to build and sustain a test-driven culture across the M5 platform. You will design, implement, and... ...automated test frameworks and AI-assisted testing strategies,... ...partnering with engineering to ensure quality from planning through release....PlatformQualitySeniorRemote job
- ...a global leader in digital advertising quality, seeks a Senior Manager, Engineering in New York. You will lead and mentor a team of engineers, shape AI-enabled product directions, and drive scalable architectures across platforms, partnering with Product and other stakeholders...PlatformQualitySenior
- ...marketing agency is seeking an Associate Director, AI Engineer in New York to develop innovative AI products.... ...LLM frameworks, focusing on designing multi-agent systems and collaborating with teams to deliver high-quality AI solutions. The candidate will engage in hands...QualitySenior
- ...leading conversational AI platform empowering every brand... ...Douglas to deploy AI agents that power personalized... ...and raises the quality of every build that follows... ...and Forward Deployed Engineers to scale the agent in... ...behind you. This is a senior individual contributor...PlatformQualitySeniorFull timeWork at officeLocal area
- Kforce Inc in New York, NY is seeking an experienced AI Engineer to lead the delivery of agents, automations, and platform components that drive client operations. You... ...pod's roadmap, manage 4-8 engineers, and ensure quality, timelines, and margins while partnering with...PlatformQualitySenior
$250k - $330k
...the leading conversational AI platform empowering every brand to deliver... ...Douglas to deploy AI agents that power personalized, deeply... .... About the Role As a Senior Software Engineer on the Agent Orchestration... ...performance, reliability, and quality. You will have significant...PlatformQualitySeniorWork at office$207k - $300k
...Master’s degree or PhD in Engineering, Computer Science, or a... ...Experience in Vertex AI, BigQuery, Cloud... ...versatile, display leadership qualities and be enthusiastic to... ...As a Staff Applied AI Agent Developer, you will be... ...sophisticated AI agents on our platform. This is a high-impact...PlatformQualitySeniorFull timeFlexible hoursShift work- ...focused on improving the quality, opportunity, and affordability... ...please visit: . As a Senior Associate of Analytics Engineering within Morgan Health, you... ...product/architecture, and platform partners) Preferred... ...technologies Experience using AI-assisted coding tools to...PlatformQualitySeniorVisa sponsorship
J.P. Morgan
New York, NY16 days ago - ...A robotics startup building a platform that automates how physical, real... ...to test generation to AI-proposed fixes, spanning software... ...'s a novel infrastructure-and-agents problem. Founders : a tight-knit... ...and internal tools that keep engineers and customers moving fast. Build...PlatformSeniorWork at office
$160k - $200k
...a next-generation platform that provides a comprehensive... ...programs to help agents develop expert... ...We’re hiring a Senior PM to lead data products and AI agents powering our... ...with data science, engineering, and analytics to shape... ...delivering a high-quality experience for...PlatformQualitySeniorFull timePart timeWork at officeRelocation$124k - $186k
Senior Software Engineer, AI Products & Agents 45696 New York, NY, US, 10036 Technology New York Full-Time Fully... ...Global builds the internal platforms that power how the business understands... ...engineering standards around code quality, testing, and system design Shape...PlatformQualitySeniorFull timeImmediate startRemote work$80 per hour
...with project-based AI opportunities for... ...project is suited for a Senior Python developer... ...across different platforms Monitor code... ...improve overall code quality Requirements 5+... ...experience as a Software Engineer (primarily Python)... ...experience with agent evaluation...PlatformQualitySeniorPermanent employmentTemporary workFreelanceRemote workFlexible hours$218k - $273k
Scale AI is the data foundation for AI, helping... ...our data annotation platform, generative AI... ...About the General Agents Team The General Agents... ...About the Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...writing production-quality, testable, and maintainable...PlatformQualitySeniorFull timeContract workFor contractorsFor subcontractorWork at office$182k - $242k
CoreWeave, the AI Hyperscaler™, acquired... ...end‑to‑end platform to develop, deploy... ...training clusters, agent building, and inference... ...experimentation at scale. The engineering team is... ...The Role As a Senior Full Stack Engineer... ...sacrificing production quality. Wondering if you...PlatformQualitySeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$229.9k - $262.4k
...Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) Overview At Capital One, we are creating responsible and reliable AI systems, changing... ...Candidate You love to build systems, take pride in the quality of your work, and also share our passion to do...PlatformQualitySeniorFull timePart timeLocal areaCapital One National Association
New York, NY1 day ago$170k
...Barclays as a Prime Risk Senior Developer - VP, where... ...risk and PnL management platform—a unified, cross-asset... ...delivers real-time analytics, AI enabled workflows, and... ...deployment of risk engines and real-time services... ...the delivery of high-quality software solutions, driving...PlatformQualitySeniorHourly payTemporary workWork at office$103.2k - $189.2k
...world's leading independent platform for digital advertising, with... ...support trusted journalism, quality entertainment, and creators... ...meet you. We are seeking a Senior Systems Engineer, Commercial Intelligence and... ...proactive signal delivery, and AI‑assisted workflows that...PlatformQualitySeniorFull timeTemporary workLocal areaWorldwide$130k - $147k
...the center of every decision. Our AI-first platform transforms proprietary data, advanced... ...We are looking for a Senior Machine Learning Engineer to support our Databricks-native machine... ...role is critical in ensuring high-quality model monitoring and compliance....PlatformQualitySeniorPart timeWork at officeRemote workWork from homeFlexible hoursCurinos Inc
New York, NY8 days ago$190.8k - $267.1k
...information, visit The Test Engineering team within the Quality Engineering (QE) org is looking for a Senior Software Engineer who can... ...Software Engineer for Android platform 3+ years in Android development... ...by artificial intelligence (AI). You will have the opportunity...PlatformQualitySeniorFor contractorsWork experience placementFlexible hours$165k - $220k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and... ...the internal and customer engineering teams, offering valuable insights... ...match. Here are a few qualities we’ve found compatible with our...PlatformQualitySeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- Get AI-powered advice on this job and more exclusive features... ...For higher-risk users, our platform integrates seamlessly with... .... The Role: As a Senior Site Reliability Engineer (SRE) at Dune Security, you... ...early and ensure high code quality before deployment. What We’...PlatformQualitySeniorFull timeWork at office
$140k - $170k
...Our team is building a global platform for illiquid asset... ...rendering efficiency Operate as an AI-augmented engineer, using modern AI tools to significantly... ...your development speed and quality - while maintaining strong... ...Pilot and orchestrate AI agents to handle multi-step...PlatformQualitySeniorTemporary work- ...DescriptionRequisition ID94030DepartmentTech Data AI VenturesJob FunctionTech Data... ...weekRole Overview:The Data Quality Engineer plays a key role in advancing... ...governance workflows using platforms such as Anomalo, Atlan and... ...to see how our employees and agents are leading the industry and...PlatformQualitySeniorLocal area
$144k - $329.1k
...leveraging data, AI, and emerging GenAI... ...operations. As a Senior Manager specializing... ...overseeing the engineering and scaling of AI,... ...leader across AI, data platforms, GenAI, and... ...orchestration frameworks, and agent‑based solutions.... ...demonstrate these qualities. EY | Building a...PlatformQualitySeniorSummer holidayFlexible hoursEY
New York, NY9 hours ago$130k - $160k
...commerce run through the Upside platform every year, and that value... ...initiatives. About The Role At Upside, engineers are expected to gather the... ...decisions that lead to high quality software and delightful user... ...Actions. We also leverage numerous AI tools, including OpenAI and...PlatformQualitySeniorFull timeWork at officeFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Engineer, AI Agent Quality & Platform. Be the first to apply!
Related searches