Senior Software Quality Engineer, Agentic Harness
$113.4k - $221.75kAdobe Systems
The OpportunityAdobe is reimagining the future of creativity, where generative AI and human imagination work together. As a Quality Engineer on the Agentic Harness team, you’ll help the harness behave the way creators expect. You’ll verify that the agent’s behavior, tool use, and outputs meet Adobe’s quality and reliability bar before they ship. You’ll work closely with engineers and data scientists to catch regressions early and harden test coverage. You’ll help the team ship quickly without breaking what already works.You’ll bring a quality perspective to a fast-moving, agent-based system. You’ll write and maintain automated test suites and design test plans for new agent capabilities. You’ll dig into failures to find root cause. This is a hands-on role where you’ll grow your skills evaluating LLM-based and agentic systems. You’ll join a team building quality practices for this space from the ground up.What you’ll doDesign, write, and maintain automated test suites and test plans covering the agentic harness’s behavior, tool use, and outputs.Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.What you’ll need to succeedBachelor’s degree in Computer Science or a related field, or equivalent experience.Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.Hands-on experience writing automated tests and test frameworks. Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.Comfort digging into bugs and failures across a stack to identify root cause, not just report symptoms.Familiarity with testing LLM-based or agentic systems and how their behavior differs from traditional software.Comfort operating in a fast-moving, ambiguous environment where the technology and user expectations are evolving quickly.About AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let’s Adobe togetherAt Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email View email address on click.appcast.io Use Guidelines for Interviews:Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.Expected Pay Range:Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $113,400 -- $221,750 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $153,200 - $221,750 In New York, the pay range for this position is $153,200 - $221,750 In Washington, the pay range for this position is $142,500 - $206,275 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.State-Specific Notices:California:Fair Chance OrdinancesAdobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.Colorado:Application Window NoticeIf this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.Massachusetts:Massachusetts Legal NoticeIt is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.SummaryLocation: San Francisco; San Jose; Seattle; Lehi; New YorkType: Full time
- ...new product we are building from scratch, and quality engineering is a core founding-team focus.We seek a Senior Software Quality Engineer eager to establish standards... ...deterministic, and developer-friendly.Stand up evaluation harnesses for automated workflows: golden prompt suites,...SeniorShift work
$80 - $85 per hour
...partnering with a client to find a Senior Agentic AI Engineer who will design, build, and... ..., observability, and quality controls for AI agents and... ...Python and production software engineering skills with hands... ...MCP integration, and agent harness engineeringProficiency designing...SeniorRemote work$220k - $290k
...of transforming product quality and customer... ...medtech manufacturers to harness the power of quality and... ...looking for an experienced Software Engineer to help architect and scale the agentic systems at the core of... ...Axion platform. This is a senior individual contributor...SeniorLocal areaWork from homeFlexible hoursNight shiftWeekend work- ...evaluated. The Agent Harness Bridge team sits at the... ...systems, ensuring the same agentic coding runtime used in... ...for a Principal Software Engineer to lead the architecture... ...role is ideal for a senior backend or infrastructure... ...engineering quality. In this role, you...SuggestedFull time
- ...Senior/Staff Product Manager, Agentic Practice CloudZero is seeking a Senior/Staff Product... ...discipline - such as engineering, finance, DevOps, product... ...with long-term product quality and platform health Enterprise... ...building reusable harnesses, skills, or agent patterns...SeniorTemporary work
- ...Senior Quality Assurance Engineer At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government... ...disciplined release management for embedded software deployed in real-world transportation environments...Senior
$155k - $185k
...Senior Software Quality Engineer San Francisco Company Overview Echo Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver...Senior- ...building a full-stack AI platform from the ground up; one that is agentic, vertically integrated, and designed for scale. This gives... ...say is impossible. The Role We're looking for a Senior Software Engineer focused on AI systems to join our Engineering team. You'll...SeniorFull time
$230k - $340k
...production data pipeline, not a research demo. We're hiring a Senior AI Engineer to own a slice of this enrichment surface end-to-end.... ...search, scraping, structured database lookups, scoring), eval harness, and instrumentation surface for token-and-tool tracing....SeniorFull timeWork at officeFlexible hours- ...Associate Vice President, Senior Product Manager, Agentic Workflows About the Company Premier commercial real estate finance company Industry... ...technologies, including large language models, prompt engineering, and agentic workflows, as well as the ability to...Senior
$200k - $400k
Senior Software Engineer - Agentic Systems We are partnered with a highly technical AI research company building advanced AI systems capable of operating across complex, real‑world engineering environments. The company is well‑funded, executing large‑scale programs, and...SeniorFull timeImmediate start$159k - $239k
...authentication for the GenAI era. We’re looking for a Senior Software Engineer to join the AI Agentic Experience team at Auth0. This role is pivotal in... ...broader AI + identity ecosystem Write and Maintain High-Quality Documentation including API references, quickstarts,...SeniorFull timeLocal areaWorldwideFlexible hours- ...Role: This role builds the layer that turns model capability into systems that actually work for users. You'll develop the core agent harness (the execution loop, tool-use strategies, context construction, and model-facing experimentation) and iterate on agent behaviors...SeniorFull timeContract workH1bVisa sponsorship
$168.1k - $312.3k
...group whose goal is to harness the transformative... ...motivated and passionate Senior ML Engineer to join our... ...foundation models and agentic systems for therapeutic... ...candidate combines strong software and ML engineering... ...caching, latency/cost/quality tradeoffsML infrastructure...SeniorFull timeLocal areaWorldwideRelocation package- ...entity.Be the backbone of Atlassian’s Agentic AI Integration Products : The Agentic AI... ...ResponsibilitiesLeadership: Build, coach, and mentor a team of software engineers.Technical Strategy: Deliver... ...in building and maintaining high-quality system components and servicesYou are...SeniorWork at officeLocal area
$172.55k - $203k
...deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped... ...in and out of the office. We are seeking a highly skilled Senior Software Test Engineer to join our team. In this role, you will be responsible...SeniorWork at officeLocal areaRemote workFlexible hours$123.1k - $227k
...transformation in the agentic era? You’re in the right... ...about turning the software on — it's about continuous... ...As a Customer Success Senior Manager, you are a key... ...— whether it's data quality issues in Data Cloud,... ...Salesforce Product and Engineering teams to help ensure the...SeniorFull timeWork experience placementShift work$122k - $240.5k
Position Summary Agentic AI is moving from... ...'re growing a team of engineers who want to work at the... ...verticalized sector solutions in software, data, AI, network,... ...to detail and quality of work productAbility... ...entry-level employees to senior leaders, we believe...SeniorWork at officeLocal areaVisa sponsorshipShift work$286.2k - $326.7k
...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating responsible and reliable AI... ...testing, deployment, and support AI software components including foundation... ...to build systems, take pride in the quality of your work, and also share our passion...SeniorFull timePart timeRemote work$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview At Capital One, we are creating responsible and... ..., test, deploy, and support AI software components including foundation... ...building systems, take pride in the quality of your work, and share our...SeniorLocal area$190k - $270k
...unique combination of proprietary infrastructure and software, we empower over 250,000 businesses worldwide -... ...AI tooling across the spectrum: from prompt engineering and in-context learning to fine-tuned models and agentic systems, choosing the right approach for each problem...SeniorTemporary workLocal areaWorldwide$150k - $245k
...proprietary infrastructure and software, we empower over 250,000... ...are tool-agnostic, and expect engineers to own problems end-to-end. We... ...industry has.About the RoleAs a Senior Backend Engineer, you’ll help... ...+ Pydantic) that power agentic workflows, AI copilots, and real...SeniorTemporary workLocal areaWorldwide$162.7k - $220.2k
...future of autonomous AI systems. The Senior WW Partner GTM Specialist for Agentic AI will be the driving force... ...lasting impact on how businesses harness autonomous AI agents, this role offers... ...schedules- Experience selling enterprise software or cloud-based applications-...SeniorLocal areaWorldwideFlexible hours$176k - $220k
...Handshake, we believe the infrastructure you build should be as thoughtful as the product it supports. We're looking for a Senior Cloud Engineer on the Agentic Infrastructure team who's excited to shape the foundation that our engineering teams build on — someone who sees...SeniorFull timeFreelanceInternshipWork at officeRemote workFlexible hours$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable... ..., test, deploy, and support AI software components including foundation... ...systems, take pride in the quality of your work, and also share our...SeniorFull timePart timeLocal area- ...We are now looking for a Senior Applied AI Engineer to build the intelligence layer... ...first place: the metrics, harnesses, and feedback loops that... ...observability. Build better agentic infrastructure and partner... ...~7+ years of professional software engineering experience, with...SeniorFull timeRemote workWork from home
$286.2k - $326.7k
...Overview Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) At Capital One, we are creating... ..., deployment, and support AI software components including foundation model... ...build systems, take pride in the quality of your work, and also share our passion...SeniorFull timePart timeLocal areaRemote work$175k - $205k
...this way. The Role: Forge’s quality engineering team’s charter is to improve... ...accountable.We are seeking a Sr Software Development Engineer in Test... .... We are looking for a senior, technical and customer focused... ...with AI solutions such as agentic automation, MCPs, RAG applications...SeniorContract workLocal area- ...decarbonize their business. We're looking for software engineers to help build the AI platform that... ...leader laying the foundations for agentic AI at Watershed - designing the orchestration... ...behavior at scale Build evals, harnesses, and guardrails that turn agent...SeniorFull timeWork at officeRemote work
- ...About Flow Flow Engineering is an AI-native requirements platform... ...Flow is seeking full stack senior software engineers to build AI-powered... ...effectively. You will work on agentic systems engineer and agentic... ...data pipelines, evaluation harnesses, prompt and model management...SeniorFull timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Quality Engineer, Agentic Harness. Be the first to apply!
- software test engineer San Francisco, CA
- qa engineer San Francisco, CA
- senior software test automation engineer San Francisco, CA
- senior software quality engineer San Francisco, CA
- quality assurance engineer San Francisco, CA
- senior quality assurance engineer San Francisco, CA
- senior automation test engineer San Francisco, CA
- software quality engineer San Francisco, CA
- qa automation engineer remote San Francisco, CA
- qa automation test engineer San Francisco, CA



