Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Quality Engineer, Agentic Harness

$113.4k - $221.75k

Adobe Systems

The OpportunityAdobe is reimagining the future of creativity, where generative AI and human imagination work together. As a Quality Engineer on the Agentic Harness team, you’ll help the harness behave the way creators expect. You’ll verify that the agent’s behavior, tool use, and outputs meet Adobe’s quality and reliability bar before they ship. You’ll work closely with engineers and data scientists to catch regressions early and harden test coverage. You’ll help the team ship quickly without breaking what already works.You’ll bring a quality perspective to a fast-moving, agent-based system. You’ll write and maintain automated test suites and design test plans for new agent capabilities. You’ll dig into failures to find root cause. This is a hands-on role where you’ll grow your skills evaluating LLM-based and agentic systems. You’ll join a team building quality practices for this space from the ground up.What you’ll doDesign, write, and maintain automated test suites and test plans covering the agentic harness’s behavior, tool use, and outputs.Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.What you’ll need to succeedBachelor’s degree in Computer Science or a related field, or equivalent experience.Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.Hands-on experience writing automated tests and test frameworks. Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.Comfort digging into bugs and failures across a stack to identify root cause, not just report symptoms.Familiarity with testing LLM-based or agentic systems and how their behavior differs from traditional software.Comfort operating in a fast-moving, ambiguous environment where the technology and user expectations are evolving quickly.About AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let’s Adobe togetherAt Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email View email address on click.appcast.io Use Guidelines for Interviews:Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.Expected Pay Range:Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $113,400 -- $221,750 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $153,200 - $221,750 In New York, the pay range for this position is $153,200 - $221,750 In Washington, the pay range for this position is $142,500 - $206,275 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.State-Specific Notices:California:Fair Chance OrdinancesAdobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.Colorado:Application Window NoticeIf this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.Massachusetts:Massachusetts Legal NoticeIt is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.SummaryLocation: San Francisco; San Jose; Seattle; Lehi; New YorkType: Full time

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Quality Engineer, Agentic Harness in San Francisco, CA vacancy
  •  ...new product we are building from scratch, and quality engineering is a core founding-team focus.We seek a Senior Software Quality Engineer eager to establish standards...  ...deterministic, and developer-friendly.Stand up evaluation harnesses for automated workflows: golden prompt suites,... 
    Senior
    Shift work

    Adobe

    San Francisco, CA
    3 days ago
  • $80 - $85 per hour

     ...partnering with a client to find a Senior Agentic AI Engineer who will design, build, and...  ..., observability, and quality controls for AI agents and...  ...Python and production software engineering skills with hands...  ...MCP integration, and agent harness engineeringProficiency designing... 
    Senior
    Remote work

    Labur

    San Francisco, CA
    3 days ago
  • $220k - $290k

     ...of transforming product quality and customer...  ...medtech manufacturers to harness the power of quality and...  ...looking for an experienced Software Engineer to help architect and scale the agentic systems at the core of...  ...Axion platform. This is a senior individual contributor... 
    Senior
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    San Francisco, CA
    4 days ago
  •  ...evaluated. The Agent Harness Bridge team sits at the...  ...systems, ensuring the same agentic coding runtime used in...  ...for a Principal Software Engineer to lead the architecture...  ...role is ideal for a senior backend or infrastructure...  ...engineering quality. In this role, you... 
    Suggested
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...Senior/Staff Product Manager, Agentic Practice CloudZero is seeking a Senior/Staff Product...  ...discipline - such as engineering, finance, DevOps, product...  ...with long-term product quality and platform health Enterprise...  ...building reusable harnesses, skills, or agent patterns... 
    Senior
    Temporary work

    CloudZero

    San Francisco, CA
    2 days ago
  •  ...Senior Quality Assurance Engineer At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government...  ...disciplined release management for embedded software deployed in real-world transportation environments... 
    Senior

    Hayden AI

    San Francisco, CA
    28 minutes ago
  • $155k - $185k

     ...Senior Software Quality Engineer San Francisco Company Overview Echo Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver... 
    Senior

    Echo Neurotechnologies

    San Francisco, CA
    2 days ago
  •  ...building a full-stack AI platform from the ground up; one that is agentic, vertically integrated, and designed for scale. This gives...  ...say is impossible. The Role We're looking for a Senior Software Engineer focused on AI systems to join our Engineering team. You'll... 
    Senior
    Full time

    Soris

    San Francisco, CA
    1 day ago
  • $230k - $340k

     ...production data pipeline, not a research demo. We're hiring a Senior AI Engineer to own a slice of this enrichment surface end-to-end....  ...search, scraping, structured database lookups, scoring), eval harness, and instrumentation surface for token-and-tool tracing.... 
    Senior
    Full time
    Work at office
    Flexible hours

    Baselayer

    San Francisco, CA
    1 day ago
  •  ...Associate Vice President, Senior Product Manager, Agentic Workflows About the Company Premier commercial real estate finance company Industry...  ...technologies, including large language models, prompt engineering, and agentic workflows, as well as the ability to... 
    Senior

    Confidential

    San Francisco, CA
    3 days ago
  • $200k - $400k

    Senior Software Engineer - Agentic Systems We are partnered with a highly technical AI research company building advanced AI systems capable of operating across complex, real‑world engineering environments. The company is well‑funded, executing large‑scale programs, and... 
    Senior
    Full time
    Immediate start

    Strativ Group

    San Francisco, CA
    2 days ago
  • $159k - $239k

     ...authentication for the GenAI era. We’re looking for a  Senior Software Engineer to join the AI Agentic Experience team at Auth0. This role is pivotal in...  ...broader AI + identity ecosystem Write and Maintain High-Quality Documentation  including API references, quickstarts,... 
    Senior
    Full time
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    1 day ago
  •  ...Role: This role builds the layer that turns model capability into systems that actually work for users. You'll develop the core agent harness (the execution loop, tool-use strategies, context construction, and model-facing experimentation) and iterate on agent behaviors... 
    Senior
    Full time
    Contract work
    H1b
    Visa sponsorship

    Thomas Talent Network

    San Francisco, CA
    20 days ago
  • $168.1k - $312.3k

     ...group whose goal is to harness the transformative...  ...motivated and passionate Senior ML Engineer to join our...  ...foundation models and agentic systems for therapeutic...  ...candidate combines strong software and ML engineering...  ...caching, latency/cost/quality tradeoffsML infrastructure... 
    Senior
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    South San Francisco, CA
    8 hours ago
  •  ...entity.Be the backbone of Atlassian’s Agentic AI Integration Products : The Agentic AI...  ...ResponsibilitiesLeadership: Build, coach, and mentor a team of software engineers.Technical Strategy: Deliver...  ...in building and maintaining high-quality system components and servicesYou are... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    8 hours ago
  • $172.55k - $203k

     ...deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped...  ...in and out of the office. We are seeking a highly skilled Senior Software Test Engineer to join our team. In this role, you will be responsible... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours

    Oura

    San Francisco, CA
    1 day ago
  • $123.1k - $227k

     ...transformation in the agentic era? You’re in the right...  ...about turning the software on — it's about continuous...  ...As a Customer Success Senior Manager, you are a key...  ...— whether it's data quality issues in Data Cloud,...  ...Salesforce Product and Engineering teams to help ensure the... 
    Senior
    Full time
    Work experience placement
    Shift work

    Salesforce

    San Francisco, CA
    1 day ago
  • $122k - $240.5k

    Position Summary Agentic AI is moving from...  ...'re growing a team of engineers who want to work at the...  ...verticalized sector solutions in software, data, AI, network,...  ...to detail and quality of work productAbility...  ...entry-level employees to senior leaders, we believe... 
    Senior
    Work at office
    Local area
    Visa sponsorship
    Shift work

    Deloitte

    San Francisco, CA
    3 days ago
  • $286.2k - $326.7k

     ...Senior Director, AI Engineering -Agentic AI PlatformAt Capital One, we are creating responsible and reliable AI...  ...testing, deployment, and support AI software components including foundation...  ...to build systems, take pride in the quality of your work, and also share our passion... 
    Senior
    Full time
    Part time
    Remote work

    Capital One

    San Francisco, CA
    3 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview At Capital One, we are creating responsible and...  ..., test, deploy, and support AI software components including foundation...  ...building systems, take pride in the quality of your work, and share our... 
    Senior
    Local area

    Capital One National Association

    San Francisco, CA
    3 days ago
  • $190k - $270k

     ...unique combination of proprietary infrastructure and software, we empower over 250,000 businesses worldwide -...  ...AI tooling across the spectrum: from prompt engineering and in-context learning to fine-tuned models and agentic systems, choosing the right approach for each problem... 
    Senior
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    2 days ago
  • $150k - $245k

     ...proprietary infrastructure and software, we empower over 250,000...  ...are tool-agnostic, and expect engineers to own problems end-to-end. We...  ...industry has.About the RoleAs a Senior Backend Engineer, you’ll help...  ...+ Pydantic) that power agentic workflows, AI copilots, and real... 
    Senior
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    4 days ago
  • $162.7k - $220.2k

     ...future of autonomous AI systems. The Senior WW Partner GTM Specialist for Agentic AI will be the driving force...  ...lasting impact on how businesses harness autonomous AI agents, this role offers...  ...schedules- Experience selling enterprise software or cloud-based applications-... 
    Senior
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    3 days ago
  • $176k - $220k

     ...Handshake, we believe the infrastructure you build should be as thoughtful as the product it supports. We're looking for a Senior Cloud Engineer on the Agentic Infrastructure team who's excited to shape the foundation that our engineering teams build on — someone who sees... 
    Senior
    Full time
    Freelance
    Internship
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    18 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable...  ..., test, deploy, and support AI software components including foundation...  ...systems, take pride in the quality of your work, and also share our... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corp

    San Francisco, CA
    4 days ago
  •  ...We are now looking for a Senior Applied AI Engineer to build the intelligence layer...  ...first place: the metrics, harnesses, and feedback loops that...  ...observability. Build better agentic infrastructure and partner...  ...~7+ years of professional software engineering experience, with... 
    Senior
    Full time
    Remote work
    Work from home

    Roger Healthcare

    San Francisco, CA
    1 day ago
  • $286.2k - $326.7k

     ...Overview Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) At Capital One, we are creating...  ..., deployment, and support AI software components including foundation model...  ...build systems, take pride in the quality of your work, and also share our passion... 
    Senior
    Full time
    Part time
    Local area
    Remote work

    Capital One

    San Francisco, CA
    a month ago
  • $175k - $205k

     ...this way. The Role: Forge’s quality engineering team’s charter is to improve...  ...accountable.We are seeking a Sr Software Development Engineer in Test...  .... We are looking for a senior, technical and customer focused...  ...with AI solutions such as agentic automation, MCPs, RAG applications... 
    Senior
    Contract work
    Local area

    Forge Global

    San Francisco, CA
    2 days ago
  •  ...decarbonize their business. We're looking for software engineers to help build the AI platform that...  ...leader laying the foundations for agentic AI at Watershed - designing the orchestration...  ...behavior at scale Build evals, harnesses, and guardrails that turn agent... 
    Senior
    Full time
    Work at office
    Remote work

    Watershed

    San Francisco, CA
    1 day ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform...  ...Flow is seeking full stack senior software engineers to build AI-powered...  ...effectively. You will work on agentic systems engineer and agentic...  ...data pipelines, evaluation harnesses, prompt and model management... 
    Senior
    Full time
    Flexible hours

    Flow Engineering

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Quality Engineer, Agentic Harness. Be the first to apply!