Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Quality Engineer, Agentic Harness

$113.4k - $221.75k

Adobe Systems

The OpportunityAdobe is reimagining the future of creativity, where generative AI and human imagination work together. As a Quality Engineer on the Agentic Harness team, you’ll help the harness behave the way creators expect. You’ll verify that the agent’s behavior, tool use, and outputs meet Adobe’s quality and reliability bar before they ship. You’ll work closely with engineers and data scientists to catch regressions early and harden test coverage. You’ll help the team ship quickly without breaking what already works.You’ll bring a quality perspective to a fast-moving, agent-based system. You’ll write and maintain automated test suites and design test plans for new agent capabilities. You’ll dig into failures to find root cause. This is a hands-on role where you’ll grow your skills evaluating LLM-based and agentic systems. You’ll join a team building quality practices for this space from the ground up.What you’ll doDesign, write, and maintain automated test suites and test plans covering the agentic harness’s behavior, tool use, and outputs.Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.What you’ll need to succeedBachelor’s degree in Computer Science or a related field, or equivalent experience.Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.Hands-on experience writing automated tests and test frameworks. Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.Comfort digging into bugs and failures across a stack to identify root cause, not just report symptoms.Familiarity with testing LLM-based or agentic systems and how their behavior differs from traditional software.Comfort operating in a fast-moving, ambiguous environment where the technology and user expectations are evolving quickly.About AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let’s Adobe togetherAt Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email View email address on click.appcast.io Use Guidelines for Interviews:Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.Expected Pay Range:Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $113,400 - $221,750 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $153,200 - $221,750 In New York, the pay range for this position is $153,200 - $221,750 In Washington, the pay range for this position is $142,500 - $206,275 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.State-Specific Notices:California:Fair Chance OrdinancesAdobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.Colorado:Application Window NoticeIf this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.Massachusetts:Massachusetts Legal NoticeIt is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.SummaryLocation: San Francisco; San Jose; Seattle; Lehi; New YorkType: Full time

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Quality Engineer, Agentic Harness in San Jose, CA vacancy
  • $260.36k - $358k

     ...ADI combines analog, digital, AI, and software technologies into solutions that...  ...About the Role We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build multimodal...  ..., LangGraph) and dynamic multi-agent harnesses for complex reasoning workflows... 
    Senior
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    3 days ago
  •  ...embraced for the unique qualities you bring. Our...  ...The PositionAs a Senior Data Scientist -...  ...cutting-edge agentic capabilities and...  ...Production-Grade Engineering: Write clean, tested...  ...evaluation harnesses, prompt/version management...  ...evaluation.Solid software engineering... 
    Senior
    Full time
    Relocation package

    Roche

    San Jose, CA
    2 days ago
  • $184k - $287.5k

     ...are looking for a Senior Solutions Architect...  ...production-grade Agentic AI systems on NVIDIA...  ...with strategic software companies to translate...  ...of partner engineering, NVIDIA’s AI platform...  ...tradeoffs across model quality, latency,...  ...analysis.Work with agent harnesses and execution... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

    We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring software engineers...  ...these capabilities to support agentic inference workloads, including long-...  ...LLM serving stacks with agent harnesses such as OpenCode, Codex, Claude Code... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $184k - $287.5k

    We are looking for a Senior Solutions Architect to...  ...build, and deploy secure agentic AI systems on NVIDIA’s...  ...with strategic software companies across cybersecurity...  ...Science, Electrical Engineering, AI/ML, or equivalent...  ...with OpenShell, agent harnesses, sandboxed execution,... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $132k - $207k

    NVIDIA is seeking a highly skilled QA Engineer to join our Workstation and Virtualization...  ...will collaborate closely with customers, software engineers, and program managers to...  ...resolutions, ensuring flawless product quality. Our ideal candidate will possess deep expertise... 
    Senior
    Full time
    Remote work
    Flexible hours

    Nvidia

    Santa Clara, CA
    4 days ago
  • $140.25k - $210.38k

    Introduction to the jobSenior Software Quality Assurance Engineer will play a critical role in ensuring the quality, reliability, performance, and maintainability of software solutions that drive customer satisfaction. We are looking for an experienced QA professional and... 
    Senior
    Full time
    Work experience placement
    Work at office
    3 days per week

    ASML Holding

    San Jose, CA
    4 days ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote...  ...intelligent software and smart user...  ...exceptional, data-driven Senior Engineering Manager, Agentic & GenAI...  ...testing and evaluation harnesses (unit evals, integration...  ...) to measure agent quality and eliminate regressions... 
    Senior
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    4 days ago
  • $178k - $321k

     ...-agent platform (Hive Mind), agentic workflows, data pipelines, and...  ..., the agent runtime, and the harness: a resilient cloud platform,...  ...implement it. This is a two-person engineering team: you deploy, debug, and...  ...-cycle workflows. Working software wins arguments; migrate by... 
    Senior

    OKX

    San Jose, CA
    11 hours ago
  • $141.11k - $150k

    Senior Software Quality Engineer Ab Ovo, Inc. is hiring a Senior Software Quality Engineer, responsible for the following duties: Writing and maintaining automated test scripts using Java and JavaScript languages; Working on web and mobile application automation testing... 
    Senior

    Ab Ovo

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...outstanding AI systems to transform GPU software development. Our team leads the effort in crafting agentic AI systems that improve the quality and efficiency of GPU software. This is...  ...funnelWork closely with GPU SW kernel engineers to pinpoint high-impact automation opportunities... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    11 hours ago
  •  ...design, development, and deployment of advanced AI agents and agentic systems. Architect and implement complex multi-agent systems, including...  .... Collaborate with product managers, UX designers, and other engineers to define requirements and deliver impactful solutions.... 
    Senior
    Full time
    Work experience placement

    Eightfold

    Santa Clara, CA
    more than 2 months ago
  •  ...We are seeking a highly motivated Senior Technical Lead Dev to design develop and lead the delivery of next generation Agentic AI solutions for enterprise ERP and Supply...  ...environments This role combines hands-on engineering technical leadership and business process... 
    Senior

    Cloudious LLC

    San Jose, CA
    1 day ago
  • $124.5k - $272k

     ...One platform, its Zero Trust Engine, and the powerful NewEdge network...  ....Positions are available at Senior Staff and above. Candidates...  ...layer that makes AI in agentic workflows fast, efficient, and...  ...for bounded tasks; build eval harnesses that gate a capability to release... 
    Senior

    Netskope

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...s best talent.As a Developer Technology Engineer you will be at the forefront of innovation...  ...RTX & DGX SoC performance for agentic use. This role offers an outstanding opportunity...  ...effective solutions.Work across system software, GPU driver, architecture, and NVIDIA Research... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...managed insights layer. This layer delivers clear recommendations directly to IT leadership and the CIO.We’re looking for a Senior Agentic Insights Engineer to be the hands-on technical builder behind this transformation. In this role, you’ll develop and operate the agentic... 
    Senior
    Full time
    For contractors
    Shift work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    Join NVIDIA's Isaac Applications Engineering team and help build the platform for Physical AI...  ...that runs through all of it: is our software ready to be used by agents? That means the...  ...Run and integrate skill evaluations so agentic workflows are measured, not just deployed... 
    Senior
    Full time
    Live in
    Night shift

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    We are looking for outstanding Senior High Performance AI Engineers to build the next generation of agentic AI systems for the CUDA ecosystem. Our team works across the...  ...will collaborate closely with internal NVIDIA software, model, and hardware teams to bring new capabilities... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...on the world.As a Developer Technology Engineer, you will be at the forefront of innovation...  ...-source projects to enable professional agentic AI workflows at the edge powered by...  ...feature and performance enhancements of OSS software, including but not limited to projects... 
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $143k - $191k

     ...About the Role Eightfold is building the next generation of Agentic AI products that help millions of people and enterprises make better talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user-facing product features across... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Eightfold

    Santa Clara, CA
    a month ago
  • $140k - $224.25k

     ...development, gaming technology, and improving software quality through thoughtful testing? If so, we...  ...a creative, hands-on automation engineer with strong Python development skills,...  ...stand out from the crowd:Experience with agentic AI development, including how agents are... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...looking for an outstanding Senior Compiler Engineer to help build the next generation...  ...intersection of compilers, agentic systems, numerical...  ...code transformations across software and hardware boundaries.In...  ...continuously improve compiler quality, numerical correctness, robustness... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $168k - $264.5k

    NVIDIA is seeking ASIC Design Engineers with experience in agentic AI to help design and implement the world's leading SoC's and GPU's. As part of NVIDIA...  ...knowledge of data structures, algorithms, and software engineering principles.Experience with fine-tuning large... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    11 hours ago
  • $174.72k - $295.68k

     ..., and smart connectivity.You will be a senior engineer on the team building our internal AI engineering...  ...power how our engineers build and ship software. A core mission is connecting agents to...  ...against operational systems. The agentic layer (NL intake, agentic trouble-... 
    Senior
    Full time

    XPENG Motors

    Santa Clara, CA
    1 day ago
  • $153.75k - $225k

     ...countries and 30+ languages. Today, Eightfold is at the forefront of agentic AI, delivering intelligent agents that actively drive outcomes...  ...that values ownership, collaboration, and high standards. Our engineers, product leaders, and go-to-market teams work closely together—... 
    Senior
    Work experience placement
    Work at office
    3 days per week

    Eightfold

    Santa Clara, CA
    3 days ago
  • $229.9k - $262.4k

    {"description": "Senior Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) Overview:...  ...develop, test, deploy, and support AI software components including foundation...  ...to build systems, take pride in the quality of your work, and also share our passion... 
    Senior
    Full time
    Part time
    Local area

    Capital One Financial Corporation

    San Jose, CA
    more than 2 months ago
  • $123.24k - $200k

     ...Senior / Principal AI Engineer for Business Intelligence As a Sr./Principal AI...  ...concepts, create evaluation harnesses to measure accuracy, latency...  ...experience in software engineering, machine learning...  ...including RAG, fine-tuning, agentic frameworks, prompt engineering... 
    Senior
    Work at office

    TSMC

    San Jose, CA
    2 days ago
  • $248k - $391k

     ...lead a high-performance engineering organization that...  ...operates production-grade software systems at global...  ...You'll Be Doing:As a Senior Engineering Manager, you...  ...include:Architect and ship agentic AI systems using LLM-...  ...and review production-quality code, not just scripts... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...Axiado, developing breakthrough technology takes more than great engineering—it takes a team of exceptional people who collaborate boldly,...  ...TCU (Trusted Control/Compute Unit) solutions. We are hiring a Senior QA Engineer - Performance & Reliability to lead the... 
    Senior

    Axiado Corporation

    San Jose, CA
    3 days ago
  •  ...to build and run AI. As an Agentic Data Engineer, you will build the data and...  ...production standards for quality, provenance, and security.THE...  ...pipelines, behavioral test harnesses, and production quality...  ...behaviorPREFERRED EXPERIENCE:5+ years of software engineering with... 
    Senior
    Flexible hours

    AMD

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Quality Engineer, Agentic Harness. Be the first to apply!