Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Quality Engineer, Agentic Harness

$113.4k - $221.75k

Adobe Systems

The OpportunityAdobe is reimagining the future of creativity, where generative AI and human imagination work together. As a Quality Engineer on the Agentic Harness team, you’ll help the harness behave the way creators expect. You’ll verify that the agent’s behavior, tool use, and outputs meet Adobe’s quality and reliability bar before they ship. You’ll work closely with engineers and data scientists to catch regressions early and harden test coverage. You’ll help the team ship quickly without breaking what already works.You’ll bring a quality perspective to a fast-moving, agent-based system. You’ll write and maintain automated test suites and design test plans for new agent capabilities. You’ll dig into failures to find root cause. This is a hands-on role where you’ll grow your skills evaluating LLM-based and agentic systems. You’ll join a team building quality practices for this space from the ground up.What you’ll doDesign, write, and maintain automated test suites and test plans covering the agentic harness’s behavior, tool use, and outputs.Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.What you’ll need to succeedBachelor’s degree in Computer Science or a related field, or equivalent experience.Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.Hands-on experience writing automated tests and test frameworks. Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.Comfort digging into bugs and failures across a stack to identify root cause, not just report symptoms.Familiarity with testing LLM-based or agentic systems and how their behavior differs from traditional software.Comfort operating in a fast-moving, ambiguous environment where the technology and user expectations are evolving quickly.About AdobeAdobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours. Let’s Adobe togetherAt Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email View email address on click.appcast.io Use Guidelines for Interviews:Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.Expected Pay Range:Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $113,400 -- $221,750 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $153,200 - $221,750 In New York, the pay range for this position is $153,200 - $221,750 In Washington, the pay range for this position is $142,500 - $206,275 At Adobe, for sales roles starting salaries are expressed as total target compensation (TTC = base + commission), and short-term incentives are in the form of sales commission plans. Non-sales roles starting salaries are expressed as base salary and short-term incentives are in the form of the Annual Incentive Plan (AIP).In addition, certain roles may be eligible for long-term incentives in the form of a new hire equity award.State-Specific Notices:California:Fair Chance OrdinancesAdobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.Colorado:Application Window NoticeIf this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.Massachusetts:Massachusetts Legal NoticeIt is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.SummaryLocation: San Francisco; San Jose; Seattle; Lehi; New YorkType: Full time

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Quality Engineer, Agentic Harness in New York, NY vacancy
  • $250k

     ...predictions on real-world events, and quality is not optional. This role...  ...by improving our AI testing harness and extending automated...  ...communicate quality status clearly to engineers, product managers, and...  ...manual verification, using agentic tools to do the tedious work... 
    Senior
    Temporary work
    Shift work

    Polymarket

    New York, NY
    11 hours ago
  • $220k - $290k

     ...of transforming product quality and customer...  ...medtech manufacturers to harness the power of quality and...  ...looking for an experienced Software Engineer to help architect and scale the agentic systems at the core of...  ...Axion platform. This is a senior individual contributor... 
    Senior
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    3 days ago
  • $195k - $255k

     ...is the innovation and engineering hub behind Epiq’s next...  ...OpportunityYou will build the agentic systems at the center...  ...used to measure quality. You will own systems...  ...datasets, regression harnesses, and offline and online...  ...Qualifications5+ years of software-engineering experience... 
    Senior
    Full time
    Work at office
    Local area
    3 days per week

    Epiq Systems

    New York, NY
    2 days ago
  • $115.2k - $214k

     ...group whose goal is to harness the transformative...  ...Drug Discovery, the Software Engineering team builds and operates...  ...to help build our agentic platform for molecule...  ...will develop production-quality software, integrate...  ...experience and for the Senior Software Engineer... 
    Senior
    Full time
    Local area
    Worldwide
    Relocation package
    3 days per week

    Genentech

    New York, NY
    3 days ago
  • $215k - $275k

     ...modern technology and software products with clients...  ...blend design, product engineering, analytics, automation...  ...learning, generative AI, agentic workflows, modern data...  ...detection, quality scoring, latency/cost...  ...leadership.* Develop senior practitioners and practice... 
    Senior
    Temporary work
    Local area

    Slalom

    New York, NY
    2 days ago
  •  ...game-changing, high-quality solutions.As a Senior Lead Architect at JPMorganChase...  ...for various software applications and...  ...prototype, and scale agentic AI solutions across...  ...within the central Engineering and Architecture function...  ..., and evaluation harnesses that help engineering... 
    Senior
    For contractors

    JP Morgan Chase

    New York, NY
    3 days ago
  •  ...FanDuel Group seeks a senior director-level Product Management leader to own one or more agentic AI surfaces end-to-end, partnering with product managers and designers in tech and commercial. You will mentor AI PMs, codify patterns for PM practice, and shape the discipline... 
    Senior

    Jobleads-US

    New York, NY
    1 day ago
  •  ...complex enterprise data landscapes. You'll develop the models and agentic architectures that power demand forecasting, consumer...  ...and maintain robust ML pipelines: data preprocessing, feature engineering, model training, evaluation, and production deployment Architect... 
    Senior
    Full time
    Immediate start

    Decircle

    New York, NY
    11 hours ago
  •  ...Jobtailor seeks a senior architect to own the system design for agentic capabilities, including orchestration, context and state, tool boundaries, and reliability patterns for non-deterministic systems. You will prototype to validate architectural decisions before teams... 
    Senior

    Jobleads-US

    New York, NY
    1 day ago
  • $102.75k - $195.25k

     ...infrastructure behind an agentic software development lifecycle...  ...bases that other engineering teams will depend on...  ...Work you'll do As a Senior Consultant, Agentic Engineering...  ..., evaluation harnesses, and guardrails that...  ...and delivering high-quality work with minimal direction... 
    Senior
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Deloitte

    New York, NY
    3 days ago
  • Stoke Space is seeking a Mechanical Engineer to develop packaging for flight avionics, analyze harness routing, and lead hardware integration for a rapidly reusable launch vehicle. You will collaborate with avionics, structures, and production teams to implement design... 
    Senior

    Stoke Space

    New York, NY
    1 day ago
  •  ...collaborative environment.  We are seeking an experienced Software Quality Engineer to help drive quality across a growing SaaS platform....  ...to ensure software quality throughout the SDLC. This is a senior individual contributor role for someone who enjoys building... 
    Senior
    Full time
    Remote work

    TeamBuilder

    New York, NY
    more than 2 months ago
  •  ...what's possible together. As a Senior Director of Software Engineering at JPMorganChase within Connected Commerce...  ...multi-department strategy for agentic AI-enabled engineering and SDLC/TLM...  ...(human-in-the-loop decisioning, quality gates), measurement frameworks, and... 
    Senior

    JPMorgan Chase & Co.

    New York, NY
    1 day ago
  •  ...JPMorgan Chase & Co. is seeking a Senior Lead Architect within Corporate...  ...platforms. You will drive agentic AI capabilities, work with cloud...  ...environments, and collaborate with engineers, security, and product teams to deliver high-quality solutions. You will influence... 
    Senior

    Jobleads-US

    New York, NY
    2 days ago
  • $156.5k - $230k

     ...defining and leading the engineering approach for...  ...the design, quality, and reuse of the...  ...of use cases that harness the power of Generative...  ...are looking for a Senior Principal Engineer...  ..., hands-on senior software developer, and a key...  ..., and tools for agentic solutions.Extensive... 
    Senior
    Full time
    Work at office
    Flexible hours
    Day shift

    Bank of America

    New York, NY
    1 day ago
  •  ...Developer Platform, an AI-powered Marketing Operating System. We seek a Senior Product Designer to architect the Agentic and Vertical Apps framework, bridge design and engineering, and set standards for quality, speed, and innovation. You will collaborate with design system... 
    Senior

    United States Digital Space LLC

    New York, NY
    4 days ago
  • $171k - $180k

     ...Technologyservice offering, specializing in Agentic AI within banking and capital markets,...  ...enterprise Large Language Models, LLM harnesses, open-source foundational models, and specialized...  ...of enterprise LLM selection, prompt engineering, fine-tuning approaches, and integration... 
    Senior
    Work at office
    Immediate start
    Worldwide
    3 days per week

    Sia

    New York, NY
    3 days ago
  • $123k - $215.25k

     ...dine, and experience the brand.We are seeking a Senior Product Manager to drive the development and delivery of Agentic Commerce capabilities for our Card Members....  ...new interaction models. Partnering closely with Engineering, Product, and cross-functional teams, this... 
    Senior

    American Express

    New York, NY
    4 days ago
  •  ...Associate Vice President, Senior Product Manager, Agentic Workflows About the Company Premier commercial real estate finance company Industry...  ...technologies, including large language models, prompt engineering, and agentic workflows, as well as the ability to... 
    Senior

    Confidential

    New York, NY
    2 days ago
  •  ...New YorkHybridFull Time$160k - $180kJob title: Senior Technical Platform Product Manager - Payments Infrastructure & Agentic AILocation: New York, NY (Hybrid)Our client...  ...commercial interactions. Working daily with platform engineers, solutions architects, risk partners, and... 
    Senior
    Work at office
    Remote work

    Motion Recruitment

    New York, NY
    3 days ago
  •  ...financial services company is looking for a Senior Product Manager to help define the future of...  ..., features, and services that enable secure agentic transactions across multiple channels. You'll work closely with Engineering, Product, Fraud, Network, Legal, Compliance,... 
    Senior
    Full time

    Motion Recruitment

    New York, NY
    2 days ago
  •  ...Title: Senior Agentic AI Engineer Location: NY or Alpharetta, GA with 3 days work from client office. Duration: 12+ months (Long term)...  ...Strong hands-on experience in developing large scale complex software solutions using Object Oriented Programming languages and... 
    Senior
    Work at office

    Wise Skulls

    New York, NY
    1 day ago
  • New YorkLab49 - Software Engineering /Full-time /HybridLab49 is a specialist strategy, design, and technology consulting company dedicated...  ...of technology projects.Lab49 is now looking for a Senior Agentic Developer, an engineer who doesn’t just use AI tools but writes... 
    Senior
    Full time
    Work at office

    ION Group

    New York, NY
    1 day ago
  • $90k - $110k

    Position: Senior Quality Assurance Engineer Location: Melville, NY Company/Industry: Well-established precision manufacturer Schedule: Mon-Fri On-...  ...or Defense).Fluent in GD&T per ASME Y14.5, statistical software (Minitab), and 8D/CAPA methodologies.Compensation / Pay... 
    Senior
    Flexible hours

    PrideStaff

    New York, NY
    1 day ago
  • $122k - $200k

     ...defining and leading the engineering approach for complex...  ...conducting multiple software implementations, and applying...  ...:We’re seeking a Senior Engineer to lead the...  ...and implementation of Agentic AI across the SDLC. You...  ...repositories, CI/CD pipelines, quality and security gates,... 
    Senior
    Full time
    Work at office
    Shift work
    Day shift

    Bank of America

    New York, NY
    2 days ago
  • $129k - $152k

     ...rewards. We’re hiring a Product Designer for Agentic Trading, a fast-moving team building the...  ...works across product design, creative, engineering, and research to make powerful AI-driven...  ...into iterationsEnsure designs meet quality standards, align with regulatory requirements... 
    Senior
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood Financial

    New York, NY
    11 hours ago
  • $220k - $240k

     ...Product Manager to own the agentic and platform...  ...Conduct platform. This is a senior individual-contributor...  ...across product and engineering.The mandate has two connected...  ...what it means to ship software where wrong answers...  ...because of the quality of your work, not your... 
    Senior
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Smarsh

    New York, NY
    1 day ago
  • $147k - $202k

     ...authentication for the GenAI era. We’re looking for a Senior Software Engineer to join the AI Agentic Experience team at Auth0. This role is pivotal in...  ...broader AI + identity ecosystemWrite and Maintain High-Quality Documentation including API references, quickstarts,... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    2 days ago
  •  ...guidance and subject matter expertise to engineers on testing and Quality Assurance (QA) methodologies and...  ...into the design and development of software and IT processes• Involved in the review...  ...TechnologyExperience level: Mid-Senior LevelIndustry: Computer Software
    Senior
    Work experience placement

    EROS Technologies

    New York, NY
    1 day ago
  •  ...flexible, open data and software solutions for over 200...  ...a transformation to agentic software development....  ...not an add-on to the engineering workflow but the primary...  ...transformation end-to-end. The Senior Director of Agentic...  ...delivery velocity and quality. Reports to: Chief... 
    Senior
    Worldwide
    Flexible hours

    10000 FactSet Research Systems Inc.

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Quality Engineer, Agentic Harness. Be the first to apply!