Principal Test Automation Engineer
Full-time
d-Matrix
Responsibilities
- Set technical direction for AI-enabled workflow automation across build, CI, testing, and release.
- Build agent harnesses and integrations with GitLab, Jira, test results, logs, and observability data.
- Develop evaluation methods to measure automation effectiveness while preserving correctness.
- Define guardrails, autonomy standards, human review points, and auditability requirements for AI systems.
- Deliver quality engineering automations for failure attribution, failure clustering, defect deduplication, coverage-gap analysis, and release-readiness summaries.
- Establish shared engineering patterns, participate in design reviews, mentor engineers, and set technical direction across teams without direct authority.
Requirements
- Extensive production software engineering experience with strong Python skills.
- Enough Rust and/or C++ experience to understand build flows and diagnose compiler errors.
- Experience shipping production AI-enabled tools or automation used by others beyond demonstrations.
- Deep hands-on experience with LLM APIs, agent harnesses, tool integration, and context engineering.
- Experience designing evaluations for nondeterministic systems and measuring their impact without reducing correctness.
- Strong fluency across CI/CD, testing, and release processes, with sound judgment about when AI is appropriate.
- A track record of setting technical direction across teams that do not report to you.
- Preferred: exposure to compilers, firmware, or hardware-in-the-loop test environments.
- Preferred: experience with MCP or similar protocols, GitLab, Jira, or Prometheus APIs, and cost and latency management for LLM-based systems.
- Preferred: daily use of Claude Code, Cursor, or Copilot.
Benefits
- Location: Santa Clara, California or remote within the United States.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Principal Test Automation Engineer in Santa Clara, CA vacancy
$195k - $285k
...playground? Together, we can help shape the endless possibilities of AI. Principal Test Automation EngineerLocation: Santa Clara, Ca / Remote, USRole Overviewd-Matrix is hiring a Principal Software Engineer to define and build how we use AI-enabled automation across the...PrincipalRemote workd-Matrix
Santa Clara, CA1 day ago- Job DescriptionAdvantest is seeking a Senior Principal AI Test Automation Engineer todesign and deliver reliable automation for complex engineering and productiontest environments.This role combines advanced test engineering, software automation, CI/CD, andAI-enabled workflows...Principal
Advantest
San Jose, CA4 days ago $187k - $377.5k
...Senior Principal, Solution Test & Automation Engineer This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office. Who We Are: Hewlett Packard Enterprise is the global edge-to-cloud company advancing the...PrincipalWork experience placementWork at office2 days per weekHewlett Packard Enterprise
Sunnyvale, CA4 days ago$115.1k - $189.2k
...researchers to further treat and prevent disease worldwide.Pay Range:$115,100.00 - $189,200.00POSITION SUMMARYThe Senior Test Automation Engineer designs, develops, and maintains scalable automated test solutions for instrument software, data pipelines, analytics platforms...SuggestedFull timeTemporary workInternshipWorldwideFlexible hoursBio-Techne
San Jose, CA3 days ago- ...26-21299Salary$67.96 / hour Client’s Mac Hardware Validation Engineering (HVE) Infrastructure team is looking for a talented and motivated engineer to help us help design, develop and deploy automated testing infrastructure. Client’s Mac HVE team is responsible for validating...Suggested
Mindlance
Sunnyvale, CA3 days ago $150.4k - $277.6k
...Quality & Test Automation Engineer – Developer Experience Cupertino, California, United States Software and Services The Xcode team provides the tools to develop software for Apple's innovative iOS, macOS, watchOS, tvOS, and visionOS platforms. Because tools are...RelocationApple Inc.
Cupertino, CA4 days ago$130k - $250k
...humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial... ...require 5 days/week in-office collaboration. We are seeking a Test Automation Engineer to design, build, and maintain automated testing...Full timeWork at officeFigure
San Jose, CA4 days ago- We’re looking for a Hardware Test Automation Engineer who thrives in a hands-on lab environment — someone who feels most at home working with hardware, instruments, and real systems under test. The employee will work on validating all customer facing PCBs at a system level...Work from home
Achronix Semiconductor Corporation
Santa Clara, CA5 days ago $148.5k - $204k
...Opportunity:Sonatus is looking for an experienced Staff System Test Engineer with deep expertise in AI testing to lead quality efforts... ...validating AI model testing, deployment, monitoring, and test automation within innovative automotive and cloud environments. This is...Work at officeWorldwideFlexible hoursShift work3 days per weekSonatus
Sunnyvale, CA3 days ago- ...ITIL certification), ISO 27001:2005 Information Security Management System (ISMS), and CMMI-DEV Level 3"Job DescriptionDatacom test automation networking engineerSan Jose, CA6 Months (extendable.) Interview Mode : Job Description7-10 years experience in Networking, Datacom...
Comtech
San Jose, CA2 days ago - ...-15Deadline: 0001-01-01Our client, a leading organization in the technology and networking industry, is seeking a Network Test Automation Engineer to join their team. As a Network Test Automation Engineer, you will be part of the engineering department supporting network...Temporary workFlexible hours
Experis
San Jose, CA3 days ago $126.1k - $227k
...partner for the world's top brands, offering comprehensive engineering, supply chain, and manufacturing solutions. With 60 years of... ...and diverse communities around the globe.JOB SUMMARYThe Principal Automation Engineer (JDAS) is responsible for supporting production/manufacturing...PrincipalContract workTemporary workWork at officeLocal areaWorldwideJabil Circuit
San Jose, CA3 days ago$149.6k - $245.16k
...technologies built on Intel's silicon photonics platform. We are seeking a highly motivated Silicon Photonics Wafer Test Automation Development Engineer to support the development, implementation, and optimization of wafer-level testing solutions for integrated photonic...Full timeInternshipLocal areaImmediate startRemote workShift workIntel
Santa Clara, CA5 days ago- ...Photonics Test Automation Engineer - Python - Silicon Photonics - Santa Clara You can get further details about the nature of this opening, and what is expected from applicants, by reading the below. Lumicity is partnered with a growing, well-funded startup that...Immediate start
Lumicity
Santa Clara, CA1 hour ago $136.88k - $205k
...Your ImpactMarvell is seeking a highly motivated and talented Principal Test Engineer to join our dynamic NPI product engineering team. You will... ..., real-time answer generators like ChatGPT or Copilot, or automated note-taking bots) during interviews.These tools must not be...PrincipalPermanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA5 days ago- Apple Inc. in Cupertino, California is seeking a Quality & Test Automation Engineer - Developer Experience to design, maintain, and extend automated tests and tooling for Xcode and Instruments. You will work with a Xcode feature team to improve coverage across OS, compiler...
$150k - $190k
...Principal Test Engineer Principal Test Engineer San Jose, CA | Hybrid (3 days onsite / 2 remote) Base Salary: $150,000–$190,000 (DOE) A leading chip and silicon IP innovator is seeking a Principal Test Engineer to join its Operations organization. This is a highly visible...PrincipalRemote workTalentry LLC
San Jose, CA2 days ago$176k - $298k
...and advance faster than ever.As a Staff/Principal Design Engineer in the NVE Design Engineering... ...NAND circuit development through design automation, agentic circuit-design enablement, and... ...team members** (Product Engineering, Test, Probe, Process Integration, Assembly,...PrincipalFull timeLocal areaImmediate startMicron
San Jose, CA1 day ago$148.32k - $203.94k
...Principal Test EngineerSiTime is the Precision Timing company. Timing is the heartbeat of all... ...including high-growth ones in AI datacenters, automated driving, industrial and humanoid robots... ...the timing industry.The Principal Test Engineer is responsible for the development of...PrincipalSiTime
Santa Clara, CA7 hours ago$80k - $160k
...our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest... ...visit us at DescriptionWe are seeking a highly skilled SDET/Test Automation Engineer with strong hands-on experience in Python, Swift, and...Minimum wageLocal areaWipro
Cupertino, CA1 day ago- Apple is seeking a NAND QA Test Engineer in Cupertino, CA. You will join a world-class HW/SW team to test and qualify solid-state storage programs, focusing on NAND reliability testing and validation. Responsibilities include building QA systems, running stress tests, and...
$184.7k - $277.6k
...tools and systems that drive efficiency across every stage of the pipeline — from commit to customer. As an AI Quality & Test Automation Engineer, you'll be at the forefront of applying AI to proactively hunt edge cases, surface anomalies, and raise the quality bar for...WorldwideRelocationApple Inc.
Cupertino, CA1 day ago$176k - $298k
## Principal Design Automation EngineerSan Jose, California, United States of AmericaApply NowFind out how... ...than ever.As a Staff/Principal Design Engineer in the NVE Design Engineering... ...team members\*\* (Product Engineering, Test, Probe, Process Integration, Assembly,...PrincipalFull timeLocal areaImmediate startMicron Technology, Inc
San Jose, CA1 day ago- Everpure is seeking a Manufacturing Test Development Software Engineer to lead end-to-end test architecture for next-generation server/storage systems. You will drive hardware-focused software automation, collaborate with Design Engineering, Operations, and Quality, and...Contract work
- Zscaler is seeking a Principal System and Solution Test Engineer for a hybrid role in Santa Clara, CA. You will drive quality strategy for Zero Trust... ...testing, Python expertise, and experience building test automation using Terraform or CloudFormation, plus deep L2-L7...Principal
$150.68k - $225.7k
...Team, Your ImpactAs a Hardware Design Principal Engineer with Marvell, you’ll be a member of the... ...part of this.What You Can ExpectDrive Test Hardware NPI process from development /... ...knowledge of probe technologyExperience in automated IC test equipment's (Automatic Test...PrincipalPermanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA1 day ago- Apple Inc. is seeking a firmware QA engineer to join the iOS Device QE team in Sunnyvale, CA. You will test firmware for next-generation human interface devices, collaborating... ...a track record using Python to build tests and automate validation of embedded systems. Strong...
- HP Enterprise's HPE Networking team seeks a Principal Solution Test & Automation Engineer to drive quality across large-scale networking and distributed software solutions. This role combines deep testing expertise with system-level engineering and mentorship for teams...
$185.39k - $277.7k
...lead. Your Team, Your ImpactMarvell is expanding its global Test Solutions Engineering (TSE) organization and seeking an experienced Senior... ..., real-time answer generators like ChatGPT or Copilot, or automated note-taking bots) during interviews.These tools must not be...PrincipalPermanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA2 days ago$136.88k - $205k
...to thrive, learn, and lead. Your Team, Your ImpactAs a test development principal engineer in the Operations business group, you will test features... ...real-time answer generators like ChatGPT or Copilot, or automated note-taking bots) during interviews.These tools must not...PrincipalPermanent employmentFull timeInternshipWork from homeMarvell
Santa Clara, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Test Automation Engineer. Be the first to apply!
Related searches
- principal test engineer Santa Clara, CA
- engineering director Santa Clara, CA
- hotel chief engineer Santa Clara, CA
- director systems engineering Santa Clara, CA
- technical director engineering Santa Clara, CA
- chief design engineer Santa Clara, CA
- principal network engineer Santa Clara, CA
- senior civil engineer project manager Santa Clara, CA
- principal data engineer Santa Clara, CA
- principal engineer Santa Clara, CA