Staff Engineer, Test Automation (R5792)
$157.2k - $235.8kShield
Job Description
Job Description
Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
Job Description:Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
The Hivemind Software Engineering Integration and Test team is seeking a Staff Automated Test Engineer to provide technical leadership for automated verification across our next-generation autonomy platform. You will define and evolve test architecture, validation infrastructure, MLOps quality systems, and CI/CD pipelines that enable the Hivemind software ecosystem to create, test, and deploy resilient autonomy capabilities for unmanned aircraft and robotic platforms operating in complex, contested, and GPS-denied environments.
You will work across production flight code, machine learning models, simulation and synthetic environments, mission planning and orchestration systems, operator-facing Ground Control Station applications, telemetry and data pipelines, cloud-native developer infrastructure, and hardware-in-the-loop systems.
In this hands-on Staff role, you will lead complex, cross-functional initiatives, establish automation and verification standards, identify systemic quality risks, and develop scalable test infrastructure. The ideal candidate combines deep Python automation and distributed-systems testing experience with technical leadership and experience validating machine learning systems throughout the data, training, evaluation, deployment, and monitoring lifecycle.
What you'll do:
Own the technical strategy, architecture, and roadmap for automated testing, verification, and MLOps quality across the Hivemind ecosystem.
Design and maintain scalable test frameworks for autonomy software, backend services, APIs, operator-facing applications, and distributed hardware environments.
Lead functional, integration, regression, system, performance, reliability, and end-to-end testing across simulation, edge-compute, software-in-the-loop, and hardware-in-the-loop environments.
Build automated ML validation pipelines covering data quality, training reproducibility, model accuracy, robustness, regression, latency, resource utilization, and system integration.
Establish CI/CD and continuous training workflows that provide versioning and traceability for datasets, models, configurations, evaluation results, and deployment artifacts.
Develop scenario-based validation for autonomy models, including edge cases, degraded sensing or communications, distribution shifts, and representative mission conditions.
Create observability, analytics, and failure-triage capabilities for software behavior, model and data drift, inference health, test results, and production performance.
Build Python automation that improves test execution, parallelization, reporting, environment setup, experiment comparison, and developer productivity.
Create test harnesses, simulators, stubs, mocks, and synthetic data capabilities that improve system testability and coverage.
Collaborate with software, autonomy, machine learning, data, simulation, and systems engineers to define verification strategies and improve designs before implementation.
Develop and govern AI-assisted engineering workflows using coding agents and LLM-based tools for test generation, log analysis, debugging, and failure triage while maintaining security, reproducibility, and traceability.
Required qualifications:
Typically 8+ years of relevant experience in software engineering, test infrastructure, developer tooling, MLOps, systems integration, or systems verification, or an equivalent combination of experience and demonstrated impact.
5+ years of experience building scalable automation frameworks or developer tooling in Python.
Demonstrated success designing test, CI/CD, or MLOps infrastructure used across multiple engineering teams.
Experience validating machine learning systems across the data, training, evaluation, packaging, deployment, and monitoring lifecycle.
Understanding of ML quality risks such as data leakage, training-serving skew, nondeterminism, distribution shift, drift, model regression, and statistical acceptance criteria.
Experience defining model-performance baselines, automated evaluation suites, release thresholds, and candidate-to-production comparison workflows.
Experience testing GPU-accelerated infrastructure and workloads, including GPU scheduling, allocation, utilization, and resource contention in Kubernetes environments.
Experience with performance benchmarking, profiling, and observability for GPU workloads, including identifying compute, memory, storage, networking, and data-loading bottlenecks.
Experience validating multi-tenant Kubernetes environments, including RBAC, resource quotas, workload isolation, and scheduling behavior.
Experience qualifying integrated hardware and software systems, including automated validation of compute, GPU, storage, networking, drivers, firmware, and deployed software configurations.
Strong system-design skills and experience testing distributed systems, backend services, APIs, and integrated hardware and software environments.
Experience developing integration and regression strategies for internally developed, third-party, open-source, and partner software, including dependency management, compatibility testing, and upgrades.
Strong understanding of asynchronous and concurrent Python programming for scalable automation and parallel test execution.
Experience with package and dependency management, reproducible environments, and build systems such as Conan, pip, setuptools, Poetry, Nix, or similar.
Experience with automated observability, log collection, analytics, reporting, and root-cause analysis in complex software, data, and infrastructure systems.
Experience working in Linux-based development environments.
Preferred qualifications:
Experience with model registries, experiment tracking, dataset or feature versioning, model serving, and automated artifact promotion using MLflow, Kubeflow, Weights & Biases, SageMaker, Vertex AI, or similar platforms.
Experience with GPU scheduling and orchestration platforms such as Run:ai, NVIDIA GPU Operator, KAI Scheduler, Kueue, Volcano, or similar technologies.
Experience with NVIDIA GPU infrastructure, including CUDA, drivers, container runtimes, Multi-Instance GPU, GPU fractionalization, and hardware/software compatibility testing.
Experience with GPU profiling and performance-analysis tools such as NVIDIA Nsight, PyTorch Profiler, or similar technologies.
Experience validating perception, planning, decision-making, reinforcement learning, or other autonomy models in simulation and on deployed systems.
Experience testing models on embedded or edge-compute platforms, including latency, memory, power, accelerator compatibility, quantization, and hardware-specific behavior.
Experience qualifying production servers or appliances, including hardware validation, burn-in, provisioning, firmware, networking, storage, and software-stack validation before deployment.
Experience with reliability, fault-injection, and recovery testing across distributed compute, storage, networking, and GPU infrastructure.
Experience validating reproducible installation, operation, upgrades, and rollback in cloud, on-premises, disconnected, or air-gapped environments.
Experience with containers, Kubernetes, cloud infrastructure, infrastructure as code, and reproducible test environments.
Proficiency with Go or TypeScript for automation tooling or UI test development.
Experience integrating Python with native C or C++ applications through bindings, wrappers, subprocess interfaces, or similar interoperability tooling.
Aerospace, robotics, autonomy, embedded systems, or safety-critical software experience.
Familiarity with software-in-the-loop, hardware-in-the-loop, requirements-based verification, configuration management, artifact traceability, or standards such as DO-178C and MIL-STD-882.
#LI-DS5
#LD
Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.
Compensation Range: $157.2K - $235.8K
- ...Instagram, and YouTube. Job Description: Shield AI's Software Test & Automation Team develops the verification, validation, and automation... ...) environments. As a Senior Software Test & Automation Engineer, you will design and develop automated test infrastructure,...SuggestedFull timeTemporary workPart timeWorldwide
- ...Senior Staff Engineer - Test Development & Characterization An industry-leading medical technology company based in San Diego county is hiring a Senior Staff Engineer to lead test development and characterization of new wearable health monitoring devices. This individual...SuggestedRelocation package
$90k - $130k
...Job Description Job Description Title: Thermal Test Python Automation Engineer Location: San Diego, CA (Day 1 onsite/5 days in office) Duration: Fulltime Salary Range: $90,000-$130,000 a year Job Description:- " 3 years of experience in QA and test automation...SuggestedFull timeWork at office$37 - $41 per hour
...Job Description Job Description Job Title: Manufacturing Test Engineer Job Description We are seeking a dedicated Manufacturing Test Engineer to perform hands-on functional testing of complex DUV laser systems. The role involves validating equipment and manufacturing...SuggestedContract workTemporary workDay shift$85k - $110k
...too much at stake to go solo. Our Operations Team is seeking a Manufacturing Test Engineer to develop, implement, and continuously improve manufacturing test processes and automated test systems for TrellisWare products. This role will bring test solutions from product...SuggestedContract workWork experience placementWork at officeLocal areaWorldwide- ...Job Description Description: On-site in either San Diego, CA or Dallas, TX Our client is seeking a Senior Software Test & Automation Engineer to develop verification, validation, and automation capabilities that enable rapid delivery of autonomy across...Hourly payLocal area
$184.7k - $324.8k
...Validation team builds the tooling and automation that keeps Apple Intelligence features high... ...of relevant industry experience in test automation, software development, or related... ...to ramp into it quickly.Strong software engineering fundamentals — able to define atomic,...Relocation- ...measurements and strong functional understanding and working knowledge of test equipment (i.e.- power supplies, oscilloscope, spectrum... ...-shooting functions. Solid understanding of RF principles, RF engineering tools and cellular radio building blocks Knowledge of...
$140k - $180k
...RF Test Engineer Logos Space is a Low Earth Orbit (LEO) satellite system purpose-built to serve the connectivity needs of the commercial... ...problems. Responsibilities Select, procure, deploy, automate, and validate production and hardware-in-the-loop testbed RF...Contract workInternshipWork at officeLocal areaWorldwide$90k - $125k
...systems. About this role: We are seeking an Integration Test Engineer to lead the validation, configuration, installation, and end... ..., container configurations, and OS-level services. ~ Test Automation & Scripting: Write and maintain test scripts (Bash, Python)...Live in$100k - $135k
...an excellent first industry role for an engineer with strong analog fundamentals from school... ...year Key Responsibilities Bench test setup: Build and maintain the fixtures... ...or MATLAB for data analysis and test automation. Nice-to-haves Familiarity with...Permanent employmentFull timeInternship- ...We are seeking an AFE Test & Integration Engineer to support the validation and integration of a cutting-edge neural recording ASIC. This is... ...Experience using Python or MATLAB for data analysis and test automation. Nice to Have Research experience involving...Internship
$100k - $135k
...AFE Test & Integration Engineer – Analog Electronics Location: San Diego, CA Employment Type: Full-Time Base Salary: $100,000–$135,... ...Python or MATLAB for data analysis, visualization, and test automation. Support integration testing of ASICs with neural...Full timeInternship$86.9k - $198k
...Job Number: R0253539 Systems and Test Engineer, Senior The Opportunity: Are you looking for an opportunity to combine your technical skills with big picture thinking to make an impact in the development of RF technology? You understand your customer's environment...Full timeContract workPart timeLocal areaRemote work$87.1k - $157.45k
...Position Overview Leidos Undersea Systems Division is seeking a skilled Test Engineer who will be responsible for supporting and leading various tasks in conjunction with a large project team of engineers. The project team supports multiple Navy sponsors in designing...Full timeWork at officeWorldwideShift workNight shift- ...The System Test Engineer provides subject matter proficiency for our USAF mission. This role is responsible for providing analytical skills... ...procedures, performing various types of manual and automated software testing including, but not limited to, unit testing,...Minimum wageContract workTemporary workWork experience placementRemote work
$178k - $190k
...diagnostics. Our mission is to redefine what diagnostic testing can reveal and enable advancements in patient care that were... ...reality. Position Overview We are seeking a Senior Staff Surface Process Engineer / Surface Chemist to develop innovative surface...Full time- ...Role Overview We are seeking an Hardware Test Engineer – Level 3 with 5+ years of experience in hardware design, validation, testing, and debugging. The ideal candidate will have strong knowledge of analog, digital, and power electronics , along with hands-on experience...
$76.5k - $141.5k
...national security. Job Title: Specialist, Integration and Test Engineer Job Code: 43435 Job Location: San Diego, CA Job Schedule... ...for testing circuit cards and software, test case automation as well as conducting tests on RF hardware. The ideal candidate...Local areaFlexible hours- ...Job Description Job Description Job Title: RF Test Engineer Location: San Diego, California Onsite/ Remote: Day 1 Onsite at customer... ...simulators/test platforms. Ability to work with RF automation tools and execute algorithm-driven test flows. Understanding...Remote work
$125k - $180k
...Job Description Job Description We are seeking a Senior Test Engineer to lead the development and execution of test solutions for... ...circuits used in memory, AI, high-performance computing, and automated test equipment (ATE) applications. This role owns the production...$65 - $71 per hour
...Description Job Title: Software Developer in Test Location: San Diego, CA, 92128 or... ...: As a Software Development Engineer in Test on the System Integration and... ...focus on building scalable integration automation frameworks and enhancing existing frameworks...Hourly payWork experience placement- ...Position: Staff/Senior Staff GPU Engineer - Shader RTL & Microarchitecture Location: San Diego, CA (4 days onsite) Employment Type: Full-Time... ...post-silicon debug. Partner with verification teams on test plans, coverage, assertions, debug strategies, and directed...Full time
- ...Job Description Job Description Kros-Wise Inc., is seeking a full time Integrated Test Engineer II in San Diego, CA. Duties and Responsibilities: Provide to project teams test engineering support during CNO availabilities, EMs, CMAVs, and WOOs. Evaluate and...Full timeFor contractors
$105k - $125k
...25,000.00 Per Year Role and Responsibilities: Full Time position supporting the TESS Task Order filling the Project Engineer as a senior test engineer position with extensive travel. Duties include: system engineering, test analysis, and technical doc support for...Full time- ...Job Description Job Description Job Title: RF Test Engineer Location: San Diego, California Onsite/ Remote: Day 1 Onsite at customer... ...simulators/test platforms. Ability to work with RF automation tools and execute algorithm-driven test flows. Understanding...Remote work
$165k - $195k
...individual who enjoys working in a small business environment in the High-Tech Industry. The Senior RF Test Engineer will be responsible for the ownership and operation of automated test systems for characterizing and testing of wireless radio products. The primary focus of...Flexible hours$86.06k - $126.23k
...Introduction to the job We are seeking Test Engineers to join our EUV System Test and Integration group. You will be part of an interdisciplinary team that tests and integrates our EUV systems for Development and Engineering. Our EUV light source consists of an intricate...Full timeLocal areaImmediate startShift workDay shift$269.18k - $376.84k
...operations. Job Description Blue Origin is seeking a Principal ASIC Test Engineer to lead production test strategy for RF, mmWave, and mixed-... ...Proficiency in Python, C, Java or similar languages for test automation and production data analysis. Base Pay Range for: CA...Permanent employmentFull timeTemporary workLocal areaRelocation- ...globally.The team is looking for a Design-for-Test contractor to test and validate the next... ...and simulation debug• Experience with automation and scripting - Tcl/Perl/Python•... ..../B.Tech: Electronics and Communication Engineering (ECE), Electrical and Electronics Engineering...For contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Test Automation (R5792). Be the first to apply!
- engineering aide San Diego, CA
- project engineer assistant project manager San Diego, CA
- technology administrator San Diego, CA
- staff engineer San Diego, CA
- senior staff engineer San Diego, CA
- assistant engineer San Diego, CA
- senior staff systems engineer San Diego, CA
- software engineer staff San Diego, CA
- senior automation controls engineer San Diego, CA
- qa automation engineer remote San Diego, CA





