Test & Evaluation Lead
$170k - $210kPrimordial Labs
About Primordial Labs
We're building the next generation interface for commanding autonomous systems in the real world. Our core product, Anura, translates spoken or typed intent into structured actions across drones, sensors, and mission software—enabling faster, more intuitive control in high-stakes environments. We’re a distributed team of engineers, operators, and technologists focused on deploying reliable autonomy at the tactical edge.
The Mission
Anura takes a spoken order and turns it into robot motion. Proving that it works, in software, in simulation, and on real vehicles in the field, is one of the hardest and most important problems we have. We’re looking for someone to own that proof, and to build much of it themselves.
You’ll lead our quality assurance and physical test functions, and you’ll be hands-on with test development and infrastructure. You’ll build the automated test and evaluation capability that qualifies a build before it reaches a range, while setting the strategy, standards, and readiness criteria that tell us whether it’s ready. Much of our testing runs in simulation and hardware-in-the-loop environments, so you’ll design an approach that leans on them heavily.
When we tell a program office the system performs, the evidence behind that claim runs through you.
What You'll Do
Set the Strategy. Define how we test, from automated suites on every build through simulation and system-level tests on real platforms, and what has to be true at each stage before a build moves forward.
Build the QA Machinery. Design and build the automated test and evaluation capability, running on our simulation and HIL environments, along with the frameworks and standards our engineering teams test against. Range time is the most expensive test environment we have, and it should be confirming what you already know, not discovering it.
Score the System. Build and maintain the end-to-end scenarios we measure system performance against, including hard cases designed to break things, from ambiguous commands and lost links to unexpected changes mid-mission. Measure whether the system did the right thing end to end, not just whether each component returned something plausible.
Own the KPIs. Develop and own the test KPIs that define whether the system works for operators, built from acceptance criteria and mission-level performance measures. Track them across builds, measure where defects slip past our gates, and report results to leadership and customers.
Own the Gates. Set the criteria a build must meet to enter physical test, and own the final sign-off on whether a build is ready to go to a customer, based on the evidence from QA and the range.
Close the Loop. Turn field data from physical test into replayable regression cases and evaluation additions within days, not months.
Lead the Team. Lead our physical test engineers, overseeing test planning, field events, and results, and grow the team as we scale. Expect occasional travel to test ranges and field events.
Report the Truth. Produce clear test reports and readiness evidence for leadership, customers, and program offices, including results nobody wants to hear.
Work Across the Org. Partner with systems engineering on acceptance criteria, with mission engineering on the measures that matter operationally, with the people building our simulation environments, and with DevOps on how tests run in the pipeline.
The Split
You and your team build the tests, run them, and tell us precisely what broke and under what conditions. Engineering owns the fixes. Test stays independent of the teams it evaluates, and protecting that independence is part of your job.
Who You Are
Builder First. You write real code, and you’d rather build the test framework yourself than describe it to someone else.
Suspicious by Default. You assume it’s broken until something proves otherwise, and you’re drawn to the failure mode nobody else thought to look for.
Statistically Literate. You know a probabilistic system doesn’t pass or fail, it performs at a rate, and you can tell the difference between a real regression and noise.
Independent and Credible. You can deliver an unwelcome result to engineering leadership or a customer and make it stick.
Player-Coach. You lead by example, set clear standards, and grow engineers who would rather find the bug than defend the build.
At Home Everywhere Test Happens. You’re as comfortable in a code review or a simulation environment as you are on a test range.
Required Qualifications
Experience. 6+ years in QA, test engineering, test automation, or systems test, including experience leading engineers or test efforts.
QA and Test Automation. Deep, hands-on experience building automated test suites and frameworks for complex software, and keeping them fast and trustworthy.
Software. Strong proficiency in Python, comfort in Linux, and hands-on experience with CI.
Test Leadership. Demonstrated experience defining test strategy, standards, KPIs, and readiness criteria for complex systems.
System-Level Test. Working knowledge of testing on real hardware or platforms, and how field testing fits into a broader test strategy.
Simulation. Familiarity with simulation and hardware-in-the-loop testing, and how to use them to reduce what has to be discovered in the field.
Education. BS in Computer Science, Engineering, or a related technical field, or equivalent hands-on experience.
Nice to Have
Experience building evaluation for ML models in production, including test set design, metric selection, and catching regressions that standard accuracy numbers hide
Experience testing systems with ML components
Robotics, unmanned systems, or autonomy test experience
Defense test and evaluation experience, including test plans, TEMPs, and government deliverable reporting
Experience building a test function at a startup or small company
Important Qualification Note: Due to the nature of our work and federal compliance requirements, this position strictly requires U.S. Citizenship and current residency within the United States. Please note that Permanent Residency (Green Card status) or visa sponsorship cannot satisfy these specific regulatory requirements.
Compensation
Compensation for this position includes a target base salary of $170,000 - $210,000 annually, with the specific figure determined by the candidate's experience level.
We’re committed to fair and equitable compensation and are happy to explain how we determine our salary ranges, just ask!
Our Benefits
Beyond a Competitive Salary, we provide a significant equity stake, aligning your growth with ours.
100% Remote: This role is fully remote, open to residents across the US. We believe that talent knows no borders (well, except for the US in this case!).
Comprehensive Health Coverage: We provide comprehensive medical, dental, and vision plans so you and your family can stay healthy and worry free.
Retirement Planning: Plan for tomorrow with our 401(k) package, complete with a generous 6% company match.
Generous DTO: Our generous Discretionary Time off (DTO) policy is all about helping you take the breaks you deserve and live your healthiest, most fulfilling life.
Elite Technology Package: Enjoy an elite technology package to make your work effortless and efficient.
Our Interview Process
Our interview process is designed to be thorough and respectful of your time. It typically includes:
Conversation with the People Team: Lets get to know one another first!
Screener Interview: A 30-minute discussion about relevant concepts and your past experience.
Technical Challenge: We provide an at your own pace challenge focused on real life situations. After completion, you'll present your solutions in a follow-up call. This allows us to understand your thought processes and technical approach.
Technical Collaboration & Team Q&A: Walk through a recent code sample with the engineering team, discuss your design choices, and ask us anything about our stack, culture, and day to day work.
We are committed to a low-stress interview experience—no trick questions or brain teasers!
Primordial Labs is an equal opportunity employer, committed to creating a welcoming and respectful environment for everyone. Discrimination and harassment have no place here. We firmly believe that a diverse team enriches our problem-solving capabilities, sparks greater creativity, and ultimately leads to a better product and a more vibrant company.
We understand that great talent comes from various paths and that passion and transferable skills are invaluable. At Primordial Labs, what truly matters is your ability to make an impact, your dedication to our mission, and your capacity to thrive in a fast-paced, collaborative atmosphere. We are dedicated to fostering an inclusive workplace where you can contribute your unique talents, expand your skills, and learn continuously. If you’re driven to make a real impact, we encourage you to apply, even if your experience doesn’t perfectly align with every qualification.
#LI-REMOTE
- ...Senior Test Integration Lead Company: Iron Will Ventures, Inc. Location: Phoenix/Chandler, AZ Position Level: Senior Employment Type... ...milestones, and flight execution activities. Evaluate technical issues, integration challenges, and test anomalies...SuggestedFull time
$104k - $166k
...farthest reaches of the galaxy. As the world’s leading mission capability integrator and... ...Peraton is seeking a Penetration Testing Lead to join our team. This person will... ...tactics, techniques, and procedures and evaluate the organization’s ability to detect and...SuggestedFull timeContract workTemporary workRemote workShift work- ...True Zero Technologies is seeking an experienced Penetration Testing Team Lead to oversee and execute advanced penetration testing and Red... ...security assessments, identifying exploitable vulnerabilities, evaluating security controls, and providing actionable recommendations...SuggestedFull time
$132.4k - $251.6k
...complex problems. With our three market leading businesses, world-class operations and investments... ...and defense.Systems Engineering & Test Capabilities (SE&TC) integrates, verifies... ...develop plans and procedures, debug and evaluate system functions and interfaces, develop...SuggestedTemporary workFor contractorsWork experience placementInterim roleWork at officeRemote workFlexible hours$128k - $245k
...is a community of people who anticipate, lead, and believe that listening is where learning... ...#VTeamLife.What you’ll be doing…As the Test Lead of Mobile Base Marketing, you will... ...OpportunityVerizon is an equal opportunity employer. We evaluate qualified applicants without regard to...SuggestedFull timeTemporary workPart timeWork experience placementWork at officeWork from homeShift work3 days per week- ...the NCRC Range Modernization (RM), The Senior Integration and Testing Lead is a critical leadership role responsible for architecting, governing... ...& Management: Directly manage, mentor, and evaluate a cross-functional team of QA automation engineers, integration...Contract workTemporary workRemote workWorldwide
$107.5k - $204.5k
...complex problems. With our three market leading businesses, world-class operations and investments... ...and defense.The Systems Engineering & Test Capabilities discipline is seeking an... ...developing simulation scenarios to evaluate system performance.Experience analyzing large...Temporary workWork experience placementInterim roleWork at officeRemote workRelocation packageFlexible hoursShift workDay shiftAfternoon shift- ...opportunity for a Systems Integration and Testing Manager in Alachua, Florida USA (greater... ...Systems Integration and Testing Manager leads a multidisciplinary engineering team to... ...and field trials (e.g. prototype evaluations at mine sites) to validate performance under...Work at officeWorldwide
- ...positive impacts here on Earth. Currently, we are seeking a Software Test Lead to contribute to our mission in a dynamic startup environment... ...injection , failure mode testing, and resilience validation Evaluate and introduce automation frameworks and tooling suited to the...Permanent employmentFull timeRemote workMonday to Friday
- ...Overview Apogee is seeking a Senior Test & Evaluation Manager to lead planning, coordination, execution, and reporting for developmental test (DT), integration test, and operational test (OT) activities in direct support of the JPO Integrated Test Team (ITT)....Full timeTemporary workWork at office
- Penetration Testing Team Lead Everforth ECS is seeking a Penetration Testing Team Lead who lives in close proximity to the National Capital... ...technical guidance, supporting skills development, and evaluating new tools and techniques for inclusion in the team's toolkit...Local areaRemote work
$107.5k - $204.5k
...complex problems. With our three market leading businesses, world-class operations and investments... ...and defense. Systems Integration & Test (SI&T) is organized into multiple... ...relevant experience.Experience collecting and evaluating data to diagnose technical issues.Experience...Temporary workWork experience placementWork at officeRemote workFlexible hours$116.9k - $243.1k
...The work As the SAP Automation Lead, you will play a pivotal role in guiding... ...leadership will be essential in coordinating test automation activities, driving the development... ...DoD/Federal requirements Integrate or evaluate alternative automation platforms (...Full timeLive inWork at officeLocal area$107.5k - $204.5k
...complex problems. With our three market leading businesses, world-class operations and investments... ...of aerospace and defense.Environmental Test (ET) is an engineering organization that... ..., flight test clearance, engineering evaluations, and failure investigations.Implement...Temporary workWork experience placementInterim roleWork at officeLocal areaRemote workRelocation packageFlexible hoursNight shiftAfternoon shift- ...create more certainty for our customers that leads to better moments, every day. Our... ...champion lives! Job Summary Software Test Analyst Lead is responsible for improving... ...evangelizing best practices and constantly evaluating and implementing new practices, tools, and...Full timePart timeWork at officeLocal areaRemote workWork from homeFlexible hours
- ...Test Automation Lead This is a remote position. Comerit is searching for a Test Automation Lead. Our current client is looking to increase their project team for their Release 2 data cleansing and data harmonization project. This will include moving from legacy systems...Remote work
- ...Description Job Description Job Title: Tech Lead Location: Lisle, IL Onsite/ Remote:... .... Automation and requirements for test tools (logging equipment, HIL benches, automation... ..., or disability. All applicants will be evaluated solely based on their ability, competence...Remote work
$115k - $165k
...contribute to technology initiatives in a collaborative environment with opportunities for professional growth. Job Title: Test Automation Lead Location: Remote Position Type: Full-time, Direct W2 - [Not open to C2C or 1099] Salary Range: $115,000–$165,000...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...Job Summary: The client is seeking an experienced Test Automation Lead to join the team. The successful candidate will be responsible for leading the transformation of testing into a continuous and efficient end-to-end quality engineering function through the...Remote work
- ...Performance Testing Lead Location: remote Design and implement performance testing strategies using Tricentis NeoLoad. Develop load testing scenarios, scripts, and execution plans based on system requirements and user load models in S/4 specific to SD, CPI iflows...Remote work
- ...Leading product testing efforts for the Veteran's Crisis Line program, the full-time Senior Test Lead will ensure software quality and compliance on the Salesforce platform while working remotely. Key responsibilities Develop comprehensive master test plans and define...Full timeRemote work
$176.8k - $228.8k
...Washington D.C., and Nashville. Remote work is allowed. Role Overview Key Responsibilities May Include: Supporting Epic Beaker testing, build, optimization, and ongoing maintenance activities. Gathering requirements and translating operational needs into...Hourly payTemporary workRemote work- ...and entertainment industries. We work with some of the world's leading game developers and publishers, providing Functional QA, Compliance... ...impact. We’re looking for an experienced Mobile Compliance Test Lead to ensure our mobile titles meet App Store and Google...Full time
- ...PROLIM Global Corporation () is currently seeking GIS Test Lead for a position in San Francisco, CA with one of our top clients. Location : San Francisco, CA Duration: 6 Months (With Possible Extension) Job Type: Contract Experience...Contract work
$100k - $120k
...Test Lead Location: Redmond, WA Mode: Remote Job Type: Fulltime/ Contract Years of Experience: 10-15 Years Salary/ Rate: Fulltime: The pay range for this role is US$100,000 - US$120,000 per annum including any bonuses or variable pay. Rate: $55/Hr...Full timeContract workRemote work$100k - $120k
A global software testing company in Chicago is looking for a Performance Test Lead / Mid-Level Performance Test Engineer. The role involves designing and executing performance test strategies, with strong expertise in performance testing, Apache JMeter, and Azure Load...Full timeRemote work- ...Role Overview: Lead the testing and quality assurance activities for GIS applications, spatial data platforms, mapping solutions, and geospatial integrations. Ensure high-quality delivery of GIS products by managing test teams, defining test strategies, and validating...
- ...Job Description The Test Lead will manage end-to-end testing for the Medical Cannabis Patient Registry modernization, Patient Portal, security integrations, data migration, accessibility, and production readiness. Required / Preferred Experience...Remote work
$107.5k - $204.5k
...solving the world’s most complex problems. With our three market leading businesses, world-class operations and investments in research... ...providing functional support to the section “EO Integration and Test Section” (~15%).This position is on site in our Tucson, AZ location...Temporary workWork experience placementInterim roleWork at officeRemote workRelocation packageFlexible hours- ...QA Lead The QA Lead is responsible for quality and test related process execution with high impact to the business. This includes providing feedback on artifacts developed during requirements and analysis phase within client projects; authoring test plans and test cases...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Test & Evaluation Lead. Be the first to apply!



