Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Test & Evaluation Lead

$170k - $210k
Full-time

Primordial Labs

About Primordial Labs

We're building the next generation interface for commanding autonomous systems in the real world. Our core product, Anura, translates spoken or typed intent into structured actions across drones, sensors, and mission software—enabling faster, more intuitive control in high-stakes environments. We’re a distributed team of engineers, operators, and technologists focused on deploying reliable autonomy at the tactical edge.

The Mission

Anura takes a spoken order and turns it into robot motion. Proving that it works, in software, in simulation, and on real vehicles in the field, is one of the hardest and most important problems we have. We’re looking for someone to own that proof, and to build much of it themselves.

You’ll lead our quality assurance and physical test functions, and you’ll be hands-on with test development and infrastructure. You’ll build the automated test and evaluation capability that qualifies a build before it reaches a range, while setting the strategy, standards, and readiness criteria that tell us whether it’s ready. Much of our testing runs in simulation and hardware-in-the-loop environments, so you’ll design an approach that leans on them heavily.

When we tell a program office the system performs, the evidence behind that claim runs through you.

What You'll Do

  • Set the Strategy. Define how we test, from automated suites on every build through simulation and system-level tests on real platforms, and what has to be true at each stage before a build moves forward.

  • Build the QA Machinery. Design and build the automated test and evaluation capability, running on our simulation and HIL environments, along with the frameworks and standards our engineering teams test against. Range time is the most expensive test environment we have, and it should be confirming what you already know, not discovering it.

  • Score the System. Build and maintain the end-to-end scenarios we measure system performance against, including hard cases designed to break things, from ambiguous commands and lost links to unexpected changes mid-mission. Measure whether the system did the right thing end to end, not just whether each component returned something plausible.

  • Own the KPIs. Develop and own the test KPIs that define whether the system works for operators, built from acceptance criteria and mission-level performance measures. Track them across builds, measure where defects slip past our gates, and report results to leadership and customers.

  • Own the Gates. Set the criteria a build must meet to enter physical test, and own the final sign-off on whether a build is ready to go to a customer, based on the evidence from QA and the range.

  • Close the Loop. Turn field data from physical test into replayable regression cases and evaluation additions within days, not months.

  • Lead the Team. Lead our physical test engineers, overseeing test planning, field events, and results, and grow the team as we scale. Expect occasional travel to test ranges and field events.

  • Report the Truth. Produce clear test reports and readiness evidence for leadership, customers, and program offices, including results nobody wants to hear.

  • Work Across the Org. Partner with systems engineering on acceptance criteria, with mission engineering on the measures that matter operationally, with the people building our simulation environments, and with DevOps on how tests run in the pipeline.

The Split

You and your team build the tests, run them, and tell us precisely what broke and under what conditions. Engineering owns the fixes. Test stays independent of the teams it evaluates, and protecting that independence is part of your job.

Who You Are

  • Builder First. You write real code, and you’d rather build the test framework yourself than describe it to someone else.

  • Suspicious by Default. You assume it’s broken until something proves otherwise, and you’re drawn to the failure mode nobody else thought to look for.

  • Statistically Literate. You know a probabilistic system doesn’t pass or fail, it performs at a rate, and you can tell the difference between a real regression and noise.

  • Independent and Credible. You can deliver an unwelcome result to engineering leadership or a customer and make it stick.

  • Player-Coach. You lead by example, set clear standards, and grow engineers who would rather find the bug than defend the build.

  • At Home Everywhere Test Happens. You’re as comfortable in a code review or a simulation environment as you are on a test range.

Required Qualifications

  • Experience. 6+ years in QA, test engineering, test automation, or systems test, including experience leading engineers or test efforts.

  • QA and Test Automation. Deep, hands-on experience building automated test suites and frameworks for complex software, and keeping them fast and trustworthy.

  • Software. Strong proficiency in Python, comfort in Linux, and hands-on experience with CI.

  • Test Leadership. Demonstrated experience defining test strategy, standards, KPIs, and readiness criteria for complex systems.

  • System-Level Test. Working knowledge of testing on real hardware or platforms, and how field testing fits into a broader test strategy.

  • Simulation. Familiarity with simulation and hardware-in-the-loop testing, and how to use them to reduce what has to be discovered in the field.

  • Education. BS in Computer Science, Engineering, or a related technical field, or equivalent hands-on experience.

Nice to Have

  • Experience building evaluation for ML models in production, including test set design, metric selection, and catching regressions that standard accuracy numbers hide

  • Experience testing systems with ML components

  • Robotics, unmanned systems, or autonomy test experience

  • Defense test and evaluation experience, including test plans, TEMPs, and government deliverable reporting

  • Experience building a test function at a startup or small company

Important Qualification Note: Due to the nature of our work and federal compliance requirements, this position strictly requires U.S. Citizenship and current residency within the United States. Please note that Permanent Residency (Green Card status) or visa sponsorship cannot satisfy these specific regulatory requirements.

Compensation

Compensation for this position includes a target base salary of $170,000 - $210,000 annually, with the specific figure determined by the candidate's experience level.

We’re committed to fair and equitable compensation and are happy to explain how we determine our salary ranges, just ask!

Our Benefits

  • Beyond a Competitive Salary, we provide a significant equity stake, aligning your growth with ours.

  • 100% Remote: This role is fully remote, open to residents across the US. We believe that talent knows no borders (well, except for the US in this case!).

  • Comprehensive Health Coverage: We provide comprehensive medical, dental, and vision plans so you and your family can stay healthy and worry free.

  • Retirement Planning: Plan for tomorrow with our 401(k) package, complete with a generous 6% company match.

  • Generous DTO: Our generous Discretionary Time off (DTO) policy is all about helping you take the breaks you deserve and live your healthiest, most fulfilling life.

  • Elite Technology Package: Enjoy an elite technology package to make your work effortless and efficient.

Our Interview Process

Our interview process is designed to be thorough and respectful of your time. It typically includes:

  1. Conversation with the People Team: Lets get to know one another first!

  2. Screener Interview: A 30-minute discussion about relevant concepts and your past experience.

  3. Technical Challenge: We provide an at your own pace challenge focused on real life situations. After completion, you'll present your solutions in a follow-up call. This allows us to understand your thought processes and technical approach.

  4. Technical Collaboration & Team Q&A: Walk through a recent code sample with the engineering team, discuss your design choices, and ask us anything about our stack, culture, and day to day work.

We are committed to a low-stress interview experience—no trick questions or brain teasers!

Primordial Labs is an equal opportunity employer, committed to creating a welcoming and respectful environment for everyone. Discrimination and harassment have no place here. We firmly believe that a diverse team enriches our problem-solving capabilities, sparks greater creativity, and ultimately leads to a better product and a more vibrant company.

We understand that great talent comes from various paths and that passion and transferable skills are invaluable. At Primordial Labs, what truly matters is your ability to make an impact, your dedication to our mission, and your capacity to thrive in a fast-paced, collaborative atmosphere. We are dedicated to fostering an inclusive workplace where you can contribute your unique talents, expand your skills, and learn continuously. If you’re driven to make a real impact, we encourage you to apply, even if your experience doesn’t perfectly align with every qualification.

#LI-REMOTE

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Test & Evaluation Lead in Remote vacancy
  •  ...Senior Test Integration Lead Company: Iron Will Ventures, Inc. Location: Phoenix/Chandler, AZ Position Level: Senior Employment Type...  ...milestones, and flight execution activities. Evaluate technical issues, integration challenges, and test anomalies... 
    Suggested
    Full time

    Iron Will Ventures

    Remote
    18 days ago
  • $104k - $166k

     ...farthest reaches of the galaxy. As the world’s leading mission capability integrator and...  ...Peraton is seeking a Penetration Testing Lead to join our team. This person will...  ...tactics, techniques, and procedures and evaluate the organization’s ability to detect and... 
    Suggested
    Full time
    Contract work
    Temporary work
    Remote work
    Shift work

    Peraton

    Remote
    9 days ago
  •  ...True Zero Technologies is seeking an experienced Penetration Testing Team Lead to oversee and execute advanced penetration testing and Red...  ...security assessments, identifying exploitable vulnerabilities, evaluating security controls, and providing actionable recommendations... 
    Suggested
    Full time

    True Zero Technologies

    Remote
    13 days ago
  • $132.4k - $251.6k

     ...complex problems. With our three market leading businesses, world-class operations and investments...  ...and defense.Systems Engineering & Test Capabilities (SE&TC) integrates, verifies...  ...develop plans and procedures, debug and evaluate system functions and interfaces, develop... 
    Suggested
    Temporary work
    For contractors
    Work experience placement
    Interim role
    Work at office
    Remote work
    Flexible hours

    Raytheon

    Tucson, AZ
    3 days ago
  • $128k - $245k

     ...is a community of people who anticipate, lead, and believe that listening is where learning...  ...#VTeamLife.What you’ll be doing…As the Test Lead of Mobile Base Marketing, you will...  ...OpportunityVerizon is an equal opportunity employer. We evaluate qualified applicants without regard to... 
    Suggested
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Work from home
    Shift work
    3 days per week

    Verizon

    Alpharetta, GA
    4 days ago
  •  ...the NCRC Range Modernization (RM), The Senior Integration and Testing Lead is a critical leadership role responsible for architecting, governing...  ...& Management: Directly manage, mentor, and evaluate a cross-functional team of QA automation engineers, integration... 
    Contract work
    Temporary work
    Remote work
    Worldwide

    By Light Professional IT Services

    Orlando, FL
    2 days ago
  • $107.5k - $204.5k

     ...complex problems. With our three market leading businesses, world-class operations and investments...  ...and defense.The Systems Engineering & Test Capabilities discipline is seeking an...  ...developing simulation scenarios to evaluate system performance.Experience analyzing large... 
    Temporary work
    Work experience placement
    Interim role
    Work at office
    Remote work
    Relocation package
    Flexible hours
    Shift work
    Day shift
    Afternoon shift

    Raytheon

    Andover, MA
    9 hours ago
  •  ...opportunity for a Systems Integration and Testing Manager in Alachua, Florida USA (greater...  ...Systems Integration and Testing Manager leads a multidisciplinary engineering team to...  ...and field trials (e.g. prototype evaluations at mine sites) to validate performance under... 
    Work at office
    Worldwide

    Sandvik AB

    Tallahassee, FL
    5 days ago
  •  ...positive impacts here on Earth. Currently, we are seeking a Software Test Lead to contribute to our mission in a dynamic startup environment...  ...injection , failure mode testing, and resilience validation Evaluate and introduce automation frameworks and tooling suited to the... 
    Permanent employment
    Full time
    Remote work
    Monday to Friday

    Lunar Outpost

    Golden, CO
    1 day ago
  •  ...Overview Apogee is seeking a Senior Test & Evaluation Manager to lead planning, coordination, execution, and reporting for developmental test (DT), integration test, and operational test (OT) activities in direct support of the JPO Integrated Test Team (ITT).... 
    Full time
    Temporary work
    Work at office

    Apogee Engineering, LLC

    Remote
    13 days ago
  • Penetration Testing Team Lead Everforth ECS is seeking a Penetration Testing Team Lead who lives in close proximity to the National Capital...  ...technical guidance, supporting skills development, and evaluating new tools and techniques for inclusion in the team's toolkit... 
    Local area
    Remote work

    ClearanceJobs

    New York, NY
    3 days ago
  • $107.5k - $204.5k

     ...complex problems. With our three market leading businesses, world-class operations and investments...  ...and defense. Systems Integration & Test (SI&T) is organized into multiple...  ...relevant experience.Experience collecting and evaluating data to diagnose technical issues.Experience... 
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Raytheon

    Mckinney, TX
    4 days ago
  • $116.9k - $243.1k

     ...The work As the SAP Automation Lead, you will play a pivotal role in guiding...  ...leadership will be essential in coordinating test automation activities, driving the development...  ...DoD/Federal requirements Integrate or evaluate alternative automation platforms (... 
    Full time
    Live in
    Work at office
    Local area

    Accenture Federal Services

    Remote
    5 days ago
  • $107.5k - $204.5k

     ...complex problems. With our three market leading businesses, world-class operations and investments...  ...of aerospace and defense.Environmental Test (ET) is an engineering organization that...  ..., flight test clearance, engineering evaluations, and failure investigations.Implement... 
    Temporary work
    Work experience placement
    Interim role
    Work at office
    Local area
    Remote work
    Relocation package
    Flexible hours
    Night shift
    Afternoon shift

    Raytheon

    Tucson, AZ
    3 days ago
  •  ...create more certainty for our customers that leads to better moments, every day. Our...  ...champion lives! Job Summary Software Test Analyst Lead is responsible for improving...  ...evangelizing best practices and constantly evaluating and implementing new practices, tools, and... 
    Full time
    Part time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    American United Life Ins Co

    Indianapolis, IN
    3 days ago
  •  ...Test Automation Lead This is a remote position. Comerit is searching for a Test Automation Lead. Our current client is looking to increase their project team for their Release 2 data cleansing and data harmonization project. This will include moving from legacy systems... 
    Remote work

    COMERIT

    United States
    3 days ago
  •  ...Description Job Description Job Title: Tech Lead Location: Lisle, IL Onsite/ Remote:...  .... Automation and requirements for test tools (logging equipment, HIL benches, automation...  ..., or disability. All applicants will be evaluated solely based on their ability, competence... 
    Remote work

    Yantran LLC

    Lisle, IL
    26 days ago
  • $115k - $165k

     ...contribute to technology initiatives in a collaborative environment with opportunities for professional growth.  Job Title: Test Automation Lead  Location: Remote  Position Type: Full-time, Direct W2 - [Not open to C2C or 1099]  Salary Range: $115,000–$165,000... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Remote
    6 days ago
  •  ...Job Summary: The client is seeking an experienced Test Automation Lead to join the team. The successful candidate will be responsible for leading the transformation of testing into a continuous and efficient end-to-end quality engineering function through the... 
    Remote work

    Exaways Corporation

    United States
    5 days ago
  •  ...Performance Testing Lead Location: remote Design and implement performance testing strategies using Tricentis NeoLoad. Develop load testing scenarios, scripts, and execution plans based on system requirements and user load models in S/4 specific to SD, CPI iflows... 
    Remote work

    JConnect Infotech

    United States
    3 days ago
  •  ...Leading product testing efforts for the Veteran's Crisis Line program, the full-time Senior Test Lead will ensure software quality and compliance on the Salesforce platform while working remotely. Key responsibilities Develop comprehensive master test plans and define... 
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    3 days ago
  • $176.8k - $228.8k

     ...Washington D.C., and Nashville. Remote work is allowed. Role Overview Key Responsibilities May Include: Supporting Epic Beaker testing, build, optimization, and ongoing maintenance activities. Gathering requirements and translating operational needs into... 
    Hourly pay
    Temporary work
    Remote work

    Chartis

    Remote
    11 days ago
  •  ...and entertainment industries. We work with some of the world's leading game developers and publishers, providing Functional QA, Compliance...  ...impact. We’re looking for an experienced Mobile Compliance Test Lead to ensure our mobile titles meet App Store and Google... 
    Full time

    Testronic

    Remote
    17 days ago
  •  ...PROLIM Global Corporation () is currently seeking GIS Test Lead for a position in San Francisco, CA with one of our top clients. Location : San Francisco, CA Duration: 6 Months (With Possible Extension) Job Type: Contract Experience... 
    Contract work

    PROLIM Corporation

    San Francisco, CA
    5 days ago
  • $100k - $120k

     ...Test Lead Location: Redmond, WA Mode: Remote Job Type: Fulltime/ Contract Years of Experience: 10-15 Years Salary/ Rate: Fulltime: The pay range for this role is US$100,000 - US$120,000 per annum including any bonuses or variable pay. Rate: $55/Hr... 
    Full time
    Contract work
    Remote work

    Yochana

    United States
    15 hours ago
  • $100k - $120k

    A global software testing company in Chicago is looking for a Performance Test Lead / Mid-Level Performance Test Engineer. The role involves designing and executing performance test strategies, with strong expertise in performance testing, Apache JMeter, and Azure Load... 
    Full time
    Remote work

    QualiTest Group

    United States
    3 days ago
  •  ...Role Overview: Lead the testing and quality assurance activities for GIS applications, spatial data platforms, mapping solutions, and geospatial integrations. Ensure high-quality delivery of GIS products by managing test teams, defining test strategies, and validating... 

    Prophecy Technologies

    San Francisco, CA
    5 days ago
  •  ...Job Description The Test Lead will manage end-to-end testing for the Medical Cannabis Patient Registry modernization, Patient Portal, security integrations, data migration, accessibility, and production readiness. Required / Preferred Experience... 
    Remote work

    RICEFW Technologies

    United States
    2 days ago
  • $107.5k - $204.5k

     ...solving the world’s most complex problems. With our three market leading businesses, world-class operations and investments in research...  ...providing functional support to the section “EO Integration and Test Section” (~15%).This position is on site in our Tucson, AZ location... 
    Temporary work
    Work experience placement
    Interim role
    Work at office
    Remote work
    Relocation package
    Flexible hours

    Raytheon

    Tucson, AZ
    2 days ago
  •  ...QA Lead The QA Lead is responsible for quality and test related process execution with high impact to the business. This includes providing feedback on artifacts developed during requirements and analysis phase within client projects; authoring test plans and test cases... 
    Remote work

    Software Technology Inc

    United States
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Test & Evaluation Lead. Be the first to apply!