Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer in Test, Compiler & Systems Validation

Code Metal, Inc.

About Code Metal

Code Metal is the leader in automated software engineering you can trust. As AI writes more of the world's code, the bottleneck in software has shifted from writing code to verifying it works, and AI cannot verify its own work with certainty. Code Metal takes a fundamentally different approach: constrain AI to what it does reliably, verify every step independently of the model using formal methods, and keep engineers in the loop on the decisions that matter. The result isn't code that probably works — it's code that is provably correct, with auditable proof. Customers including the U.S. Air Force, L3Harris, RTX, and Toshiba use Code Metal to modernize legacy code, optimize performance on real hardware, and move prototypes to production, fast. Founded in 2023 with offices in Boston and San Francisco, Code Metal isfunded byAccel, Salesforce Ventures, B Capital, Smith Point Capital, J2 Ventures, Shield Capital, Overmatch, RTX, and others.
Learn more at codemetal.ai.

The Role

Code Metal is strengthening Quality Engineering across its code-transformation platforms, language toolchains, and AI-assisted engineering workflows. Our teams already have meaningful validation practices in place. As the first dedicated Software Engineer in Test (SDET) hire for this space, reporting to the Director of Quality Engineering, you will build on those foundations - identifying gaps, establishing scalable practices, improving consistency and coverage, and creating clearer quality signals and trustworthy release evidence in partnership with Engineering, Research, and Solutions.

Core Responsibilities
  • Assess existing validation practices, identify material gaps, and establish scalable quality strategies for code-generation, transpilation, and software-transformation workflows.

  • Strengthen quality practices for AI-assisted and agentic workflows, with sound judgment about reliability, reproducibility, risk, and appropriate oversight.

  • Build automated quality and regression infrastructure for AI-assisted software workflows that produces reproducible engineering evidence.

  • Strengthen and standardize quality signals and release evidence, including regression trends, failure attribution, validation results, and documented readiness criteria.

  • Diagnose complex failures across C/C++, Rust, Python, build systems, generated code, and heterogeneous target environments; make focused corrections where practical and partner with owning teams on deeper fixes.

  • Integrate validation suites and quality gates into delivery workflows while collaborating with, rather than replacing, the team responsible for shared CI/CD and developer infrastructure.

  • Lead quality practices for this space, establish technical standards, mentor engineers, and help shape the Quality Engineering function’s roadmap, operating model, and cross-team interfaces.

Required Qualifications
  • Significant experience in systems software, compiler or language tooling, developer tools, embedded software, or low-level execution environments.

  • Production-grade programming proficiency in Python and C++, plus the ability to read and debug unfamiliar C and Rust code.

  • Experience designing and scaling automated test frameworks, distributed execution systems, or evaluation pipelines for complex systems software.

  • Strong understanding of memory models, concurrency, runtime performance, and architecture-dependent behavior across CPU, GPU, embedded, or other constrained targets.

  • Hands‑on experience with Linux, containerized environments, continuous integration platforms, and modern build systems.

  • Ability to translate ambiguous quality risks into measurable validation plans, explain tradeoffs clearly, and lead technical work across team boundaries.

  • Strong cross-functional collaboration skills, including partnering with Product to align validation strategies with the product value proposition and customer expectations.

  • Experience validating AI-assisted or nondeterministic software systems, with sound judgment about AI limitations, reproducibility, independent test evidence, and when deterministic controls or human oversight are required.

Preferred Qualifications
  • Experience improving and scaling quality practices for complex, nondeterministic, or high-consequence software systems.

  • Experience evaluating agentic or AI-assisted systems and translating their risks into practical quality controls.

  • Deep hands‑on experience with compilers, language tooling, intermediate representations, ABI compatibility, or cross‑language semantic validation.

  • Experience establishing repeatable validation environments and traceable engineering evidence.

  • Familiarity with formal verification and experience translating research methods into practical engineering checks.

  • Professional experience in regulated, safety‑critical, or high‑assurance domains such as defense, aerospace, automotive, medical devices, industrial systems, or semiconductor platforms.

Experience Level

Typically 8+ years of relevant software engineering, test infrastructure, or quality engineering experience, with demonstrated Staff-level scope and impact. Equivalent depth of experience is valued over a rigid year count.

Benefits
  • Pay depends on experience, but we strive to be at the upper end of the salary range

  • Health care plan with 100% premium coverage, including medical, dental, and vision

  • 401k with 5% matching

  • Paid Time Off (uncapped vacation, plus sick and public holidays)

  • Flexible hybrid or remote work arrangement

  • Relocation assistance for qualifying employees

Wage Transparency - The salary range for this role is not a guarantee of compensation or salary, as the final offer amount may vary based on factors including, but not limited to, individual proficiency, skills, experience, and location.


We are an equal opportunity employer. US Citizenship may be required for certain project assignments involving security clearance.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer in Test, Compiler & Systems Validation in Boston, MA vacancy
  • $102k - $120k

    Boston Dynamics seeks a highly technical Staff Software Engineer in Test, to test the Atlas Humanoid Robot....  ...and performance of Atlas’s software systems, focusing heavily on metrics based...  ...to robot behavior and ML model validation. If you thrive on learning fast, solving... 
    Suggested
    Full time
    Visa sponsorship

    Boston Dynamics

    Waltham, MA
    1 day ago
  • $200k - $265k

    BostonEngineering - Virtual Test Environment /Full...  ...Pilot autonomy system powers a growing range...  ...are a hands-on systems software engineer who takes ownership of...  ...control documents; validate message encoding, signal...  ....Maintain cross-compilation, packaging, and deployment... 
    Suggested
    Full time
    Flexible hours

    Merlin Labs

    Boston, MA
    4 days ago
  • $254k - $350k

     ...Seattle, WASoftware - Autonomy Software /Full-time /HybridThe...  ...next generation of autonomous system intelligence.As a Machine Learning...  ...Learning and System Optimization Engineer, you will orchestrate and...  ...implement model conversion and compilation pipelines using TensorRT for... 
    Suggested
    Full time
    Temporary work
    Relocation package

    Zoox

    Boston, MA
    2 days ago
  • $200k - $265k

     ...Merlin Software EngineerMerlin is a publicly...  ...Merlin Pilot autonomy system powers a growing...  ...'s global flight test facilities, including...  ...systems software engineer who takes...  ...control documents; validate message encoding,...  ...reproducible.Maintain cross-compilation, packaging, and... 
    Suggested
    Flexible hours

    Merlin

    Boston, MA
    1 day ago
  • $144k - $288k

     ...Staff Software Engineer, Scientific System of Record Cambridge, MA USA; San Francisco, CA USA We are seeking a Staff Software Engineer to join our Scientific...  ...ensure reproducibility and close the Design-Build-Test-Learn (DBTL) loop. What You'll Be Building User Interfaces... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    5 days ago
  •  ...platform and is seeking a Senior Software Developer in Test (SDET) to help drive...  ...management, and financial systems. This is an opportunity to...  ...a highly collaborative engineering organization where quality...  ...understanding of SQL and database validation techniques Experience... 
    Full time

    Motion Recruitment

    Boston, MA
    1 day ago
  • $102.4k - $166.4k

     ...creative and collaborative Scientific Software Engineer to help solve the unique software...  ..., ranging from classical compiler techniques to quantum system architecture. You will be building...  ...including version control, code review, testing, CI/CD, logging, profiling, debugging... 

    QuEra Computing

    Boston, MA
    4 days ago
  •  ...Design and implement real-time system software architectures leveraging...  ...hardware.Contribute to BSP validation and system-level debugging...  ...document unit and integration testing for system software...  ...peripheral devices.Support hardware engineering teams with deep technical... 
    Full time
    Temporary work
    Work at office
    Immediate start
    Work visa

    Sonos

    Boston, MA
    4 days ago
  •  ...PermanentPay: $160000Posted: 2026-08-24Senior Software Engineer, Test InfrastructureJoin an innovative...  ...for complex distributed systems. Develop integration and hardware-in-...  ...frameworks. Design fault-injection and system validation capabilities. Partner with software and... 
    Immediate start

    Talener

    Boston, MA
    5 days ago
  • $65 - $80 per hour

     ...generation of quality engineering practices across a modern...  ...a highly technical software engineer with strong Python...  ...building automated testing solutions for data...  ...automated tests for backend systems, APIs, data pipelines,...  ...as Git Experience validating data integrity, data quality... 
    Full time
    Temporary work
    Flexible hours

    Motion Recruitment

    Boston, MA
    1 day ago
  • $324k - $389k

     ...MASoftware - Autonomy Software /Full-time /On-siteAt...  ...a team of world-class engineers with diverse backgrounds...  ...design, and automated testing. You’ll master new...  ...research to impact key systems to move Zoox forward.ResponsibilitiesLead...  ..., defining the validation process for our next-... 
    Odd job
    Full time
    Temporary work
    Relocation package

    Zoox

    Boston, MA
    4 days ago
  • $146.25k - $224.25k

     ...OpportunityWe're looking for a Staff Software Engineer to be a technical leader on...  ...demanding parts of the system.You will set and uphold engineering...  ...for code quality, testing, observability, security and...  ...including design controls and validation.You will mentor senior and... 
    Local area
    Worldwide
    Relocation package

    PathAI

    Boston, MA
    4 days ago
  • $204k - $310k

     ...Staff Or Principal Software Engineer, Scientific System Of RecordWe are seeking a Staff Or Principal Software Engineer, Scientific System Of Record to join our...  ...systems ensure reproducibility and close the Design-Build-Test-Learn (DBTL) loop.What You'll Be BuildingTechnical... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    1 day ago
  • $185k - $225k

     ...Staff Software Engineer - Payment Solutions United States Opportunity Overview...  ...and modern distributed systems. This is a remote-first...  ...control, and automated testing ~ Strong system design, observability...  ...Suite, anchored by Cohere Validate™, an AI-driven clinical and... 
    Contract work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Cohere Health

    Boston, MA
    5 hours ago
  • $195.2k - $292.8k

     ...civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft,...  ...research and production, our engineers build the data pipelines,...  ...systems. Model Evaluation & Validation – Develop benchmarks, testing methodologies, and... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Worldwide

    Shield AI

    Boston, MA
    5 hours ago
  • $172.5k - $313.7k

     ...of Salesforce. We’re building Systems Integration Agent, announced...  ...computer use dependable raises hard engineering questions. How does an agent...  ..., prototype solutions, and validate results in their environments...  ...bounded technical approach, test it with users, and lead it... 
    Full time

    Salesforce

    Boston, MA
    4 days ago
  •  ...with intelligent systems. Its products include...  ...Hivemind autonomy software, V-BAT and X-BAT...  ..., then integrate, validate, and field it on the...  ...customers. Our engineers write new autonomy...  ...the-loop, to live test exercise.  In this...  ...Growth – Mentor Staff and Senior engineers... 
    Full time
    Temporary work
    Part time
    Work at office
    Worldwide

    Shield AI

    Boston, MA
    8 days ago
  •  ...civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT...  ...platforms, then integrate, validate, and field it on the...  ...Strategic Systems (ACP), engineering leadership, customer/program...  ...integration workflows, testing infrastructure, and... 
    Full time
    Temporary work
    Part time
    Work at office
    Worldwide

    Shield AI

    Boston, MA
    8 days ago
  • $195.2k - $292.8k

     ...civilians with intelligent systems. Its products include Hivemind autonomy software and V‑BAT and X‑BAT...  ...platforms, then integrate, validate, and field it on the...  ...while mentoring engineers and improving engineering...  ...while supporting flight tests, customer demonstrations... 
    Full time
    Temporary work
    Part time
    Work at office
    Worldwide

    Shield AI

    Boston, MA
    5 hours ago
  • $187.53k - $281.3k

     ...Staff Software Engineer, Autonomy Behaviors (R4588) Lead the design and delivery...  ...civilians with intelligent systems. Its products include...  ...integration, hardware, and test engineering to solve some of...  ...implementation, verification, and validation, utilizing tools and... 
    Full time
    Temporary work
    Part time
    Worldwide

    Shield Inc

    Boston, MA
    4 days ago
  • $150k - $190k

     ...experiences. Our systems integrate devices,...  ...areas of Alarm.com's engineering organization:...  ...partners require. A Staff Engineer in this space...  ...hiring a Staff Software Engineer to serve...  ...implementation, validation, and production readiness...  ..., refactoring, test generation, and... 
    Casual work
    Work at office
    Immediate start
    Worldwide
    Shift work

    Alarm Com

    Boston, MA
    1 day ago
  •  ...Our client is seeking a Senior Software Engineer in Test to ensure product quality across a digital...  ...for distributed and microservice-based systems. Due to client requirements,...  ...Proficiency with databases, SQL, data validation, and testing of data workflows. ~ Familiarity... 
    Hourly pay
    Local area

    Eliassen Group

    Boston, MA
    more than 2 months ago
  • $230k - $288k

     ...shaping the future of software analysis and...  ...in your future. Staff Backend Software Engineer Location San Francisco...  ...vulnerabilities, validated by 95% of security reviewers...  ...Security Testing and is trusted by leading...  ...and infrastructure systems to design, build and... 
    Full time
    Currently hiring
    Work at office
    Local area
    Remote work
    Work from home
    Weekend work
    3 days per week

    Semgrep

    Boston, MA
    5 hours ago
  • $195.2k - $292.8k

     ...civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT...  ...program — then integrate, validate, and field it on the real...  ...-in-the-loop, to live test exercise. You'll...  ...'s a hands-on role for engineers who like seeing their code... 
    Temporary work
    Work experience placement
    Work at office
    Worldwide

    Shield AI

    Boston, MA
    5 days ago
  • $70 - $85 per hour

     ...investment management firm is seeking a Software Engineer, Test Automation for a contract opportunity...  ...and reliability across critical systems. This role provides the opportunity to...  ...solutions Experience with ETL process and validating data Strong Windows proficiency... 
    Full time
    Contract work
    Temporary work
    Flexible hours
    3 days per week

    Motion Recruitment

    Boston, MA
    2 days ago
  • $75k - $245k

     ...exploration to biomedical engineering, lives often...  ...Summary:The Software Engineer (SMTS) develops...  ...executes software tests to check...  ...Identify program/system-level technical risks...  ...independently verifying and validating safety critical...  ...system lifecycle. Staff must be able to... 
    Full time
    Local area

    Draper Laboratory

    Somerville, MA
    4 days ago
  • $106.61k - $284.28k

     ...Currently we are hiring a Staff Software Development Engineer with deep, hands‑on...  ...RESTful APIs, and event‑driven systems. While also being...  ...using JSON; ensure robust validation, versioning, and backward...  ...including unit/integration testing, static analysis, artifact... 
    Hourly pay
    Full time
    Temporary work
    Currently hiring
    Local area

    CVS Health

    Milton, MA
    3 days ago
  • $168.6k - $224.8k

     ...Automation organization, the Test Platform Services (TPS) team...  ...and automation that validate SimpliSafe’s end-to-end ecosystem...  ..., firmware, and distributed software systems to ensure our devices behave...  ...production.We are seeking a Software Engineer to lead TPS’s technical... 
    Work at office
    Shift work

    SimpliSafe

    Boston, MA
    5 days ago
  •  ...Software Development / Software Test Engineer (SDE/STE)We are seeking a Software Development / Software Test Engineer...  ...experience to develop robust system software, build automated testing...  ...engineering workflows, debugging, and validation processes.Write production-quality... 

    Kaleidoscope Innovation

    Boston, MA
    4 days ago
  • $198.25k - $237.5k

    General InformationJob TitleAI Engineering Lead, Evals and Systems IntegrationJob ID111330...  ...product team, building software that helps the world’s...  ...systems, systems integration testing, and data problems with...  ...and the Agentic Core, validating that knowledge graph outputs... 
    Full time
    Contract work
    Local area
    Immediate start

    Bain & Company

    Boston, MA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer in Test, Compiler & Systems Validation. Be the first to apply!