Platform Test Engineer - Build Resilient AI Testing Tools
US Health Partners, LLC
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Baseten is seeking talented and experienced Software Engineers to join our Platform team within the Infrastructure organization. As a member of Baseten's Platform Team, you will own the systems that let every engineer at Baseten prove their code works before it reaches production. Our product runs mission-critical AI inference for customers who measure downtime in dollars per second, which means our internal bar for correctness, performance, and failure tolerance has to be exceptional.
Your focus is the full testing stack: fast and reliable unit test tooling, integration harnesses that spin up realistic environments on demand, load and performance testing for GPU-backed inference workloads, and resilience testing that deliberately breaks things so our customers never have to find out what happens when a node dies mid-request. This is a builder role with org-wide leverage. You won't be writing tests for other teams — you'll be building the frameworks, harnesses, and feedback loops that make writing good tests the path of least resistance, and you'll set the standards for what "well-tested" means at Baseten.
RESPONSIBILITIES
Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against.
Build and maintain unit, integration, load and performance testing frameworks
Design end to end test infrastructure that provisions realistic dependencies on demand — ephemeral Kubernetes namespaces, containerized service dependencies, etc.
Build resilience and chaos testing capabilities: fault injection, network partition and latency simulation, pod and node failure scenarios, dependency degradation, and automated verification that our systems degrade gracefully and recover.
Attack test suite reliability head-on — flake detection and quarantine, test impact analysis and selective execution, parallelization, and aggressive reduction of end-to-end CI wall time.
Build observability into the testing layer itself: coverage reporting, test health dashboards, failure triage tooling, and clear signals about which areas of the codebase are under-tested.
Create project templates and shared libraries so new services start with a complete testing setup on day one.
Partner directly with product and infrastructure teams — embed where needed, understand their hardest testing problems, and turn one-off solutions into platform capabilities.
Mentor engineers across the org on testing practice and raise the collective bar through code review, documentation, and internal advocacy.
REQUIREMENTS
Strong proficiency in Go and/or Python, with hands-on experience building test tooling and libraries used by other engineers.
Deep experience with testing frameworks and their internals — pytest, Go's testing package, testify, testcontainers, or equivalents — including the ability to extend them, not just use them.
Experience designing integration test infrastructure for distributed systems, including ephemeral environment provisioning and dependency management.
Practical experience with load and performance testing tools (k6, Locust, Vegeta, JMeter, Gatling, or similar) and the judgment to interpret results and drive action from them.
Solid Kubernetes and Docker fundamentals — you can build test infrastructure that runs on and tests against real cluster environments.
Advanced understanding of CI/CD, including how to keep large test suites fast, deterministic, and trustworthy at scale.
A track record of measurably improving testing culture on an engineering team — you have opinions on what to test, what not to test, and where the ROI actually is.
Are excited about building foundational infrastructure and are comfortable working independently on ambiguous, high-impact technical challenges
BENEFITS
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
#J-18808-Ljbffr- Baseten is hiring a Software Engineer focused on testing within the Platform team. You will own the... ...-end testing strategy, building unit, integration, load,... ...for a mission-critical AI inference platform. You... ...infrastructure, implement resilience and chaos testing, and...Suggested
- ...the RoleThe VP, Platform Engineering is the senior-most... ...This leader owns AI Infrastructure, DevOps... ..., enterprise Testing, Database... ...executive leadership to build the platforms, guardrails... ..., and shared tooling—while advancing... ..., and production resilience across the...SuggestedFull timeContract workWork at officeLocal areaRemote workRelocationFlexible hours
- ...work execution platform for industrial... ...design an asset, build it, run it,... ...looking for an Engineering Director to lead... ...engineer builds on: AI Builder, DevOps, Compliance, Testing Frameworks,... ...orchestration, tool registry, and developer... ...big wins and resilience. #J-18808-...Suggested
- ...About Liberate Liberate builds AI agents to automate manual tasks... ...seasoned Staff DevOps and Platform Engineer to own and evolve the... ...resource utilization. CI/CD, Tooling, and Developer Experience... ...related components of SOC2, pen-testing, and Vanta-driven controls....SuggestedFor contractorsRemote work
$127k - $184k
...value of Google Cloud Platform across the... ...Experience with cloud engineering, on-premise engineering... ...Analytics, Cloud AI, Networking,... ...execution).Experience building long-term... ...vectors, penetration testing).As a Platform Customer... ...technology, and tools that help developers...Suggested$165k - $247k
Amplitude is the leading AI analytics platform, helping over 4,700... ...NBCUniversal, and Square—build better products and... ...platform, teams can analyze, test, and optimize user... ...that every Amplitude engineer relies on every day to... ...platform. Design tooling and workflows that help...Shift work$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where... ...Cloud & DevOps Engineer, Senior Member... ...), to design, build, automate, and... ...and production platforms. You will work... ...using tools such as Terraform... ...automated build, test, deployment,... ...fault tolerance, resiliency, service...Full time- ...life sciences industry, building the platform that helps the world’s largest... ...faster. The Commercial Tools team is building the... ...As a Services Platform Engineer you'll ship real, cutting-edge AI features to production fast... ...keep it solid: own the tests, CI and observability...Work at officeLocal areaRemote workWork from home
- ...we're not just a platform; we're a trusted partner... ..., release and test automation, and... ...that lets all of engineering ship safer, faster... ...a multiplier: we build paved roads and enable... ...build the systems and tooling that raise the... ...leveraging agentic / AI-assisted software...Bank staffWork at officeLocal areaNight shift2 days per week3 days per week
$189k - $236k
...nationwide and are building a workplace that... ...Rewards philosophy.AI is a fundamental part... ...engage with AI tools relevant to their... ...re hiring seasoned engineers to join our teams that work on core platform capabilities, improving... ..., building, and testing large-scale...Full timeWork at officeLocal areaRemote work2 days per week3 days per week$197.3k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where... ...SummaryDesign, build, and maintain... ..., APIs, data-platform automation, and... ...to build the tooling, "paved paths,"... ....Software engineering fundamentalsOOP... ...failure modes.Testing (unit, integration... ...scalable, resilient, and loosely coupled...Full time$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans... ....Lead Software Engineer - Platform ServicesAt... ...online. We are building a unified digital... ..., secure, and resilient platform servicesDrive... ...system design, testing, observability,... ...development tools to improve engineering...Full time$164k - $236k
...physical operations with tools to make their work... ...industry leading AI, the Motive platform gives you complete visibility... ...the RoleAs a Staff Engineer on the Developer... ...spearhead the effort to build systems and... ...fast, robust automated testing.Improve the performance...Temporary workWork experience placementLocal area- ...Summary Design, build, and maintain... ...services, APIs, data-platform automation, and AI platform / agent... ...is to build the tooling, "paved paths,"... ...Backend engineering ~15+ years designing... ...modes. Testing (unit, integration... ...horizontally scalable, resilient, and loosely...
$270.4k - $365k
...: GroqMetal is building the infrastructure platform that turns large-scale... ...customer-consumable AI infrastructure. This... ...part of a software engineering team. You will lead... ...on: Write, review, test, debug, and operate... ...: Experience using tools such as Codex, Claude...Work at officeLocal areaRemote work- ...research. Together, we are building the world’s most efficient sequencing engine that operates overnight... .... We're looking for a Platform Engineer to build and... ...APIs through proactive testing, AI‑assisted red teaming,... ...with new technologies, tools, and approaches. Is...WorldwideNight shift
$164k
About the RoleAs a mobile platform engineer, you'll help shape the... ...Chime's React Native app, building the infrastructure and tooling that make development faster... ...working alongside AI.You'll thrive in this role... ...mobile quality practices and testing frameworks. #LI-Onsite #LI...Full timeWork at officeLocal areaRemote work- ...Staff Platform Software Engineer Location: San Francisco, CA – Hybrid -In Office... ...and local regression/HITL testing systems, and the in-vehicle... ..., profiling, debugging tooling, build toolchains) is well-architected... ...responsible use of modern AI tooling to improve speed...Work at officeLocal areaImmediate startRemote workFlexible hours3 days per week
$167.7k - $245.2k
...Experience Assurance platform that empowers... .... Leveraging AI and an... ...Site Reliability Engineer (SRE), you will... ...You will deploy resilient AWS cloud-native... ...CNCF-standard tools—such as Kubernetes... ...deployment, chaos testing, and "... ...GoShown ability to build and implement scalable...Full timeTemporary workWork at officeLocal areaFlexible hours- ...seeking a hands-on Staff Platform Engineer to do three things at once: build the golden roads and... ...design and deliver our AI-enabled capabilities. This... ...adopted and enforced by tooling, not just written down),... ...evaluations, regression testing, groundedness checks, and...Flexible hoursShift work
$144k - $216k
Amplitude is the leading AI analytics platform, helping over 4,700... ...NBCUniversal, and Square—build better products and... ...platform, teams can analyze, test, and optimize user... ...Salesforce Platform Engineer to support the scaling... ...change sets or devops tooling, and ensure integrity...Contract work$195k - $265k
...rebuilding biotech for the AI era.When a... ...is the AI platform for biotech R&D. Scientists... ...0 biopharma.We’re building an AI scientist... ...to reference any tools, platforms, or workflows... ...AI & Data Engineering, a small autonomous... ...Stand up the CI/CD, testing, and deployment infrastructure...Work at officeLocal areaFlexible hours3 days per week$186.9k - $267.7k
...The Splunk Agent Resilience team is... ...the future of AI resilience. Our... ...Staff Software Engineer on the Data & Scalability Platform team, you will... ...transform it, and tooling proving how all... ...standards other teams build against, own... ...tooling — load testing, profiling, and...Full timeTemporary workWork at officeLocal areaImmediate startFlexible hours- ...leading investors, we’re building the category-defining AI automation platform that healthcare teams... ...workers with world-class tools that deliver real, measurable... ...Frontend UX Platform Engineer to shape the foundations... ..., performance, testing, and frontend maintainability...Full timeWork at officeRemote workFlexible hours2 days per week
$203k - $275k
...jobs Staff Back End Engineer, Platform San Francisco, CA... ...industry by building an AI platform for wealth professionals... ...systems and creating tooling used across all... ...highly distributed and resilient systems in our AWS and... ...Employ automated testing practices to ensure high...Work at officeImmediate start3 days per week$221k - $258k
...backs bold entrepreneurs building the future through... ...technology companies, across AI, bio + healthcare,... ...a Senior IT & AI Platform Engineer to build, deploy, and... ...including evaluating, testing, and deploying new capabilities... ..., going beyond such tools as ChatGPT/Codex,...Work at office3 days per week- ...envelope to enhance, build, and deliver top-... ...Senior Lead Software Engineer at JPMorgan Chase... ...Sector, Infrastructure Platforms team, you are an... ...wide frameworks, tools, and practices within... ...optimized for AI and machine learning... ...application development, testing, and operational...For contractors
- Notion is seeking an experienced software engineer to build and maintain foundational tools, APIs, and platform experiences that make the Notion developer platform extensible... ...and performance of the developer platform, using AI tools to enhance workflows and drive impact. #J-...
$180k - $240k
...agents ubiquitous. We build the foundation for agent engineering in the real world,... ...to production-ready AI agents that teams can... ...adopted open-source tools and have grown to also offer a platform for building, evaluating... ...tokens, versioning, testing, and component discovery...Work at officeRemote workFlexible hours- ...Sciforium is an AI infrastructure company... ...efficiency serving platform. Backed by multi-million... ...support from AMD engineers the team is scaling rapidly to build the full stack... ...maintainable code with strong testing and documentation... ...with GPU profiling tools Contributions to...Work at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Platform Test Engineer - Build Resilient AI Testing Tools. Be the first to apply!
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA
- drive test engineer San Francisco, CA
- vehicle test engineer San Francisco, CA
- test engineer San Francisco, CA
- senior test engineer San Francisco, CA


