Member of Technical Staff, Production Site Reliability Engineer
$200k - $400kinferact
Overview
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
About the Role
We're looking for a Site Reliability Engineer to make Inferact's vLLM-powered inference services dependable in production. You'll work alongside the engineers building the platform, bringing a reliability perspective to how systems are designed, shipped, and operated. This is a hands-on engineering role for someone who thinks about failure before launch, simplifies operations, and writes software that makes reliable inference possible at scale.
You'll help own reliability across the production lifecycle, from release safety and observability to incident response and recovery. You'll define SLOs around availability, latency, and successful inference requests; build monitoring that helps engineers pinpoint failures; and automate recurring operational work. When incidents occur, you'll drive mitigation, coordinate escalation, and lead post-mortems that result in concrete prevention work. You'll also partner with engineering on capacity planning and operational readiness so the platform can grow without becoming harder to operate.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, systems, infrastructure, or similar.
Hands-on experience building or operating production distributed systems, cloud infrastructure, or services where reliability has meaningful user or business impact.
Strong programming or scripting ability in Python, Go, Bash, or similar, with experience building tools and automation that solve operational problems.
Experience responding to significant production incidents, including mitigation, root cause analysis, escalation, and following corrective actions through to completion.
Practical understanding of service-level objectives (SLOs), service-level indicators (SLIs), error budgets, and alerting that distinguishes user-impacting failures from noise.
Strong Linux, networking, and systems debugging fundamentals, with the ability to investigate failures across application and infrastructure boundaries.
Clear communication, sound judgment under pressure, and the ability to work with engineering teams to identify failure modes and make systems simpler to operate.
Preferred qualifications:
Experience supporting AI inference, model serving, ML infrastructure, GPU workloads, or other latency-sensitive, high-throughput services.
Experience deploying, operating, and debugging Kubernetes-based services, with familiarity with Docker, Terraform, or comparable infrastructure tooling.
Experience building observability with metrics, logs, traces, dashboards, and actionable alerts across distributed systems.
Experience improving deployment safety and recovery through automation, testing, release gates, and rollback procedures.
Experience with resource scheduling, capacity planning, or workload isolation in multi-tenant cloud or GPU environments.
Bonus points if you have:
Owned reliability for an inference service or other mission-critical platform through a period of significant growth.
Built automation that measurably reduced operational toil, improved recovery time, or prevented repeat incidents.
Established practical SLOs, post-mortem processes, or production-readiness reviews that helped engineering teams ship with greater confidence.
Logistics
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: We offers generous health, dental, and vision benefits as well as 401(k) company match.
Inferact, Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish .
$200k - $400k
...to grow vLLM as the world's AI inference engine and accelerate AI progress by making... ...About the Role We're looking for a Site Reliability Engineer to make Inferact's vLLM-powered inference services dependable in production. You'll work alongside the engineers building...SuggestedFull timeRemote workVisa sponsorship$150k - $220k
# Founding Member of Technical Staff (MTS)Bay Area, CAFull-time$150k-$220k + equity##... ...software. We provide the production layer that turns AI-... ...a blend of MLE + backend engineering with a strong customer empathy... ...measurable signals and reliable services.**Note:** Unlike...Suggested- ...and every enterprise deployment runs on production infrastructure owned by the Cloud... ...workloads. We're looking for SREs who treat reliability as a software problem. You'll own compute... ...under bursty, fast-growing load. Engineer the network. Design and operate VPC architectures...SuggestedFull time
$200k - $400k
...society are often pushed straight to production. Simile is changing that. We have... ...to run. About the Role As a Member of Technical Staff in ML Systems, you will build the platform... ...we run. We are looking for engineers who find it gratifying to see their work...SuggestedFull timeLive inFlexible hours$175k - $240k
...run by scientists and engineers from leading... ...About the Role As a Member of Technical Staff (Full-stack, Backend... ...features from concept to production, understanding how systems... ..., and building reliable foundations that accelerate... ...Regular team off-sites and company events...SuggestedFull timeWork at office- ...analyst would. They follow leads across company sites, public records, and social platforms, cross-... ...bar, and everything we ship has to hold up at production scale. If the whiteboard is your favorite part of engineering, you'll like it here. What You’ll Work On...Full timeWork at officeNight shift
$197.3k - $313.7k
...efforts. Job Category Software Engineering Job Details About... ...organization. As a Principal Member of Technical Staff (PMTS) / Staff Software... ...volume engineering toil into reliable, supervised autonomous... ...remediation, and routine production maintenance. Continuous...Full time- ...back so recommendations work in practice. Human Computer Interaction Design just-in-time, generative interfaces to make production legible and deliver clear recommendations. Who We’re Looking For People who can ship to messy, dynamic environments and are...
$180k - $260k
...AI And ML Engineer Profound is the fastest-growing AI marketing... ...to deployment, partner across product and engineering, and turn real... ...communication with both technical and non-technical partners... ...Location This is an on-site role based in our NYC or SF office...Work at office- ...it; 100+ pull requests per engineer per week is no longer an... ...live graph of your entire production system (code, CI, cloud, and... .... THE ROLE As a Member of the Technical Staff, you build the system that... ...opinions about how to make them reliable. - Curiosity about how...Remote jobFull time
- ...Onsite in Menlo Park, CA Site Reliability Engineering (SRE) is a discipline that... ...systems. Our SREs ensure our production systems' reliability,... ...make a reasoned judgment. Technical Skills Experience in any of... ...900k developer community members, 1,700 employees, more than...Immediate startRemote workWorldwide
$250k - $300k
...everything from A100 to GB300. As part of the engineering team, you'll help shape a platform that operates at production scale, supporting real customers and solving... .../ Must Have: A track record of impressive technical work you can speak to in depth; the years matter...Full timeRemote work- ...Description As an ML Infrastructure Engineer at Trajectory, you will develop algorithms... .... Inference Optimize serving for production agents and training rollouts. Improve batching... ...researchers to turn new algorithms into reliable systems across training, inference, and...Full time
- ...to create their own products. Plaid powers the tools... ...tooling that help engineering teams develop,... ...every product team.As a Staff Site Reliability Engineer on Release... ...This is a hands-on technical leadership role where... ...always looking for team members that will bring...Permanent employmentWork experience placementLocal area
- ...experienced operators across supply chain, production planning, engineering and more, simulate the consequences... ...-1 U.S. venture firms, and board members of global industrial companies.... ... THE ROLE As a Member of Technical Staff , you'll build the system that decides...Full timeRelocation
- ...Job Description As a Member of Technical Staff (Research) at Trajectory, you will design and build the post‑training stack that lets our customers’ models continually learn from real production workflows. You will own end‑to‑end experiments across data, training, and...Internship
$250k
...Member of Technical Staff Inference performance depends on how efficiently models... ...is running in a customer's production traffic. At Wafer, we... .... Our forward deployed engineers run customer deployments day... ...How we work On-site in San Francisco, five days...Full timeWork at officeVisa sponsorshipRelocation package$250k
...opportunity offers the chance to join as a Member of Technical Staff at a pivotal stage in the company's... ...tooling that underpin a live production environment serving real customers.... ...customers without hiding it from the engineers who need to debug it You will be building...Permanent employment$200k - $400k
...often pushed straight to production. Simile is changing that... ...About the Role As a Member of Technical Staff, Model Evaluations at Simile... ...product evaluation, research engineering, and related fields. Your... ...and Measurement: Build reliable systems for collecting and...Full timeFlexible hours- ...often pushed straight to production. Simile is changing that... ...Role As a Data Products - Member of Technical Staff, you will build the... .... We are looking for engineers who can bridge cutting-edge... ...be secure, auditable, and reliable by construction, while staying...Full timeInternshipFlexible hours
- ...previously built and scaled products at category leaders... ...opportunity As our Founding Member of Technical Staff (MTS) , you will define,... ...implementation to production reliability for mission-critical... ...downtime # Implementation Engineering – Embed with customers, collect...Full time
- ...Member of Technical Staff, Forward Deployed At Wafer, we are building AI systems... ...of Technical Staff are the engineers our customers work with.... ...customer from first benchmark to production, and keep their workloads... .... How we work On-site in San Francisco, five days...Full timeWork at officeVisa sponsorshipRelocation package
- ...make that possible in production, we work on every... ...of researchers and engineers from MIT, Stanford,... ...The Role As a Member of Technical Staff at Phonic, you'll work... ...AI capabilities into reliable, production-grade systems... ...We have regular off-sites and team...Full timeWork at officeShift work
$150k - $300k
...continuously improving production models. We are... ...the jobs. Core Technical Responsibilities... ...We're looking for engineers who are fluent across... ...conferences. ~ Team off-sites and conference attendance... ...development and encourage team members to contribute to the broader...Remote jobFull timeWork at officeLocal areaVisa sponsorshipRelocation packageFlexible hours- ...Member of Technical Staff: AI Research & Engineering in Media Integrity About Synhawk Synhawk builds omnimodal... ...gapped environments, and strict production SLAs. Your work with us will... ...working under real latency and reliability constraints. But no pressure....Remote jobFull timeInternshipImmediate startShift work
$150k - $300k
...continuously improving production models. We are... ...software engineering role spanning product... ...capabilities into reliable product features... ...improvements Technical Requirements Strong... .... ~ Team off-sites and conference... ...and encourage team members to contribute to...Full timeWork at officeVisa sponsorshipRelocation packageFlexible hours$200k - $400k
...are often pushed straight to production. Simile is changing... ...largest customers. Platform & Reliability: Developing the CI/CD... ...SLOs) that empower our entire engineering org to ship safely. About... ...: Ability to write clear technical specs for both internal teams...Full timeFlexible hours$180k - $290k
...public benchmarks and run in production in some of the world's... ...separated into “research” or “engineering.” A promising architecture only... .... The common thread is deep technical ownership: you should be able... ...Improve the performance, reliability, and numerical stability of...Full timeWork at office2 days per week- ...native audio. To make that possible in production, we work on every layer of the stack: data... ...We’re a small team of researchers and engineers from MIT, Stanford, CMU, MosaicML, Citadel... ..., and vision We have regular off-sites and team celebrations 401(k) – Let us...Full timeWork at office
- ...infrastructure company. Our products are used by leading businesses... ...forming a world-class team of engineers, designers, marketers,... ...layers that make it fast and reliable to query, and establishing the... ...organization dedicated to solving technical and creative problems. We...Full timeWork at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff, Production Site Reliability Engineer. Be the first to apply!
- helpdesk support technician San Francisco, CA
- tech assistant San Francisco, CA
- technical support assistant San Francisco, CA
- technical analyst San Francisco, CA
- desktop support analyst San Francisco, CA
- user support analyst San Francisco, CA
- support technician San Francisco, CA
- product support technician San Francisco, CA
- mri tech aide San Francisco, CA
- technical support analyst San Francisco, CA




