Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff — Inference Infrastructure

Full-time

causal

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.

 

To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.

 

Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.

We look for infrastructure engineers who are excited to tackle unsolved problems. Progress on an LPM is gated by how fast we can evaluate it: large-scale backtesting against decades of physical observations, ensemble generation, and rollout evaluation across model scales.

Responsibilities

Your mission is to make inference so fast and cheap that evaluation never gates research.

  • Build high-throughput inference systems for large-scale evaluation, backtesting, and scoring against historical physical observations

  • Design and implement techniques that improve latency, throughput, and efficiency for real-time inference

  • Optimize the inference stack to fully utilize hardware FLOPs, bandwidth, and memory

  • Extend orchestration frameworks (e.g. Kubernetes, Ray, Slurm) for distributed inference and large-batch evaluation sweeps

  • Establish standards for reliability, observability, and reproducibility across the inference stack, so every evaluation is trustworthy and repeatable

  • Collaborate with researchers to enable high-performance inference for novel architectures as they emerge

What we're looking for

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

  • Experience building or optimizing inference and serving systems for throughput and latency (e.g. TensorRT)

  • Understanding of distributed compute, GPU parallelism, and hardware-aware optimization

  • Deep familiarity with deep learning frameworks (e.g. PyTorch, JAX) and their underlying system architectures

  • Strong engineering skills: performant, maintainable code and the ability to debug complex codebases

  • Bonus: contributions to open-source inference or systems infrastructure (e.g. vLLM, SGLang, Triton)

Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff — Inference Infrastructure in San Francisco, CA vacancy
  •  ...better. We’re not developing drugs of our own. We’re building the infrastructure for the people who do. We’re looking for an infrastructure...  ...core infrastructure, data systems, and the training and inference stack, making these systems reliable, efficient, and easy to... 
    Suggested
    Local area

    Warp Sciences

    San Francisco, CA
    3 days ago
  •  ...responsibility to defend. About the Role As a Member of Technical Staff, Inference at Radical Numerics, you will build and optimize the...  ...deployment. You will work closely with research, infrastructure, and external partners to ensure our models can be efficiently... 
    Suggested
    Full time
    Local area

    radical-numerics

    San Francisco, CA
    7 hours ago
  •  ...recognize parts of inputs that are unimportant, reducing inference costs for scale-ups and enterprises that integrate...  ...people with a research and product focus. As a Member of Technical Staff on our infrastructure team, you'll own the cloud systems that serve our compression... 
    Suggested
    Full time
    Visa sponsorship

    the-token-company

    San Francisco, CA
    7 hours ago
  •  ...About This Role You’ll lead the platform’s backend and infrastructure, working directly with the CEO, who currently runs the backend...  ...including recommendation systems, model fine-tuning, and the inference pipeline Own production reliability through monitoring with... 
    Suggested
    Full time
    For contractors
    H1b
    Work at office
    Visa sponsorship

    Cephas Consultancy Services Private Limited

    San Francisco, CA
    2 days ago
  • $200k - $300k

     ...own models and runs its own inference, so far more of its stack...  ...consumer-scale traffic on infrastructure a very small team builds...  ...machine, fix the cause, and own technical decisions on a small team...  ...Key Details Title: Member of Technical Staff – Backend & Infrastructure... 
    Suggested
    Full time
    For contractors
    H1b
    Work at office
    Visa sponsorship

    David Joseph & Company

    San Francisco, CA
    a month ago
  • $250k

     ...building the next generation of agentic infrastructure for GPU-intensive workloads....  ...opportunity offers the chance to join as a Member of Technical Staff at a pivotal stage in the company's...  ...on orchestration intelligence, inference gateways, and agentic operations tooling... 
    Permanent employment
    San Francisco, CA
    more than 2 months ago
  •  ...interactive applications. We develop the infrastructure that enables intelligent systems to...  .... The Role We are hiring a Member of Technical Staff to lead reinforcement learning...  ...distributed training or high-throughput inference systems Familiarity with... 
    Full time

    embedding-vc

    San Francisco, CA
    7 hours ago
  •  ...designed for fast, efficient AI inference. We combine large-scale compute infrastructure with an execution platform...  ...companies, giving our team access to technical problems spanning frontier...  .... About the role As a Member of Technical Staff focused on ML Systems, you... 
    Full time

    gimlet

    San Francisco, CA
    7 hours ago
  •  ...world-class team with deep infrastructure and payments DNA to build...  ...shifts. One customer cut inference costs by 75% off the back...  ...recruiter screen, then a technical screen. If those go well,...  ...engineering team carries the title Member of Technical Staff internally. #J-18808-... 
    Shift work

    Precision Labs

    San Francisco, CA
    1 day ago
  • $200k - $300k

     ...Job Description Job Description Member of Technical Staff Company: Confidential — AI cloud on a mission to maximize...  ...per watt, using AI to optimize AI infrastructure. It serves serverless and dedicated inference for open-source LLMs at the best performance... 
    Full time
    Internship
    H1b
    Work at office
    Overseas
    Visa sponsorship

    Transparent Search Group

    San Francisco, CA
    a month ago
  • $200k - $400k

     ...Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster...  ...the Role We're looking for a hands-on supercomputing infrastructure engineer to own and operate the high-performance compute infrastructure... 
    Full time
    Remote work
    Visa sponsorship

    inferact

    San Francisco, CA
    7 hours ago
  • $200k - $400k

     ...mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by...  ...Contributions to open-source ML or system infrastructure projects. Bonus points if you have:...  ..., etc). Written widely-shared technical blogs or side projects on vLLM or LLM inference... 
    Full time
    Remote work
    Visa sponsorship
    Shift work

    inferact

    San Francisco, CA
    7 hours ago
  • $300k - $400k

     ...end. The Role We are looking for an engineer to own the inference systems that power our models in production and research. You'll work across the full inference stack, from serving infrastructure down to hardware-level optimization. Some example areas you might... 
    Full time

    mirendil

    San Francisco, CA
    7 hours ago
  • $300k - $400k

     ...own models end-to-end. The Role We are looking for an Infrastructure Engineer to own the compute and cloud foundation that...  ...scheduling, autoscaling, and multi-tenant isolation Training and inference infrastructure - understand the resource and scheduling demands... 
    Full time

    mirendil

    San Francisco, CA
    7 hours ago
  •  ...power AI. For neocloud, we turn GPU capacity into productive infrastructure that delivers lasting value and accelerate their time to market...  ...to build with you. About the Role We're looking for an Inference Engineer to build inference capabilities on top of Forge, our... 
    Full time

    hyperbolic

    San Francisco, CA
    7 hours ago
  • $150k - $300k

     ...the open superintelligence stack: the infrastructure frontier AI labs build internally, made...  ...region and one based in the USA. Core Technical Responsibilities This customer-...  ...deployment strategies for LLM training, inference, and HPC workloads Present architectural... 
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    5 hours ago
  •  ...About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous...  ...starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at... 
    Full time
    Immediate start
    Remote work

    modal

    San Francisco, CA
    7 hours ago
  •  ...the world's most efficient software for inference (processing LLM tokens) and agent hosting...  ...these! Great interpersonal and technical communication. Please don't use LLMs to...  ...Share an online whiteboard with a team member and work through a technical problem. We... 
    Full time
    Work at office

    sail

    San Francisco, CA
    7 hours ago
  •  ...Job Description – Member of Technical Staff (Inference) Location: San Francisco, CA (on-site, 5 days a week, in our San Francisco office) About Artificial Analysis Artificial Analysis is the leading independent AI benchmarking company. We support labs, engineers... 
    Full time
    Work at office
    Shift work

    artificialanalysis

    San Francisco, CA
    7 hours ago
  •  ...Perplexity is looking for a technical program manager to be the connective tissue between...  ..., and product teams, driving our core inference platform forward. Perplexity runs one...  ..., across performance engineering, infrastructure, and product teams Lead cross-functional... 
    Full time
    Shift work

    perplexity

    San Francisco, CA
    7 hours ago
  • $300k

     ...About the role This role is for strong infrastructure engineers who can build the systems...  ...distributed rollouts, training orchestration, inference, evals, data pipelines, observability,...  ..., platforms, or services used by other technical users. Strong judgment around... 
    Work at office
    Local area

    Vmax

    San Francisco, CA
    6 hours ago
  •  ...-silicon neocloud designed for fast, efficient AI inference. We combine large-scale compute infrastructure with an execution platform that partitions AI workloads...  ...AI-native companies, giving our team access to technical problems spanning frontier models, production... 
    Full time

    gimlet

    San Francisco, CA
    7 hours ago
  • $275k

     ...scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal. About the role As...  ...sits at the boundary between model execution and distributed infrastructure. You will work on systems that determine inference latency,... 
    Full time
    Relocation
    Visa sponsorship

    magic.dev

    San Francisco, CA
    7 hours ago
  • $275k - $315k

     ...amount of untrusted, freshly generated kernels on real silicon, quickly and safely, which is why we're hiring a Member of Technical Staff for Sandbox Infrastructure to build the layer that makes it possible: a serverless GPU container service across NVIDIA, AMD, TPU and... 
    Full time
    Work at office
    Relocation
    Relocation package

    sf-tensor

    San Francisco, CA
    7 hours ago
  • $250k - $300k

     ...next step in your career? Join one of the most interesting infrastructure companies in the AI space right now. Founded by two of the most...  ...Skills / Must Have: A track record of impressive technical work you can speak to in depth; the years matter less than the... 
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...Member of Technical Staff, Science Our mission is to advance humanity's ability to engineer biology...  ...your network and internal talent infrastructure. You have either (1) deep...  ...engineers on large-scale computing and AI inference infrastructure to evaluate models and... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    LatchBio

    San Francisco, CA
    4 days ago
  • $250k - $300k

     ...development? Join one of the most exciting AI infrastructure companies in the market, building a...  ...next-generation AI training and inference at scale. This role offers the opportunity...  ...Have: ~ A track record of impressive technical work you can speak to in depth, the... 
    Permanent employment
    Remote work
    San Francisco, CA
    more than 2 months ago
  • $200k - $300k

     ...just moving fast, but rewriting what fast looks like. Role Overview Higgsfield AI is looking for a hands-on Member of Technical Staff, Infrastructure Security to build, secure, and operate the systems that protect our corporate infrastructure, employee devices,... 
    Work at office
    Remote work
    Worldwide
    3 days per week

    Higgsfield

    San Francisco, CA
    23 days ago
  •  ...models, LLM-augmented retrieval, evaluation systems, agentic search, and high-performance AI infrastructure. About the role We are looking for a Member of Technical Staff to work across research, engineering, product, and customer-facing technical initiatives.... 

    Mixedbread

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...workforces with 1000x the output. Orpex is building the infrastructure they run on: agentic workforce, company brain, human trust...  ...wrong. You'll ship to production in your first week. As a Member of Technical Staff, you’ll be responsible for building, refining, and... 
    Relocation
    Visa sponsorship

    Orpex

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff — Inference Infrastructure. Be the first to apply!