Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - ML Systems & Inference

Acceler8 Talent

Member of Technical Staff - ML Systems & Inference Join a well-funded AI infrastructure startup building the orchestration layer for next-generation AI workloads This role sits at the intersection of ML systems, inference, distributed systems, and performance engineering. You'll build production inference systems, optimize scheduling and memory management, improve KV cache efficiency, and work closely with compiler, kernel, and distributed systems engineers to push AI infrastructure forward We're looking for engineers with: Strong software engineering fundamentals Experience with ML inference or model serving Knowledge of distributed systems and performance optimization Python and/or C++ Experience with vLLM, TensorRT-LLM, CUDA, or similar is a plus This is an opportunity to help define how AI workloads are executed at scale alongside a world-class engineering team Interested? Apply or message me directly #J-18808-Ljbffr Acceler8 Talent

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - ML Systems & Inference in San Francisco, CA vacancy
  •  ...first heterogeneous neocloud for AI workloads. As AI systems scale, the industry is hitting fundamental limits...  ...-class AI datacenters. Gimlet Labs is seeking a Member of Technical Staff focused on ML systems and inference. In this role, you will design and build the inference... 
    Suggested

    Gimlet Labs

    San Francisco, CA
    1 day ago
  • $225k

     ...domain‑specific RL, ultra‑long context, and inference‑time compute to achieve this goal. About...  ...Software Engineer on the Inference & RL Systems team, you will design and operate the...  ...debugging performance issues in production ML systems Ability to reason about system‑level... 
    Suggested
    Relocation
    Visa sponsorship

    Magic

    San Francisco, CA
    4 days ago
  • $150k - $300k

     ...spanning cloud LLM serving, LLM inference optimization and RL systems. You will be working on...  ...RL training stack. Core Technical Responsibilities LLM...  ...Required Experience Building ML Systems at Scale: 3+ years...  ...development and encourage team members to contribute to the... 
    Suggested
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Prime Intellect

    San Francisco, CA
    3 days ago
  • Member of Technical Staff — ML Systems & Inference Employment Type: Full-time Workplace: On-site About the Company We are building the execution layer for the next generation of AI infrastructure. As AI workloads scale and hardware architectures diversify, the bottleneck... 
    Suggested
    Full time

    Acceler8 Talent

    San Francisco, CA
    14 hours ago
  • Member of Technical Staff, ML Infrastructure & Inference Overview We are a cutting-edge AI infrastructure company building a scalable cloud platform designed...  ...machine learning workloads ($80M series A). As AI systems continue to grow in complexity, traditional infrastructure... 
    Suggested

    Acceler8 Talent

    San Francisco, CA
    3 days ago
  • $225k

     ...domain-specific RL, ultra-long context, and inference-time compute to achieve this goal. About...  ...a Software Engineer on the Pre-training Systems team, you will design and operate the...  ...debugging cross-layer issues in production ML systems Strong ownership mindset and ability... 
    Relocation
    Visa sponsorship

    Dormont Manufacturing Co

    San Francisco, CA
    3 days ago
  • $200k - $400k

     ...The Role We're looking for an inference runtime engineer to push the...  ...Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang,...  ...maintainable code and debug in complex ML codebases. Preferred...  ...etc). Written widely-shared technical blogs or side projects on... 
    Remote work
    Visa sponsorship
    Shift work

    Inferact

    San Francisco, CA
    1 day ago
  •  ...immensely competitive market. Build the systems that make AI inference fast, reliable, and cost-efficient at...  ...is a must. Bonus: experience with ML inference stacks (vLLM/SGLang), GPUs/...  ...about your experience, and share as much technical detail about Sail as you want to hear... 
    Work at office
    Immediate start

    Sail Research

    San Francisco, CA
    3 days ago
  •  ..., we build general-purpose AI systems that run efficiently across deployment...  .... The Opportunity Our Edge Inference team compiles Liquid...  ...You will work directly with the technical lead on problems that require deep understanding of both ML architectures and hardware constraints... 

    Bold Capital Partners

    San Francisco, CA
    3 days ago
  •  ...Pixeltable Inc. Member of Technical Staff San Francisco, CA·Full time Apply for...  ...allowing data scientists and ML engineers to focus on...  ...training/fine-tuning, and inference? You will also: Find opportunities...  ...related field 5+ years of systems engineering experience in an... 
    Full time
    Part time
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Pixeltable, Inc.

    San Francisco, CA
    3 days ago
  •  ...neural networks within simulations Stay current on state-of-the-art ML compilers—such as those in torch, Triton, and JAX—and decide...  ...source projects and participate actively in the broader compiler and systems community What You’ll Bring Strong background in compiler... 

    Genesis AI

    San Francisco, CA
    14 hours ago
  • $150k

     ...robotic intelligence. As a Member of Technical Staff, you’ll spearhead the development...  ...models, efficient model inference, and video tokenization....  ...integration with production systems. Drive technical...  ...record of successful production ML deployments. Experience with... 
    Local area

    Amazon Science

    San Francisco, CA
    2 days ago
  • $250k

     .... The team is small, technical, and moving fast, with...  ...: AI Tools. The Role Member of Technical Staff who can handle...  ...everything from modeling to systems to product, taking...  ...evaluate, and work with ML models in real-world...  ...pipelines for training, inference, and data processing... 
    Full time

    David Joseph & Company

    San Francisco, CA
    4 days ago
  •  ...that are unimportant, reducing inference costs for scale-ups and...  ...research and product focus. As a Member of Technical Staff on our infrastructure team, you'll own the cloud systems that serve our compression...  ...latency, high-throughput GPU ML inference infra that sits in... 
    Visa sponsorship

    The Token Company

    San Francisco, CA
    2 days ago
  • $120k - $250k

    Job Title Member of Technical Staff, Infrastructure Salary $120K - $250K + Equity Company Description...  ...models, they drastically reduce inference costs for high‑scale enterprises...  ...building global, low-latency GPU ML inference systems that sit directly in the critical path... 
    Visa sponsorship

    Jack & Jill

    San Francisco, CA
    2 days ago
  •  ...some of the most demanding inference workloads in the world. About...  ...the company. As an early member of the engineering team, you will help define the systems, standards, and technical culture behind a new class...  ...Experience optimizing ML inference, model serving, or... 

    Acceler8 Talent

    San Francisco, CA
    2 days ago
  • $200k - $400k

     ...Rauch. About the Role As a Member of Technical Staff, Model Evaluations at...  ...will build the measurement systems that determine whether our...  ...workflows, or systems that help ML teams decide where to focus...  ...Bayesian modeling, causal inference, psychometrics, polling, or... 
    Flexible hours

    Simile

    San Francisco, CA
    14 hours ago
  •  ...opportunity We are looking for a Member of Technical Staff with deep expertise in...  ...into production systems that deliver scientific value...  ...you are You are a strong ML researcher with experience...  ...architectures, training dynamics and inference behaviour. You are a skilful... 
    Flexible hours

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • # Founding Member of Technical Staff, AI Infrastructure**Location:** San Francisco...  ...easier to own by turning inference behavior, traces, workload...  ...through ambiguity, learn new systems quickly, and turn rough...  ...Experience with inference or ML infrastructure.* Exposure to... 
    Full time
    Remote work

    Touchdown Labs, Inc.

    San Francisco, CA
    2 days ago
  • $150k - $350k

    Sieve — Member of Technical Staff, Applied Research Type: Full-time | On-site | San Francisco...  ..., parallelism, pipelining, inference optimization, and occasional...  ...questions to production systems Tech stack: Python, PyTorch (or similar ML frameworks) Requirements 3+ years... 
    Full time
    Work experience placement
    H1b
    Work at office
    Visa sponsorship

    davidjoseph-co

    San Francisco, CA
    4 days ago
  • Member of Technical Staff - Post‑Training Join to apply for the Member of Technical...  .... About The Role Build systems that transform powerful pre...  ...learning algorithms, and inference‑time scaling techniques. Collaborate...  ...diving into complex ML codebases and distributed... 
    Full time
    Relocation package

    Reflection AI

    San Francisco, CA
    3 days ago
  • $300k

    Member of Technical Staff - RL Infrastructure About V max V max is an applied research...  ...learning. We are building systems to exceed humans in all...  ..., training orchestration, inference, evals, data pipelines, observability...  ...researchers and applied ML engineers to run, debug,... 
    Work at office
    Local area

    Vmax

    San Francisco, CA
    4 days ago
  • $220k

    We build and run the inference engine behind every Perplexity query and deploy dozens of model...  ..., CUTLASS, or similar). Any other deep systems programming experience is a plus. You understand...  ...for you. Good if you touched any of ML compilers and framework internals:... 

    Perplexity

    San Francisco, CA
    3 days ago
  • Member of Technical Staff - Agents at Prime Intellect - San Francisco Building the...  ...: Architect and maintain systems that support distributed AI...  ...infrastructure. Nice to Have GPU/ML Infrastructure :...  ...optimize agent training or inference on GPUs. Advanced AI/ML Knowledge... 
    Remote work
    Flexible hours

    Victrays

    San Francisco, CA
    14 hours ago
  •  ...what cutting edge means. We're hiring Members of Technical Staff to design the evaluations that set the...  ...design and execute projects to evaluate AI systems and technologies, including developing...  ...or BCG X AI and Machine Learning — ML Engineers, AI Engineers, Technical PMs... 

    Artificial Analysis Inc

    San Francisco, CA
    2 days ago
  • Member of Technical Staff - Product Engineering The Product Engineering team builds...  ...it. That surface is remote inference and the inference client,...  ...featurized, validated data in our system, and to a checkpoint they...  ...first, so a robotics or ML research background is not required... 
    Remote work

    Physical Intelligence

    San Francisco, CA
    2 days ago
  •  ...operations for spin and superconducting‑qubit systems, turning raw cryogenic hardware into...  ...of science. Role Overview As a Member of Technical Staff you will shape Conductor's core...  ...for data collection, labelling, and inference. Integrate with external systems for... 

    Conductor Quantum

    San Francisco, CA
    14 hours ago
  • Member of Technical Staff - Applied Research Patronus AI is a frontier lab developing simulation research...  ...research that defines how agentic AI systems are trained, evaluated and improved....  ...reproducible research code in Python and modern ML frameworks. Ability to execute... 

    Patronus AI, Inc.

    San Francisco, CA
    1 day ago
  •  ...Anthropic and beyond. About the Role Build systems that transform powerful pre-trained...  ..., reinforcement learning algorithms, and inference-time scaling techniques. Collaborate across...  ...skills, comfortable diving into complex ML codebases and distributed systems. Experience... 
    Relocation package

    Reflection

    San Francisco, CA
    1 day ago
  •  ...is bringing the rigor of distributed systems, model architecture, and numerics research...  ...to defend. About the Role As a Member of Technical Staff, Mechanistic Interpretability at Radical...  ...dimensional data. Contributions to open‑source ML research, interpretability tooling, or... 
    Local area

    Radical Numerics

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - ML Systems & Inference. Be the first to apply!