Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Inference

Full-time

genesis

What You’ll Do

  • Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics

  • Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization

  • Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks

  • Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)

  • Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks

What You’ll Bring

  • Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)

  • Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)

  • Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling

  • Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments

  • System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Inference in San Carlos, CA vacancy
  • $196.72k - $236.48k

     ...field, or equivalent practical experience. Preferred Qualifications • Rail-optimized network design for distributed training or inference. • Embedded, remote, power-constrained, or radiation-exposed networking experience. • Switch or adapter firmware, FPGA, kernel-driver... 
    Suggested
    Permanent employment
    Work at office
    Local area
    Remote work
    Relocation package

    Aetherflux

    San Carlos, CA
    2 days ago
  • $170.6k - $213.3k

     ...) and containerization (Docker), enough to read, debug, and extend existing workflows. AWS or GCP for large‑scale ML training and inference. Patents, peer‑reviewed publications, or conference presentations. A desire to work in a fast‑paced environment where a small team... 
    Suggested
    For contractors
    Immediate start
    Worldwide

    Natera

    San Carlos, CA
    3 days ago
  •  ...Build machine learning models for robotics control end-to-end: data curation, careful evaluation, model architecture, training/inference stacks, rigorous experiments Collaborate with simulation and real-world robotics teams to curate high-quality, diverse, and large... 
    Suggested
    Full time

    genesis

    San Carlos, CA
    8 days ago
  • $250k - $350k

     ...scale up World Model training. Simply: more tokens in = more tokens out! ML Infrastructure Own the distributed training and inference systems that keep GPUs fully utilized. Increase the throughput during training, and speed of inference, to supercharge the model’s... 
    Suggested
    Full time
    Local area

    1x

    San Carlos, CA
    8 days ago
  •  ...across the team. What You’ll Do Own the production embedded vision stack, including camera capture, media pipelines, model inference, tracking, pre- and post-processing, device services, and cloud interfaces. Design software for real-world operation: constrained... 
    Suggested
    Remote job
    Full time
    Local area

    Obvio

    San Carlos, CA
    8 days ago
  • Senior/Staff Level Inference Engineer We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism... 
    Work at office
    3 days per week

    Makers Fund

    Palo Alto, CA
    2 days ago
  • $160.36k - $240.54k

    Software Engineer, ML Inference Platform Mountain View, California (HQ) Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $177k - $270k

     ...Foundation models, VLMs, and VLAs to make autonomous driving as seamless as possible. The Opportunity Are you excited to drive our ML Inference Optimization initiatives and make our ML models that enable autonomous driving as fast and efficient as possible? You will get to... 
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  • $250k - $300k

    About the job Senior Machine Learning Engineer, Inference Senior Machine Learning Engineer, Inference Job Summary For our client, a fast-growing AI company building realtime voice and LLM technology, we are looking for a Senior Machine Learning Engineer with strong expertise... 
    Permanent employment
    Full time
    Contract work
    H1b
    Local area
    Remote work
    Relocation
    Relocation package

    AIDA projektai

    Mountain View, CA
    2 days ago
  • $180k

    Software Engineer, RL Inference SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate... 
    Temporary work

    Xai

    Palo Alto, CA
    2 days ago
  •  ...Runtime Stand up and operate model endpoints using AWS Bedrock and/or SageMaker; evaluate when to use ECS/EKS, Lambda, or Batch for inference jobs. Build and maintain application services that call LLMs through clean APIs, with streaming, batching, and backoff... 
    Permanent employment
    Full time
    Local area
    Remote work
    3 days per week

    beaconai

    San Carlos, CA
    3 days ago
  •  ...and asynchronous workflows with attention to concurrency, fault tolerance, observability, and maintainability. Integrate model inference, retrieval systems, and external data services into production applications. Build and operate containerized workloads and cloud... 
    Permanent employment
    Full time
    Local area
    Remote work
    3 days per week

    Beacon AI

    San Carlos, CA
    3 days ago
  • About Inworld Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Hundreds of... 
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    2 days ago
  •  ...and the Middle East. We are creative, low-ego and team-spirited. About the role As a Partner Manager, you will work with inference providers to support the adoption and growth of Mistral AI models on their platforms. Key responsibilities include : Own end... 
    Full time
    Relocation package

    mistral.ai

    Palo Alto, CA
    8 days ago
  • $230k - $350k

     ...Job Description Job Description About the Role Join a small AI systems team building a high-performance inference platform from the ground up. You will shape the runtime architecture and improve how large language models are served across GPUs and nodes. What You... 
    Visa sponsorship

    Wintermeyer Ventures

    Palo Alto, CA
    5 days ago
  • $230k - $350k

     ...Job Description Job Description Member of Technical Staff, Inference Systems Company: Confidential — founded by Stanford alumni with deep AI infrastructure experience Location: Palo Alto, CA (on-site 5 days per week) Compensation: $230,000 - $350,000 + competitive... 
    Full time
    H1b
    Visa sponsorship

    Transparent Search Group

    Palo Alto, CA
    5 days ago
  • $160.36k - $240.54k

     ...components.  Develop observability to track ML model lifecycles from data generation to on-road validation. Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and validate... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    12 days ago
  • $160k - $250k

     ...more useful products, and what we learn from people using those products shapes what we build next. SOFTWARE ENGINEER, TRAINING/INFERENCE (C++) At SpaceXSI we are building the high-performance inference platform that serves Grok to millions of users every day. As a Software... 
    Temporary work

    SpaceXSI

    Palo Alto, CA
    17 days ago
  •  ...and scalable cloud experience—free from vendor lock-in and designed for the next generation of AI workloads. The Senior/Staff Inference Reliability Engineer will own the end-to-end reliability and production performance of customer inference workloads. This role sits... 
    Full time

    parasail

    San Mateo, CA
    8 days ago
  •  ...models have to run fast enough to control robots in the real world, and efficiently enough to support large-scale research. As an Inference Infrastructure Engineer Intern, you'll work with our infra and research engineers to make model inference faster and more efficient... 
    Internship

    rhoda-ai

    Mountain View, CA
    8 days ago
  •  ...This ownership spans from low-level environment simulators and custom communication primitives to our distributed training loops and inference engines. We are seeking engineers who view existing libraries as a baseline and the hardware speed itself as the true target.... 
    Full time

    Harmonic

    Palo Alto, CA
    8 days ago
  •  ...with edge/cloud hybrid deployment patterns and the latency constraints that come with them Familiarity with on-robot or embedded inference environments Experience with large-scale cluster topology and scheduling systems (e.g., SLURM, Ray, Volcano) Why This Role... 
    Full time

    rhoda-ai

    Mountain View, CA
    8 days ago
  •  ...ABOUT THE ROLE We’re seeking an inference systems engineer to build the distributed serving and high-performance networking layer behind our large language models. You will own the path from model server to GPU fabric: prefill/decode disaggregation, KV-cache transfer... 
    Full time
    Work at office

    Hippocratic%20AI

    Menlo Park, CA
    8 days ago
  • $200k - $400k

     ...an infrastructure engineer to design, optimize, and scale the systems that serve our large multimodal models. Your work will make inference faster, more cost-effective, and more reliable, so our teams can focus on advancing model capabilities rather than managing bottlenecks... 
    Remote job
    Full time
    Visa sponsorship
    Work visa
    Relocation package

    elorian-ai-inc

    Palo Alto, CA
    8 days ago
  •  ...models, VLMs, and VLAs to make autonomous driving as seamless as possible.    The Opportunity Are you excited to drive our ML Inference Optimization initiatives and make our ML models that enable autonomous driving as fast and efficient as possible? You will get to... 
    Full time

    zoox

    Foster, CA
    1 day ago
  •  ...growing fleet of robots is expensive. We can't rely on one hardware vendor or the most expensive accelerators. We're looking for an Inference Optimization engineer to make Rhoda's models run fast, correctly, and cheaply on a wide range of hardware: AMD Instinct GPUs,... 
    Full time

    rhoda-ai

    Mountain View, CA
    8 days ago
  • $200k - $400k

     ...About the Role RadixArk is looking for a Member of Technical Staff — TPU Systems to build high-performance inference and training systems using JAX, XLA, and Pallas. You'll push model workloads to their limits on TPU hardware, working on SGLang-JAX and other critical... 
    Full time

    radixark

    Palo Alto, CA
    8 days ago
  • $213k - $263k

     .... In this hybrid role, you will report to the Head of ML Platform- Senior Staff Software Engineer. You will: Develop Waymo's inference platform to make it scalable, high throughput, and low latency Work closely with other teams across Waymo in hosting both internal... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    5 days ago
  • $147.2k - $224k

     ...complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and... 

    Nebius

    Palo Alto, CA
    5 days ago
  • $200k - $400k

     ...About the Role RadixArk is seeking a Member of Technical Staff - Inference-Multi-Hardware to push the limits of performance for frontier AI systems. Most performance engineering assumes a single vendor's stack. This role assumes none. You'll bring up, optimize, and... 
    Full time

    radixark

    Palo Alto, CA
    8 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Inference. Be the first to apply!