Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Performance Engineer (Inference, Training & GPU)

$200k - $300k

WORLD LABS

About World Labs:

We build foundational world models that can perceive, generate, reason, and interact with the 3D world — unlocking AI's full potential through spatial intelligence by transforming seeing into doing, perceiving into reasoning, and imagining into creating. We believe spatial intelligence will unlock new forms of storytelling, creativity, design, simulation, and immersive experiences across both virtual and physical worlds. We bring together a world‑class team, united by a shared curiosity, passion, and deep backgrounds in technology — from AI research to systems engineering to product design — creating a tight feedback loop between our cutting‑edge research and products that empower our users.

Role Overview

We are looking for a Performance Engineer to make World Labs’ models train and serve as fast as the hardware allows.

Running large generative world models at scale is a novel systems problem. You will find the bottlenecks — in kernels, in the serving path, in the training loop, in how we use our GPUs — and eliminate them. Your ownership is technical and concrete: the throughput you unlock, the latency you cut, the utilization you win back, and the correctness you hold while doing it. You will work up and down the stack, from low‑level tensor and kernel optimization to fleet‑wide serving efficiency, in close partnership with the researchers whose models you are accelerating.

This is a hands‑on, individual‑contributor role. You will profile, design, build, and ship code directly.

What You Will Do:

  • Optimize inference and serving end to end — latency, throughput, batching, caching, and scheduling — to serve our models efficiently at production scale.
  • Write and tune GPU kernels (CUDA, Triton) for hot paths; drive kernel fusion, memory- and bandwidth-bound optimization, and low-precision (FP8/INT8) execution.
  • Optimize training throughput and GPU utilization: parallelism strategies, communication/compute overlap, mixed precision, and eliminating pipeline stalls.
  • Build performance models, profiling workflows, and observability that make throughput, latency, cost, utilization, and their tradeoffs legible across the stack.
  • Own numerical correctness across precision, kernel, and hardware changes — treating correctness as part of performance, not separate from it.
  • Partner with researchers to productionize models for serving and to make experiments run faster and more reliably.
  • Where needed, work on the distributed systems that training and inference run on — but the core of the job is squeezing the most out of every GPU.

Key Qualifications:

You should excel at the fundamentals below — we index on inference, serving, GPU optimization, and training performance. Distributed‑systems breadth is welcome, but secondary.

  • Strong performance-engineering foundations: profiling, roofline analysis, latency/throughput optimization, and disciplined root-cause investigation.
  • Deep GPU programming and optimization experience (CUDA and/or Triton) — kernel-level tuning, memory hierarchy, and bandwidth optimization at scale.
  • Hands‑on experience optimizing inference and serving for large models: batching, KV/prompt caching, quantization, and low‑latency, high‑throughput sampling.
  • Hands‑on experience optimizing training performance: parallelism, distributed communication, mixed/low precision, and utilization.
  • Working knowledge of ML framework internals (PyTorch and/or JAX; torch.compile, XLA, or similar compiler paths).
  • Strong proficiency in Python, with the ability to drop into C++/CUDA (and Rust or Go) as the work demands.
  • High‑ownership mindset — you measure yourself by throughput shipped and latency cut, not tickets closed.

Preferred Qualifications:

  • Experience at an AI lab or ML-native company, optimizing systems used directly by researchers and productionizing research code.
  • Low‑precision and numerics depth: FP8/INT8 quantization, mixed-precision, and detecting numerical regressions across hardware platforms.
  • Distributed systems for large-scale training and inference — collective communication (NCCL), interconnects (NVLink), model and tensor parallelism, and fault tolerance. A strong plus, but not a substitute for the core skills above.
  • Experience serving generative, diffusion, video, or 3D/spatial models — not just text LLMs.
  • Multi-accelerator experience (GPU plus TPU or Trainium) and partnering with hardware vendors on accelerator capabilities.
  • Building performance-modeling and observability frameworks for GPU utilization and cost.

Who You Are:

  • Fearless Innovator: We need people who thrive on challenges and aren't afraid to tackle the impossible.
  • Resilient Builder: Impacting Large World Models isn't a sprint; it's a marathon with hurdles. We're looking for builders who can weather the storms of groundbreaking research and come out stronger.
  • Mission-Driven Mindset: Everything we do is in service of creating the best spatially intelligent AI systems, and using them to empower people.
  • Collaborative Spirit: We're building something bigger than any one person. We need team players who can harness the power of collective intelligence.

We're hiring the brightest minds from around the globe to bring diverse perspectives to our cutting‑edge work. If you're ready to work on technology that will reshape how machines perceive and interact with the world, World Labs is your launchpad.

Join us, and let's make history together.

Equal Opportunity & Pay Transparency

Equal Employment Opportunity

World Labs is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, veteran status, or any other characteristic protected under applicable law. We welcome all qualified applicants and are committed to providing reasonable accommodations throughout the hiring process upon request.

California Pay Transparency

  • Pay Range: $200-$300k base salary (good-faith estimate for San Francisco Bay Area upon hire; actual offer based on experience, skills, and qualifications)
  • Total Compensation: Base salary plus equity awards
  • Salary History: We do not request or consider prior compensation in making offers

Compliance: Cal. Lab. Code §432.3 (pay scale disclosure & salary history ban); Cal. Lab. Code §1197.5 (Equal Pay Act); Cal. Gov. Code §12940 (FEHA); 42 U.S.C. §2000e (Title VII); 29 U.S.C. §621 (ADEA); 42 U.S.C. §12101 (ADA)

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Performance Engineer (Inference, Training & GPU) in San Francisco, CA vacancy
  • World Labs in San Francisco is hiring a Performance Engineer to accelerate training and serving of large world models. You will identify bottlenecks across kernels, serving paths, and GPUs, then implement concrete improvements that raise throughput and lower latency. You... 
    Training
    Performance

    WORLD LABS

    San Francisco, CA
    2 days ago
  •  ...act in real time. The Inference team builds the systems...  ...scale. As a Software Engineer on Inference, you’ll...  ...providers to supply capacity, training and inference...  ...quota that keep inference performant and available across...  ...inference. Run models on GPU infrastructure, from... 
    Training
    Performance
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    2 days ago
  • OpenAI in San Francisco is seeking an experienced engineer to architect, build, and scale high-performance distributed training and inference infrastructure for massive LLMs. You will optimize GPU cluster utilization and memory management for multi-node training, partnering... 
    Training
    Performance

    AI Breaking Wire

    San Francisco, CA
    2 days ago
  •  ...hands-on support from AMD engineers the team is scaling...  ...We are looking for a GPU Cluster Engineer to own...  ...our foundation model training teams and our model serving...  ..., well-managed, high-performance infrastructure. Key...  ...Kubernetes for inference workloads — NVIDIA GPU... 
    Training
    Performance
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  •  ...Systems Administrator / DevOps Engineer, you will maintain and...  ...infrastructure behind both our model training and our inference cloud. You’ll split your...  ...throughput, and the performance and reliability of our inference...  ...infrastructure, including GPU management and workload... 
    Training
    Performance
    Work at office
    Remote work
    Relocation package

    Zyphra

    San Francisco, CA
    1 day ago
  • $250k

     ...provider building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is...  .../ Staff Site Reliability Engineer to support and scale large-scale...  ..., scalability, and performance of HPC and cloud infrastructure... 
    Training
    Performance
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...implement, and optimize custom GPU kernels using C++, PTX,...  ...operations for large-scale LLM training and inference. Integrate low-level GPU...  ...runtimes. Develop performance models, identify bottlenecks...  ...researchers, distributed systems engineers, and model-serving teams.... 
    Training
    Performance
    Full time
    Flexible hours

    Sciforium

    San Francisco, CA
    10 days ago
  • Flexion Robotics seeks a senior ML engineer to own GPU compute platforms and optimize training workflows on multi-node clusters. You will collaborate with AI...  ...hands-on experience in large-model training and performance profiling. This is an on-site opportunity in San... 
    Training
    Performance

    Flexion Robotics

    San Francisco, CA
    3 days ago
  •  ...You'll write and optimize the GPU kernels and supporting systems software that makes our training and inference workloads fast. This is deep, low-level work (performance counters, memory bandwidth, warp...  ...use. We hire kernel engineers because the gap between "this... 
    Training
    Performance
    Shift work

    MakerMaker.AI

    San Francisco, CA
    5 days ago
  • $347k

     ...platforms deliver real-world performance aligned with workload needs...  ...Porting & Performance Engineer to evaluate new hardware platforms...  ..., including CPU/GPU, memory, and I/O subsystems...  ...AI/ML workloads, including training or inference systems.Familiarity with GPU... 
    Training
    Performance
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    6 days ago
  • $220k - $260k

     ...what we sense, what we infer, which problems are best...  ...inference graph, and where the performance ceiling really is.Owning...  ..., and honest evaluation.GPU inference in practice: TensorRT engines, batching, fp16, and...  ...is, from cloud training infrastructure down to embedded... 
    Training
    Performance
    Local area
    Night shift

    Atomic

    San Francisco, CA
    5 days ago
  • $220k - $320k

     ...Customer engineering at iframe.ai is not solutions architecture and is not customer...  ...capacity accounts at a time, owning their training and inference performance end-to-end. The same engineers who...  ...-native scale-ups running 256–2048-GPU jobs. 02 Profile distributed... 
    Training
    Performance
    Visa sponsorship
    Flexible hours

    Iframe

    San Francisco, CA
    1 day ago
  • $280k

     ...committed researchers, engineers, policy experts, and...  ...systems problems. As a Performance Engineer, you'll be responsible...  ...-scale ML systems GPU/Accelerator...  ...models to low-precision inference Write a custom load...  ...combination of education, training, and/or experience... 
    Training
    Performance
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  • $300k

     ...GPU Optimisation Engineer — Real-Time Inference Want to push GPU performance to its limits — not in theory, but in production systems handling real-time speech and multimodal workloads? This team is building low-latency AI systems where milliseconds actually matter.... 
    Performance
    Relocation
    Visa sponsorship
    Free visa

    techire ai

    San Francisco, CA
    1 day ago
  •  ...Forward Deployed Engineer (Inference) Location: San Francisco, CA Employment Type: Full-time...  ...scale. About the Role Inference performance depends on far more than selecting a model...  ...-serving infrastructure experience. GPU or accelerator performance optimization... 
    Performance
    Full time

    Acceler8 Talent

    San Francisco, CA
    4 days ago
  •  ...neocloud for alternative chips. Inference is fragmenting: purpose-built...  ...5–7× faster than existing GPU-based competitors. Our...  ...the backlog. As a founding engineer, you'll help decide what we build...  ...deep enough to reason about performance at the hardware level, not just... 
    Performance

    General Compute

    San Francisco, CA
    1 day ago
  •  ...leading investors. Researchers and engineers at Hedra work closely across...  ...Role We’re looking for an Inference Optimization Engineer to work...  ...technique, write a custom GPU kernel, rethink memory...  ...gone unusually deep on model performance, GPU systems, or efficient inference... 
    Performance
    Work at office

    US Health Partners, LLC

    San Francisco, CA
    3 days ago
  •  ...hands-on Vision Systems Engineer to own the detection,...  ...: Develop and train lightweight CNN classifiers...  ...real-time embedded inference via quantization, pruning...  ...validation, and own performance verification against program...  ...on embedded FPGA and GPU platforms... 
    Training
    Performance
    Work experience placement
    Flexible hours

    ETC

    San Francisco, CA
    3 days ago
  • $180k - $235k

     ...a senior Robot Perception Engineer on the Smart Robotics team...  ...deep learning Optimize model inference for GPU deployment, leveraging CUDA...  ...maintain data pipelines for model training, evaluation, and continuous...  ...) C/C++ experience for performance-critical components... 
    Training
    Performance

    Bright Machines

    San Francisco, CA
    2 days ago
  • $140k - $200k

     ...The Sr. Data Infrastructure / Quality Engineering role will play a crucial part in...  ...sensor streams into robust, reproducible training datasets for our AI pipelines....  ...systemsExperience deploying and optimizing high-performance GPU cloud inference services, with specific expertise... 
    Training
    Performance
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    5 days ago
  • $182k - $242k

     ...combines superior infrastructure performance with deep technical...  ...looking for a Senior Storage Engineer, File & Block to help build...  ...storage that our largest AI training and inference workloads and internal...  ...storage from a follower of GPU growth into a multiplier of... 
    Training
    Performance
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    2 days ago
  • Anthropic is seeking a Performance Engineer for its Inference Engine to optimize LLM processing across accelerator and cloud platforms. You will work on...  ...device and across chips. Experience with Rust/C++ and GPU/accelerator programming is essential. The role emphasizes... 
    Performance

    EngineersOfAI

    San Francisco, CA
    2 days ago
  •  ...Machine Learning Systems Engineer (P60) to lead...  ...algorithms with reliable, high-performance infrastructure.Working...  ...scalable systems for training, fine-tuning, and...  ...scale model training, inference pipelines, or search/retrieval...  ...computing, or GPU optimization.Familiarity... 
    Training
    Performance
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    4 days ago
  • SF Tensor is building the fastest GPU compiler and a versatile kernel optimizer...  ...of Technical Staff for GPU Kernel Engineering to push the envelope on what...  ...optimize kernels that execute during pre-training, post-training and inference across NVIDIA, AMD, TPU and Trainium... 
    Training

    SF Tensor

    San Francisco, CA
    2 days ago
  • $157k - $302k

     ...generation of frontier model training and inference workloads.The Hardware...  ...Center Operations, Fleet Health Engineering, Manufacturing, Network...  ...maintain world-class operational performance across rapidly expanding AI...  ...with server platforms, GPU systems, storage infrastructure... 
    Training
    Performance
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    5 days ago
  • The role You'll own the cost and performance of our inference stack. Your work will determine how efficiently...  .... You'll work closely with the engineers operating the serving fleet while...  ...another systems language. Experience with GPU performance, including CUDA, NCCL,... 
    Performance
    Flexible hours

    adaption

    San Francisco, CA
    3 days ago
  •  ...growing group of committed researchers, engineers, policy experts, and business leaders...  ...to build beneficial AI systems. Performance Engineer, Inference Engine About the Role Anthropics inference...  ...of where its abstractions strain GPU/Accelerator programming OS internals... 
    Performance

    EngineersOfAI

    San Francisco, CA
    2 days ago
  •  ...YC and unicorn founders and senior engineers with deep expertise in 3D,...  ...looking for a Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is a highly technical...  ...Working knowledge of GPU hardware (NVIDIA) and the ability... 
    Performance
    Relocation
    Visa sponsorship
    Relocation package

    Reactor

    San Francisco, CA
    2 days ago
  • $300k - $350k

     ...and judgment. We are training frontier models with Inkling...  ...a Site Reliability Engineer (SRE) to keep our post...  ...Own the reliability, performance, and uptime of large-...  ...Experience operating GPU or TPU training clusters...  ..., and mixed training/inference workloads Experience... 
    Training
    Performance
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package
    Shift work

    Thinking Machines Lab Inc.

    San Francisco, CA
    2 days ago
  • $381k

     ...for AI.About the RoleAs an Engineer on our hardware optimization...  ...for programmability and performance. You will work with our kernel...  ...towards efficient training and inference on our models. If you are excited...  ...designDeep understanding of GPU and/or other AI acceleratorsExperience... 
    Training
    Performance
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Performance Engineer (Inference, Training & GPU). Be the first to apply!