Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff, GPU / ML Systems

Full-time

SkyPilot

About SkyPilot

SkyPilot accelerates the world's most ambitious AI teams. SkyPilot turns fragmented AI compute across clusters into one optimized, highly available and easy-to-use pool: a single AI supercomputer.

SkyPilot (10k+ GitHub stars, 18M+ downloads) manages the GPU fleets of 100s of companies, from Fortune 500s to top AI-natives like Abridge, Applied Compute, Mistral, Unconventional AI, H Company, and Nubank, with usage growing exponentially. Born in the UC Berkeley lab behind Spark and Databricks, our growing team includes top-tier talent from Databricks, Google, Berkeley, MIT, CMU, and Cornell. To date, SkyPilot has raised over $20M in seed funding from top investors (incl. Lux, Coatue, Amplify) and operators (incl. Ali Ghodsi, Jeff Dean, Guillermo Rauch, Amjad Masad, Clem Delangue, Aaron Levie).

The role

SkyPilot exists because GPUs are scarce, expensive, and scattered — and the workloads that need them (pre-training, post-training, RL, high-throughput inference) push hardware to its limits. We're looking for an engineer to own the GPU and ML-systems layer that frontier AI teams run on: accelerator scheduling and utilization, the serving path, and the integrations that make SkyPilot the fastest, most cost-efficient place to run demanding AI workloads. A few points of GPU utilization here can save a team millions in compute and days on every training run.

What you'll do

  • Own GPU scheduling, utilization and health : how SkyPilot discovers, packs, and binpacks accelerator capacity across clouds and Kubernetes, with real-time GPU health monitoring and automatic failure recovery.

  • Build optimizations for training and serving : Enable large scale pre-training with node hot-swapping, design storage systems for fast model checkpointing, container migration, inference autoscaling and multi-cluster serving, preemption handling, and sandboxes for training, RL rollouts, and evals.

  • Make the AI stack run great out of the box : deepen integrations with vLLM, PyTorch, Slime, and the frameworks teams use for pre-training and high-throughput inference.

What we're looking for

  • Hands-on experience with GPU or accelerator systems and with ML training or inference infrastructure.

  • Strongly preferred: Familiarity with the modern ML ecosystem (e.g. vLLM, PyTorch, CUDA, verl/slime) and workload-orchestration frameworks (e.g. Kueue, KAI, KServe).

  • You've done real ML-systems performance work - tell us about a bottleneck you hunted down (a stalled data pipeline, GPUs idling on a scheduling gap, communication you overlapped with compute) and what you measured before and after.

  • Strong Python, and comfort reaching into systems-level and GPU-adjacent details.

  • You care about squeezing most from the compute available to you.

  • Experience operating large-scale training or high-throughput inference in production.

What we offer

  • Competitive compensation and equity.

  • Comprehensive medical, dental, vision coverage for you and your dependents.

  • Company 401(k) plan.

  • The chance to work with some of the best minds in cloud, distributed, and AI systems — with significant autonomy and ownership.

  • A front-row seat at the latest open-source infra startup from Berkeley.

  • Gourmet lunch & dinner for the team to do their best work.

Location: San Mateo, CA. Remote will be considered for exceptional candidates.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff, GPU / ML Systems in Remote vacancy
  •  ...ambitious work. Build the systems that make AI inference...  ...cascading layers of GPU RAM, CPU RAM, and NVMe...  ...Bonus: experience with ML inference stacks (vLLM/...  ..., and share as much technical detail about Sail as you...  ...whiteboard with a team member and work through a technical... 
    Suggested
    Full time
    Work at office

    sail

    San Francisco, CA
    4 days ago
  • $200k - $400k

     ...the Role We're looking for a Member of Technical Staff, Product Security with deep infrastructure...  ...the security architecture of the systems that serve them: the inference...  .... Experience securing AI / ML infrastructure, model serving, GPU workloads, or developer platforms... 
    Suggested
    Full time
    Remote work
    Visa sponsorship

    Inferact

    Remote
    12 days ago
  • $150k - $300k

     ...deployment into one full-stack system for post-training at frontier...  ...We're hiring for multiple GPU Infrastructure positions: one...  ...one based in the USA. Core Technical Responsibilities This customer...  ...FSDP, DeepSpeed, Megatron-LM) ML framework optimization and profiling... 
    Suggested
    Remote job
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    4 days ago
  •  ...bring fragmented, heterogeneous GPU capacity together into one...  ...and data infrastructure for AI/ML workloads, including object storage...  ...storage, and distributed file systems for training data and...  ...excellent communication skills across technical and non-technical stakeholders... 
    Suggested
    Full time
    Remote work

    hyperbolic

    San Francisco, CA
    4 days ago
  • $100.9k - $175.4k

     ...hardest problems and providing unmatched technical expertise. As the operator of a...  ...satellite, launch, ground, and cyber systems for defense, civil and commercial customers...  ...a Communications Systems Engineer (Member of Technical Staff/Senior Member of Technical Staff -... 
    Suggested
    Full time
    Immediate start
    Remote work
    Relocation package
    Flexible hours

    Aerospace Corporation

    El Segundo, CA
    1 day ago
  • $200k - $400k

     ...About the Role We're looking for an AMD GPU kernel engineer to make vLLM a first-class...  ...boundary of kernels, compilers, inference systems, and hardware architecture. You'll profile...  ...constraints. Experience optimizing ML kernels such as attention, GEMM, sampling,... 
    Full time
    Remote work
    Visa sponsorship

    inferact

    San Francisco, CA
    4 days ago
  •  ...GitHub stars, 18M+ downloads) manages the GPU fleets of 100s of companies, from Fortune...  ...to own this core end to end, set its technical direction and build new features to make...  ...do Design and build the future of AI systems: you will solve some of the hardest problems... 
    Full time
    Remote work

    SkyPilot

    Remote
    12 days ago
  • $150k - $300k

     ...traverses the physical economy. What You'll Do As a Member of Technical Staff on our Frontier Data team, you'll build the...  ...operate with a lot of autonomy across a wide surface area — systems engineering, ML tooling, and research collaboration — and your judgment... 
    Work at office
    Remote work

    Roboflow

    United States
    1 day ago
  • $130k - $220k

     ...to help them hire. Title of Role: Member of Technical Staff (AI Benchmarking) Location: San Francisco...  ...independent evaluators of frontier AI systems. The company works directly with...  ...(MBB) or technical roles (SWE, ML, TPM, data roles) ~ Strong Python proficiency... 
    Work at office
    Remote work
    Visa sponsorship
    Relocation package

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  • $117k - $175.4k

     ...problems and providing unmatched technical expertise. As the operator...  ...launch, ground, and cyber systems for defense, civil and...  ...to be Successful - Senior Member of the Technical Staff Minimum Requirements:...  ...Experience with applying AI/ML to microwave design problems... 
    Full time
    For contractors
    Work at office
    Immediate start
    Remote work
    Relocation package
    Flexible hours

    Aerospace Corporation

    El Segundo, CA
    1 day ago
  • $200k - $250k

     ...position in Cortex Lab, focused on AI agents and LLM systems that run inside real enterprise workflows. The staff member designs evaluations, benchmarks, and datasets,...  ...evaluation pipelines, experimental tooling, or ML infrastructure Ability to trace agent failures... 
    Full time
    Remote work

    micro1

    Remote
    5 days ago
  • $500 per month

     ...About the Role Our recommendation system doesn't exist yet, and it needs to. We have...  ...that lasts two hours. As our RecSys founding member, you'll own this problem end-to-end - set...  ...of experience in recommendation systems, ML engineering, or applied ML in a consumer context... 
    Full time
    Work at office
    Flexible hours

    astrocade

    Palo Alto, CA
    4 days ago
  • $250k - $300k

     ...they have built a platform that deploys GPU clusters into third-party datacentres at...  ...designing and building high-performance systems spanning storage, networking, virtualisation...  ...Must Have: A track record of impressive technical work you can speak to in depth; the years... 
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...Microsoft’s Venture Fund, and others. Learn more at stuut.ai . The Role We’re hiring a Member of Technical Staff – AI/ML to design, build, and deploy AI-powered systems that solve real-world financial operations challenges. You’ll take state-of-the-art AI... 
    Full time
    Flexible hours

    stuut-ai

    San Francisco, CA
    4 days ago
  • $200k - $400k

     ...infrastructure engineer to build the distributed systems that power inference at global scale. You'...  ...qualifications: Experience with ML serving infrastructure and disaggregated inference...  ...architecture. Familiarity with GPU programming models and memory hierarchies.... 
    Full time
    Remote work
    Visa sponsorship

    inferact

    San Francisco, CA
    4 days ago
  • $175k - $350k

     ...Job Description Job Description Member of Technical Staff - Applied ML Company: Confidential — venture-backed technology company Location:...  ...projects that bring intelligence into production: the systems that help its agents reason, plan and evaluate themselves... 
    Full time
    Work at office
    Visa sponsorship

    Basis

    New York, NY
    3 days ago
  •  ...developers and enterprises who are building AI systems to power magical experiences like content...  ...engineers focused on building reliable ML systems and pushing the boundaries of LLM...  ...advanced performance techniques, including GPU/CUDA optimizations, kernel-level... 
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    New York, NY
    12 days ago
  •  ...Member of Technical Staff, Customer Tools Location: North America Remote / San...  ...one fleet and see what every GPU is doing. Customers then sell...  ...or twenty. Multi-tenant systems: You have built authorization...  ...Candidates May Have ML or HPC infrastructure: Training... 
    Remote job
    Full time

    andromeda

    Remote
    4 days ago
  •  ...internally we have a flat titling system with two types of titles:...  ...We're looking for an ML infrastructure engineer...  ...research teams as a member of ML Platform, and you'll set the technical direction for evals across...  ...experience running large batch GPU workloads on Kubernetes... 
    Remote job
    Full time

    runway-ml

    Remote
    4 days ago
  • $200k - $300k

     ...AI is looking for a highly technical, hands-on MTS, ML Security to join Higgsfield...  ...and own security across our GPU clusters and AI/ML...  ...Harden GPU hosts, operating systems, drivers, container runtimes...  ...Francisco Bay Area . Team members are expected to work from our... 
    Remote job
    Full time
    Work at office
    Worldwide
    3 days per week

    higgsfieldai

    San Francisco, CA
    4 days ago
  • $200k - $320k

     ...Job Title: Member of Technical Staff, Model Training (infra & platform) Job Type...  ...ownership of the distributed systems and platforms that enable researchers...  ...distributed training, GPU infrastructure, inference...  ...Experience with distributed ML frameworks and technologies... 
    Full time
    Local area
    Remote work

    micro1

    United States
    7 days ago
  • $150k - $210k

     ...world-class researchers and clinicians, and we now work with health systems and data partners on large longitudinal datasets: claims, health...  ...what matters and resists shortcuts. B.Sc. or higher in CS, ML, NLP, biomedical informatics or a related field; LLM/NLP... 
    Full time

    GenMD

    Remote
    14 days ago
  •  ...trust-and-safety challenges. You will own technical problems end to end, from analyzing...  ...Build and ship detection models and the systems around them. Evaluate model and system...  ...audio modeling, video or temporal analysis, ML infrastructure, evaluation or calibration... 
    Full time

    Clera

    Remote
    4 days ago
  •  ...tackle, formulate them into benchmarkable ML objectives, build reproducible pipelines,...  ...coach junior researchers by providing technical guidance, rigorous code reviews, and career...  ..., combinatorics) and formal proof systems (Lean, Coq, Isabelle). Demonstrated research... 
    Remote work

    Axiom Math

    United States
    2 days ago
  • $190k - $210k

     ...Member of Technical Staff, Software Engineering, Mosaic Reporting Cognita Imaging Level: Senior...  ..., you will build the full-stack systems behind Mosaic Reporting, Cognita's AI-...  ...lead and partner across engineering, ML, and clinical teams to take the product... 
    Full time
    Remote work

    cognita-imaging

    Palo Alto, CA
    4 days ago
  • $180k - $350k

     ...Query Talent is collecting candidate interest for a Recommendation System Engineer opportunity with a confidential consumer AI company....  ...full-time engineering experience, or a PhD in computer science, ML, information retrieval, recommender systems or a related field plus... 
    Full time
    Internship
    H1b

    Query Talent

    San Francisco, CA
    12 days ago
  •  ...driven by the quality of training data. You'll develop scalable systems that generate, curate, and improve high-quality supervision across...  ..., Physics, or a related field. Experience building ML systems. You've trained preference models, built data pipelines,... 
    Full time
    Relocation
    Visa sponsorship

    intelligence

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...curation and iteration. It matters because client systems get better when problems seen in live use...  ...science, machine learning, AI, or a related technical field Experience designing datasets and evaluation frameworks for ML systems Familiarity with RL environments and... 
    Full time
    Remote work

    micro1

    Remote
    5 days ago
  • $250k - $350k

     ...deep under the hood of our music generation systems, applying computational & human resources...  ...in scientific communication: You relate technical information with rigor and crystal...  ...science & art with a bleeding-edge music ML ecosystem, one-of-a-kind proprietary datasets... 
    Work experience placement
    Flexible hours

    Udio

    Remote
    8 days ago
  •  ...Member of Technical Staff, Provider Tools Location: North America Remote / San Francisco, CA · Full-...  ...Data centers and cloud operators bring GPU clusters to us today through calls, spreadsheets...  ...services in Go, or you have the systems background to ship production Go... 
    Full time
    Remote work

    andromeda

    Remote
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff, GPU / ML Systems. Be the first to apply!