Member of Technical Staff, GPU / ML Systems
SkyPilot
About SkyPilot
SkyPilot accelerates the world's most ambitious AI teams. SkyPilot turns fragmented AI compute across clusters into one optimized, highly available and easy-to-use pool: a single AI supercomputer.
SkyPilot (10k+ GitHub stars, 18M+ downloads) manages the GPU fleets of 100s of companies, from Fortune 500s to top AI-natives like Abridge, Applied Compute, Mistral, Unconventional AI, H Company, and Nubank, with usage growing exponentially. Born in the UC Berkeley lab behind Spark and Databricks, our growing team includes top-tier talent from Databricks, Google, Berkeley, MIT, CMU, and Cornell. To date, SkyPilot has raised over $20M in seed funding from top investors (incl. Lux, Coatue, Amplify) and operators (incl. Ali Ghodsi, Jeff Dean, Guillermo Rauch, Amjad Masad, Clem Delangue, Aaron Levie).
The role
SkyPilot exists because GPUs are scarce, expensive, and scattered — and the workloads that need them (pre-training, post-training, RL, high-throughput inference) push hardware to its limits. We're looking for an engineer to own the GPU and ML-systems layer that frontier AI teams run on: accelerator scheduling and utilization, the serving path, and the integrations that make SkyPilot the fastest, most cost-efficient place to run demanding AI workloads. A few points of GPU utilization here can save a team millions in compute and days on every training run.
What you'll do
Own GPU scheduling, utilization and health : how SkyPilot discovers, packs, and binpacks accelerator capacity across clouds and Kubernetes, with real-time GPU health monitoring and automatic failure recovery.
Build optimizations for training and serving : Enable large scale pre-training with node hot-swapping, design storage systems for fast model checkpointing, container migration, inference autoscaling and multi-cluster serving, preemption handling, and sandboxes for training, RL rollouts, and evals.
Make the AI stack run great out of the box : deepen integrations with vLLM, PyTorch, Slime, and the frameworks teams use for pre-training and high-throughput inference.
What we're looking for
Hands-on experience with GPU or accelerator systems and with ML training or inference infrastructure.
Strongly preferred: Familiarity with the modern ML ecosystem (e.g. vLLM, PyTorch, CUDA, verl/slime) and workload-orchestration frameworks (e.g. Kueue, KAI, KServe).
You've done real ML-systems performance work - tell us about a bottleneck you hunted down (a stalled data pipeline, GPUs idling on a scheduling gap, communication you overlapped with compute) and what you measured before and after.
Strong Python, and comfort reaching into systems-level and GPU-adjacent details.
You care about squeezing most from the compute available to you.
Experience operating large-scale training or high-throughput inference in production.
What we offer
Competitive compensation and equity.
Comprehensive medical, dental, vision coverage for you and your dependents.
Company 401(k) plan.
The chance to work with some of the best minds in cloud, distributed, and AI systems — with significant autonomy and ownership.
A front-row seat at the latest open-source infra startup from Berkeley.
Gourmet lunch & dinner for the team to do their best work.
Location: San Mateo, CA. Remote will be considered for exceptional candidates.
- ...ambitious work. Build the systems that make AI inference... ...cascading layers of GPU RAM, CPU RAM, and NVMe... ...Bonus: experience with ML inference stacks (vLLM/... ..., and share as much technical detail about Sail as you... ...whiteboard with a team member and work through a technical...SuggestedFull timeWork at office
$200k - $400k
...the Role We're looking for a Member of Technical Staff, Product Security with deep infrastructure... ...the security architecture of the systems that serve them: the inference... .... Experience securing AI / ML infrastructure, model serving, GPU workloads, or developer platforms...SuggestedFull timeRemote workVisa sponsorship$150k - $300k
...deployment into one full-stack system for post-training at frontier... ...We're hiring for multiple GPU Infrastructure positions: one... ...one based in the USA. Core Technical Responsibilities This customer... ...FSDP, DeepSpeed, Megatron-LM) ML framework optimization and profiling...SuggestedRemote jobFull timeWork at officeVisa sponsorshipRelocation packageFlexible hours- ...bring fragmented, heterogeneous GPU capacity together into one... ...and data infrastructure for AI/ML workloads, including object storage... ...storage, and distributed file systems for training data and... ...excellent communication skills across technical and non-technical stakeholders...SuggestedFull timeRemote work
$100.9k - $175.4k
...hardest problems and providing unmatched technical expertise. As the operator of a... ...satellite, launch, ground, and cyber systems for defense, civil and commercial customers... ...a Communications Systems Engineer (Member of Technical Staff/Senior Member of Technical Staff -...SuggestedFull timeImmediate startRemote workRelocation packageFlexible hours$200k - $400k
...About the Role We're looking for an AMD GPU kernel engineer to make vLLM a first-class... ...boundary of kernels, compilers, inference systems, and hardware architecture. You'll profile... ...constraints. Experience optimizing ML kernels such as attention, GEMM, sampling,...Full timeRemote workVisa sponsorship- ...GitHub stars, 18M+ downloads) manages the GPU fleets of 100s of companies, from Fortune... ...to own this core end to end, set its technical direction and build new features to make... ...do Design and build the future of AI systems: you will solve some of the hardest problems...Full timeRemote work
$150k - $300k
...traverses the physical economy. What You'll Do As a Member of Technical Staff on our Frontier Data team, you'll build the... ...operate with a lot of autonomy across a wide surface area — systems engineering, ML tooling, and research collaboration — and your judgment...Work at officeRemote work$130k - $220k
...to help them hire. Title of Role: Member of Technical Staff (AI Benchmarking) Location: San Francisco... ...independent evaluators of frontier AI systems. The company works directly with... ...(MBB) or technical roles (SWE, ML, TPM, data roles) ~ Strong Python proficiency...Work at officeRemote workVisa sponsorshipRelocation package$117k - $175.4k
...problems and providing unmatched technical expertise. As the operator... ...launch, ground, and cyber systems for defense, civil and... ...to be Successful - Senior Member of the Technical Staff Minimum Requirements:... ...Experience with applying AI/ML to microwave design problems...Full timeFor contractorsWork at officeImmediate startRemote workRelocation packageFlexible hours$200k - $250k
...position in Cortex Lab, focused on AI agents and LLM systems that run inside real enterprise workflows. The staff member designs evaluations, benchmarks, and datasets,... ...evaluation pipelines, experimental tooling, or ML infrastructure Ability to trace agent failures...Full timeRemote work$500 per month
...About the Role Our recommendation system doesn't exist yet, and it needs to. We have... ...that lasts two hours. As our RecSys founding member, you'll own this problem end-to-end - set... ...of experience in recommendation systems, ML engineering, or applied ML in a consumer context...Full timeWork at officeFlexible hours$250k - $300k
...they have built a platform that deploys GPU clusters into third-party datacentres at... ...designing and building high-performance systems spanning storage, networking, virtualisation... ...Must Have: A track record of impressive technical work you can speak to in depth; the years...Full timeRemote work- ...Microsoft’s Venture Fund, and others. Learn more at stuut.ai . The Role We’re hiring a Member of Technical Staff – AI/ML to design, build, and deploy AI-powered systems that solve real-world financial operations challenges. You’ll take state-of-the-art AI...Full timeFlexible hours
$200k - $400k
...infrastructure engineer to build the distributed systems that power inference at global scale. You'... ...qualifications: Experience with ML serving infrastructure and disaggregated inference... ...architecture. Familiarity with GPU programming models and memory hierarchies....Full timeRemote workVisa sponsorship$175k - $350k
...Job Description Job Description Member of Technical Staff - Applied ML Company: Confidential — venture-backed technology company Location:... ...projects that bring intelligence into production: the systems that help its agents reason, plan and evaluate themselves...Full timeWork at officeVisa sponsorship- ...developers and enterprises who are building AI systems to power magical experiences like content... ...engineers focused on building reliable ML systems and pushing the boundaries of LLM... ...advanced performance techniques, including GPU/CUDA optimizations, kernel-level...Full timeWork at officeRemote workFlexible hours
- ...Member of Technical Staff, Customer Tools Location: North America Remote / San... ...one fleet and see what every GPU is doing. Customers then sell... ...or twenty. Multi-tenant systems: You have built authorization... ...Candidates May Have ML or HPC infrastructure: Training...Remote jobFull time
- ...internally we have a flat titling system with two types of titles:... ...We're looking for an ML infrastructure engineer... ...research teams as a member of ML Platform, and you'll set the technical direction for evals across... ...experience running large batch GPU workloads on Kubernetes...Remote jobFull time
$200k - $300k
...AI is looking for a highly technical, hands-on MTS, ML Security to join Higgsfield... ...and own security across our GPU clusters and AI/ML... ...Harden GPU hosts, operating systems, drivers, container runtimes... ...Francisco Bay Area . Team members are expected to work from our...Remote jobFull timeWork at officeWorldwide3 days per week$200k - $320k
...Job Title: Member of Technical Staff, Model Training (infra & platform) Job Type... ...ownership of the distributed systems and platforms that enable researchers... ...distributed training, GPU infrastructure, inference... ...Experience with distributed ML frameworks and technologies...Full timeLocal areaRemote work$150k - $210k
...world-class researchers and clinicians, and we now work with health systems and data partners on large longitudinal datasets: claims, health... ...what matters and resists shortcuts. B.Sc. or higher in CS, ML, NLP, biomedical informatics or a related field; LLM/NLP...Full time- ...trust-and-safety challenges. You will own technical problems end to end, from analyzing... ...Build and ship detection models and the systems around them. Evaluate model and system... ...audio modeling, video or temporal analysis, ML infrastructure, evaluation or calibration...Full time
- ...tackle, formulate them into benchmarkable ML objectives, build reproducible pipelines,... ...coach junior researchers by providing technical guidance, rigorous code reviews, and career... ..., combinatorics) and formal proof systems (Lean, Coq, Isabelle). Demonstrated research...Remote work
$190k - $210k
...Member of Technical Staff, Software Engineering, Mosaic Reporting Cognita Imaging Level: Senior... ..., you will build the full-stack systems behind Mosaic Reporting, Cognita's AI-... ...lead and partner across engineering, ML, and clinical teams to take the product...Full timeRemote work$180k - $350k
...Query Talent is collecting candidate interest for a Recommendation System Engineer opportunity with a confidential consumer AI company.... ...full-time engineering experience, or a PhD in computer science, ML, information retrieval, recommender systems or a related field plus...Full timeInternshipH1b- ...driven by the quality of training data. You'll develop scalable systems that generate, curate, and improve high-quality supervision across... ..., Physics, or a related field. Experience building ML systems. You've trained preference models, built data pipelines,...Full timeRelocationVisa sponsorship
$200k - $250k
...curation and iteration. It matters because client systems get better when problems seen in live use... ...science, machine learning, AI, or a related technical field Experience designing datasets and evaluation frameworks for ML systems Familiarity with RL environments and...Full timeRemote work$250k - $350k
...deep under the hood of our music generation systems, applying computational & human resources... ...in scientific communication: You relate technical information with rigor and crystal... ...science & art with a bleeding-edge music ML ecosystem, one-of-a-kind proprietary datasets...Work experience placementFlexible hours- ...Member of Technical Staff, Provider Tools Location: North America Remote / San Francisco, CA · Full-... ...Data centers and cloud operators bring GPU clusters to us today through calls, spreadsheets... ...services in Go, or you have the systems background to ship production Go...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member of Technical Staff, GPU / ML Systems. Be the first to apply!



