Senior Platform Engineer — GPU Inference & Training
Neura Market
Perplexity is building a self-serve compute platform that lets inference engineers run training jobs and inference services without worrying about GPU provisioning or cluster configuration. You will own the platform surface and drive reliability, observability, and performance across workloads. You’ll manage the Kubernetes for GPU orchestration, multi-cloud GPU fleets, and capacity planning, aiming for a seamless experience that hides complexity behind a unified platform and scalable #J-18808-Ljbffr Neura Market
- ...company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on...SeniorTraining
- Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable systems for model experimentation, training, evaluation, inference, and retraining powering underwriting and ML-driven...SeniorTraining
- United States Digital Space LLC is seeking an infrastructure leader to own a self-serve GPU compute platform for training and inference workloads. You will design and operate the system that lets researchers launch jobs across multi-cloud GPU fleets without manual provisioning...Training
$245k - $295k
...us at Crusoe.About the RoleWe are seeking a Senior Manager, Infrastructure Platform Engineering to lead a team building core systems that turn... ...with the operational challenges of GPU clusters, AI training, and inference workloadsWorking knowledge of platform security...SeniorTrainingTemporary workImmediate start- ...technology products.As a Senior Lead Software Engineer at JPMorgan Chase... ..., Infrastructure Platforms team, you are an integral... ..., and skillsFormal training or certification on... ..., ML training, and inference.Experience with... ...understanding of NVIDIA GPU infrastructure software...SeniorTrainingFor contractors
$250k
...infrastructure provider building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is developing a... .... The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC...SeniorTrainingFull timeRemote work$190k - $215k
...motivated and skilled Senior Customer Success... ...production AI inference workloads and understands... ..., model serving platforms, LLM deployments, AI agents, or GPU-based inference... ...with the product and engineering teams to define... ...infrastructure trends.Customer Training: Deliver training...SeniorTrainingFull timeTemporary work$187k
...role Chime’s Machine Learning Platform (MLP) team builds and... ...enable data scientists and ML engineers to develop, train, deploy, and monitor models... ...feature computation, real-time inference, and experimentation. You’... ...and RayExperience with GPU programming(CUDA) and GPU costs...SeniorTrainingFull timeWork at officeLocal areaRemote work$220k
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience...Senior$295k - $405.5k
...FaireFaire is a technology wholesale platform built on the belief that the... ...join ours.About this roleAs the Senior Staff Machine Learning Platform Engineer, you will own the technical... ...of Faire’s ML platform including training, inference, feature management, governanceEstablish...SeniorTrainingWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$220k - $320k
inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques...Senior$194k - $239k
...Hover Infrastructure Engineer Hover helps... ...scaled infrastructure platforms before, and you... ...services do, from LLM inference and agent runtimes... ...to vector stores, GPU economics, and... ...This role is the senior technical partner... ...cost of management training, conferences, workshops...SeniorTrainingFull timeFor contractorsWork at officeLocal areaFlexible hours- Lantern is seeking a Machine Learning Engineer to scale the core ML platform behind our product, handling data ingestion, model training, and generation of customer recommendations... ...pipelines from data ingestion through inference to monitoring in production. Based in San...SeniorTrainingWork at office
$300k
...startup building an AI and cloud platform, powered by thousands of H100s... ..., full-scale model training, or inference. Our client operates high-performance GPU clusters powering some of the... ..., tune, and operate inference engines such as vLLM, SGLang, and TensorRT...SeniorPermanent employmentWorldwide$167.2k - $209k
...DigitalOcean is seeking a Senior Engineer 2 to play a key technical role in our AI Inference Optimization team.... ...inference engine and GPU kernel layers, ensuring... ...features," ensuring our platform is both powerful and... ...relevant conferences, training, and education. All employees...SeniorTrainingLocal areaRemote workWorldwideFlexible hours- ...for serving models in production and driving large-scale post-training workflows. You will work where model execution meets distributed... ...training loops. You will own the infrastructure enabling fast inference and scalable RL iteration, balancing KV-cache strategies,...SeniorTraining
- MakerMaker in San Francisco seeks a senior research engineer to advance efficiency in ML models, focusing on... ...quantization, speculative decoding, and efficient training-time techniques. The role blends model architecture with inference performance, delivering production-ready...SeniorTraining
- ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You... ...distributed training systems and optimize GPU utilization while collaborating with cross-...SeniorTraining
$205.9k - $407.5k
...are looking to bring on a Senior Principal ML GPU Architect to lead the ML... ...the Head of AI/ML and Data Platforms as a member of staff. You... ...with the Director of ML Engineering who is responsible for... ...step function changes in training and inference speed/scale for all our ML...SeniorTraining$230k - $265k
...financial tools they need through the platforms they already sell on. We... ...Position We’re looking for a software engineer to join Parafin’s Infrastructure team... ...systems for model experimentation, training, evaluation, inference, and retraining that power underwriting...SeniorTrainingFull timeWork from homeFlexible hours$220k - $290k
...Description:Calico seeks a Senior / Staff Cloud Engineer to lead the execution and operation... ...machine learning (ML) platform. As the technical authority... ...and Research engineers to train and deploy ML models for... ...workloadsTroubleshoot node-level GPU/TPU issues, manage...SeniorTraining- Sesterce Group is seeking a skilled networking engineer to design, deploy, and operate the network infrastructure for their GPU AI factories. The role includes working with... ...troubleshooting network performance during live AI training runs. #J-18808-Ljbffr Sesterce GroupSeniorTraining
$160k - $195k
...underlying physical infrastructure. As the Senior GPU Capacity and Optimization Planner, you... ...and our Go-To-Market (GTM) engine. You will work closely with Sales, Customer... ...commercial demand signals and large-scale AI training/inference architectural trends to inform...SeniorTrainingTemporary work$148.5k - $223.9k
...for an experienced and hands-on software engineer to join our team to build and scale the... ..., frameworks, workflows, and validation platforms, applying AI tools, that help Salesforce... ...assignment, compensation, promotion, benefits, training, assessment of job performance,...SeniorTrainingFull time- ...leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect... ...demand grows. This role involves optimizing APIs, managing GPU workloads, and collaborating with cross-functional teams....Senior
- ...out into multiple AI inference requests running in real... ...that sits a large GPU fleet spread across several... ...Today, our inference engineers and researchers build... ...responsibilities we want a dedicated platform team to own. Your job... ...platform for running training and inference...TrainingShift work
- ...they need through the platforms they already sell on.... ...for a seasoned software engineer to join Parafin’s... ...small businesses.As a Senior Software Engineer, you... ..., ML model lifecycle (training, deployment, monitoring... ...retraining), real-time inference.Contributions to internal...SeniorTrainingFlexible hours
- ...Job Description Job Description Senior Software Engineer, ML Platform Location: San Francisco, CA / Remote Flexible Employment... ...the infrastructure behind model experimentation, training, evaluation, inference, and retraining is becoming increasingly critical....SeniorTrainingFull timeRemote workFlexible hours
$179k - $218k
...must be bridged.We are seeking a Senior Staff Data Center Operations Engineer, GPU Hardware Architecture to be the definitive... ...technical authority on GPU platforms within the Data Center... ...components before they impact customer training runs.Technical Sparing Architecture...SeniorTrainingTemporary work- ...Senior Software Engineer, Developer Platform Houston, TX or San Francisco Bay Area Company Introduction At... ...From simulation and machine learning training to data pipelines and CI/CD, our... ...handling scheduling, autoscaling, GPU and heterogeneous resources, and cross...SeniorTrainingTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Platform Engineer — GPU Inference & Training. Be the first to apply!
- data platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- senior operations associate San Francisco, CA
- senior safety specialist San Francisco, CA
- senior technology project manager San Francisco, CA
- remote senior business analyst San Francisco, CA



