Senior ML Infrastructure Engineer (GPU & Cloud)
TRM Labs
A blockchain analytics company in San Francisco is seeking a Senior Software Engineer, ML Infrastructure to design and operate GPU-backed systems for AI. The ideal candidate will have 5+ years of experience in building distributed infrastructure and a bachelor’s degree in Computer Science. You will collaborate with cross-functional teams and optimize high-throughput ML workloads. This role offers the opportunity to impact the security of financial systems globally while working in a fast-paced environment. #J-18808-Ljbffr TRM Labs
- A tech startup in AI is seeking a Senior Infrastructure Engineer in San Francisco, CA. This role involves building and scaling a GPU Cloud Marketplace, transforming raw GPUs into a programmable pool for AI developers. Successful candidates will have deep knowledge in infrastructure...Senior
- A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate...Senior
- A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This... ...engineering and strong experience with GPU programming and ML inference workloads. Candidates...Senior
- ...in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-... ...distributed training systems and optimize GPU utilization while collaborating... ...over 5 years of experience in ML infrastructure and a strong...Senior
- ...custom inference stacks that have irregular GPU load. We're looking for people that have done genuinely amazing work in infrastructure who are interested in a challenge, working... ...different infrastructure around inference engines and GPU loads. This is a role that will...Senior
$160k - $230k
...building the AI Acceleration Cloud, an end-to-end platform... ...fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior AI Infrastructure... ...virtualizes cutting-edge ML hardware (GB200s/GB300s... .../SmartNICs a plus ~ GPU programming, NCCL, CUDA...SeniorFull timeRemote work- ...requirement. Evaluation Infrastructure: Build scalable... ...throughput, and error rates GPU utilization and cluster... ...in Computer Science, Engineering, or equivalent... ...Engineering, MLOps, or ML Infrastructure ~ Strong... ...dashboards ~ Experience with cloud infrastructure (AWS or...Immediate startRelocation packageNight shift
- Reducto, Inc. is seeking an Infrastructure Engineer to design, build, and maintain scalable infrastructure for AI and ML workloads. The role involves automating cloud infrastructure and implementing robust monitoring systems to ensure reliability. With a requirement of...Senior
- A cutting-edge AI video platform is seeking a Senior Software Engineer (Infrastructure) to manage its GPU deployments and maintain a reliable AWS backbone. You will collaborate with specialized providers to ensure high availability and architect scalable systems, impacting...Senior
- Aspinity is looking for a Senior Infrastructure Engineer in San Francisco, CA to manage cloud infrastructure and drive self-hosted deployments. The ideal candidate will have 7+ years in infrastructure roles with experience in cloud services and IaC tools. Responsibilities...Senior
- ...power with our Open-Access AI Cloud. By aggregating computing... ...globe, we offer an innovative GPU marketplace and AI inference... ...Role We're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic... ...data infrastructure for AI/ML workloads, including object...SeniorRemote work
$207k - $362.25k
...About the role Rippling's Infrastructure organization owns the foundational... ...company. Supporting more than 1,000 engineers and millions of end users, the Cloud Infrastructure team is... ...production environment. As a Senior Engineering Manager, you will lead...SeniorWork at office3 days per week- A pioneering AI company in San Francisco is seeking a Senior Infrastructure Engineer to build and scale their GPU Cloud Marketplace. In this foundational role, you will transform raw GPU resources into a programmable pool that serves thousands of AI developers. The position...SeniorWorldwide
$100k - $200k
Voiceflow is seeking a skilled ML-Infrastructure Engineer in San Francisco to architect and operate auto-scaling systems for our voice AI simulation platform. The role includes optimizing GPU and compute infrastructure, ensuring high performance and reliability. Ideal...Work at office- ...technology firm in San Francisco is seeking an experienced Infrastructure Engineer to lead the design and evolution of core services. You'll define... ...should have 6+ years in software engineering, expertise in cloud services, and a Bachelor's degree in a related field. This...Senior
- A technology company is seeking a Senior Software Engineer, Infrastructure, in San Francisco. This role focuses on building scalable cloud solutions while collaborating with various teams. Candidates should have 5-8 years of experience, strong software engineering fundamentals...Senior
- Slash Financial is on the lookout for a Senior Infrastructure/Platform Engineer to enhance and scale its banking platform infrastructure. Based in San Francisco, the role entails maintaining reliable, secure systems and enhancing tooling. Candidates should have 2-3+ years...Senior
- ...ML Infrastructure Engineer Spectral Labs is a spatial intelligence company building reasoning models for engineering physical systems. Our model... ...Optimize distributed training & RL across our GPU cluster of hundreds of H100 GPUs (FSDP, DeepSpeed, or custom...
- A leading AI technology company based in San Francisco is looking for a seasoned Software Engineer with expertise in cloud architecture to join their Infrastructure Engineering team. The successful candidate will lead the design of core services infrastructure, automate...Senior
$152k - $228k
...Job Description Job Description Senior ML Engineer About Invoca Invoca is an AI-powered... .... You'll be a primary driver of the infrastructure powering our Context Engine and agentic... ...Server, Baseten, and Kubernetes-based GPU infrastructure. Profile and tune for...SeniorCurrently hiringRemote workFlexible hours- ...model: the Food Foundation Model. As a Senior ML Engineer, Foundation Models, you will work at... ...Foundation Model, building the data infrastructure that feeds it, and deploying it onto physical... ...distributed training (multi-node GPU clusters, FSDP, DeepSpeed)...SeniorFlexible hours
- A tech company focused on AI is seeking a Site Reliability Engineer to ensure the reliability and performance of its GPU marketplace. This role involves maintaining service level objectives, managing capacity, and implementing secure systems. The ideal candidate has strong...Senior
- ...fast-growing AI startup is seeking a Senior Infrastructure Engineer in San Francisco. In this role, you will... .... You will contribute to optimizing ML infrastructure and integrating complex... ...candidates have 3-6 years of experience in cloud infrastructure and deep knowledge of...Senior
- Position: Senior ML Performance Engineer Location: SF Bay Area (US) or Toronto (Canada... ...: Full-Time Industry: AI Infrastructure / Compiler Systems... ...anywhere.” This includes cloud, edge, and hybrid environments... ...compiler optimization on modern GPU architectures. This role...SeniorFull time
$168k - $213k
A leading financial services AI platform is seeking a Senior Infrastructure Engineer to manage Kubernetes infrastructure and ensure compliance. You'll work on automating secure infrastructure and addressing high-performance regulatory requirements while collaborating with...Senior$183.7k - $248.6k
...The opportunity Unity is looking for a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team, where we build the real-time systems... ...'ll build and operate the infrastructure that brings ML models from training into production, ensuring our ranking...SeniorWork at officeRemote workWorldwideRelocation package- ...We're looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime... ...ll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that SLURM jobs are running,...Work at officeVisa sponsorship
$250k - $325k
...civilization runs on the same infrastructure: agreements between people... ...over the last 12 months. Engineering at Ivo Engineers at Ivo are... ...Things break. Regions go down. Cloud and LLM providers have "incidents... ...Design strategies to isolate ML vs API workloads while...SeniorContract workWork at officeRemote work$100k - $200k
...Simulation & Evaluation that scales voice and chat AI agents ML‑Infrastructure Engineer Salary $100K - $200K Equity 0.20% - 1.00% Location San... ...You'll own our model infrastructure end to end: Scaling GPU and compute infrastructure. Architect and operate the auto‑...Full timeLive inWork at office- ...through advanced hardware engineering and AI solutions.... ...We are seeking a Senior Machine Learning Infrastructure Engineer to join our... ...performance, production-grade ML ecosystem to support... ...to architect new cloud infrastructure, data... ...sharding, cross-GPU communication, and...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infrastructure Engineer (GPU & Cloud). Be the first to apply!
- computer vision machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA


