Senior ML Infrastructure Engineer (GPU & Cloud)
TRM Labs
A blockchain analytics company in San Francisco is seeking a Senior Software Engineer, ML Infrastructure to design and operate GPU-backed systems for AI. The ideal candidate will have 5+ years of experience in building distributed infrastructure and a bachelor’s degree in Computer Science. You will collaborate with cross-functional teams and optimize high-throughput ML workloads. This role offers the opportunity to impact the security of financial systems globally while working in a fast-paced environment. #J-18808-Ljbffr TRM Labs
- A tech startup in AI is seeking a Senior Infrastructure Engineer in San Francisco, CA. This role involves building and scaling a GPU Cloud Marketplace, transforming raw GPUs into a programmable pool for AI developers. Successful candidates will have deep knowledge in infrastructure...Senior
$128.7k - $261.3k
...development, and performance engineering so that every cycle on our accelerators... ...team builds high-performance GPU kernels and custom libraries... ...the heart of our on-vehicle ML inference for ADAS and... ...and improve tooling and infrastructure that make it easier to profile...SeniorLocal areaWork from homeRelocation packageFlexible hours- A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate...Senior
- A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform for large language models. This... ...engineering and strong experience with GPU programming and ML inference workloads. Candidates...Senior
- ...in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-... ...distributed training systems and optimize GPU utilization while collaborating... ...over 5 years of experience in ML infrastructure and a strong...Senior
- ...custom inference stacks that have irregular GPU load. We're looking for people that have done genuinely amazing work in infrastructure that are interested in a challenge,... ...different infrastructure around inference engines and GPU loads. This is a role that will...Senior
$160k - $230k
...Senior Software Engineer - Together Cloud Infrastructure San Francisco About the Role Together AI is building the AI... ...infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField... ...with DPUs/SmartNICs a plus ~ GPU programming, NCCL, CUDA knowledge...SeniorFull timeRemote work- ...Senior Client Infrastructure Engineer SAN FRANCISCO, CA ENGINEERING FULL-TIME What Will You Be Doing? Building infrastructure that enables... ...working with Microsoft Azure, Amazon Web Services, and other cloud providers. A good understanding of machine learning and/...SeniorFull timeWork experience placement
- Not Human Search is seeking a Senior Staff Machine Learning Engineer to join their team in San Francisco, focusing... ...cutting-edge Machine Learning infrastructure. The ideal candidate will have over 12 years of experience in applied ML/AI, including strong programming skills...SeniorRemote job
- A forward-thinking AI company seeks experienced ML engineers to build distributed training infrastructure. This role involves designing scalable systems using PyTorch and Ray, ensuring performance and reliability in large-scale environments. The ideal candidates will possess...Senior
- A frontier research laboratory in San Francisco is seeking a Senior / Principal ML Engineer to enhance their ML infrastructure. The role involves designing experimental frameworks for data scientists, collaborating with various teams, and ensuring rigorous practices in...Senior
- ...requirement. Evaluation Infrastructure: Build scalable... ...throughput, and error rates GPU utilization and cluster... ...in Computer Science, Engineering, or equivalent... ...Engineering, MLOps, or ML Infrastructure ~ Strong... ...dashboards ~ Experience with cloud infrastructure (AWS or...Immediate startRelocation packageNight shift
- ...something! Description As an engineer on ML Compute team, your work will... ...technologies such as NCCL for GPU collectives and TPU interconnect... ...scalability, containerization, and cloud platforms ~ Proficient in cloud computing infrastructure and tools: Kubernetes, Ray,...
- A cutting-edge AI video platform is seeking a Senior Software Engineer (Infrastructure) to manage its GPU deployments and maintain a reliable AWS backbone. You will collaborate with specialized providers to ensure high availability and architect scalable systems, impacting...Senior
- Delphina-Hotels- is looking for an experienced ML Infrastructure Engineer to join their Technical Staff in San Francisco. In this pivotal role, you will help shape product direction and drive key technical decisions. Your responsibilities will include developing platforms...
- ...Pte. Ltd. is seeking a Machine Learning Engineer with expertise in high-performance... ...systems to manage and optimize their infrastructure for ML model training and deployment. The ideal... ...Computer Science and experience with cloud platforms like AWS and Google Cloud. Responsibilities...Full time
- ...requirement. Evaluation Infrastructure: Build scalable... ...throughput, and error rates GPU utilization and cluster... ...degree in Computer Science, Engineering, or equivalent... ...Engineering, MLOps, or ML Infrastructure Experience... ...dashboards Experience with cloud infrastructure (AWS or...Full timeImmediate startRelocation packageNight shift
- Aspinity is looking for a Senior Infrastructure Engineer in San Francisco, CA to manage cloud infrastructure and drive self-hosted deployments. The ideal candidate will have 7+ years in infrastructure roles with experience in cloud services and IaC tools. Responsibilities...Senior
- A pioneering AI company in San Francisco is seeking a Senior Infrastructure Engineer to build and scale their GPU Cloud Marketplace. In this foundational role, you will transform raw GPU resources into a programmable pool that serves thousands of AI developers. The position...SeniorWorldwide
- ...Position: Senior ML Performance Engineer Location: SF Bay Area (US) or Toronto... ...Full-Time Industry: AI Infrastructure / Compiler Systems... ...anywhere." This includes cloud, edge, and hybrid environments... ...compiler optimization on modern GPU architectures. This...SeniorFull time
- ...power with our Open-Access AI Cloud. By aggregating computing... ...globe, we offer an innovative GPU marketplace and AI inference... ...the Role We're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic... ...data infrastructure for AI/ML workloads, including object...SeniorRemote work
$152k - $228k
...Job Description Job Description Senior ML Engineer About Invoca Invoca is an AI-powered... .... You'll be a primary driver of the infrastructure powering our Context Engine and agentic... ...Server, Baseten, and Kubernetes-based GPU infrastructure. Profile and tune for...SeniorCurrently hiringRemote workFlexible hours- A technology company is seeking a Senior Software Engineer, Infrastructure, in San Francisco. This role focuses on building scalable cloud solutions while collaborating with various teams. Candidates should have 5-8 years of experience, strong software engineering fundamentals...Senior
- Slash Financial is on the lookout for a Senior Infrastructure/Platform Engineer to enhance and scale its banking platform infrastructure. Based in San Francisco, the role entails maintaining reliable, secure systems and enhancing tooling. Candidates should have 2-3+ years...Senior
- ...technology firm in San Francisco is seeking an experienced Infrastructure Engineer to lead the design and evolution of core services. You'll define... ...should have 6+ years in software engineering, expertise in cloud services, and a Bachelor's degree in a related field. This...Senior
- A leading AI technology company based in San Francisco is looking for a seasoned Software Engineer with expertise in cloud architecture to join their Infrastructure Engineering team. The successful candidate will lead the design of core services infrastructure, automate...Senior
- ...ML Infrastructure Engineer Spectral Labs is a spatial intelligence company building reasoning models for engineering physical systems. Our model... ...Optimize distributed training & RL across our GPU cluster of hundreds of H100 GPUs (FSDP, DeepSpeed, or custom...
$250k - $350k
...makes them actually work. We're hiring ML Infrastructure Engineers to tackle a hard, real-world problem,... ...input flowing from device → edge → cloud, at scale. You'll be working across... ...for multimodal / LLM-based models GPU infrastructure and performance optimisation...- ...The Role At Mach9, ML infrastructure engineers build and maintain the systems that power production... ...on hundreds of terabytes of 3D point cloud and image data. You'll also architect... ...Experience with containerized ML workflows and GPU-accelerated training environments....Work experience placement
- ...Quantum-Accelerated AI Server Engineer Sygaldry Technologies... ...AI. They need compute infrastructure that stays out of their way: GPU access that's reliable,... ...each researcher to become a cloud expert. You'll build and... ...) Python-based ML and scientific computing...Casual workLocal areaVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Infrastructure Engineer (GPU & Cloud). Be the first to apply!
- machine learning ai engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- entry level machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA

