Senior AI Infrastructure Lead - GPU Clusters & Model Serving
Outsourceit
Outsourceit is seeking an AI Infrastructure Lead to design and operate innovative GPU infrastructure for enterprise AI workloads. This role requires a minimum commitment of 6 months and involves working closely with the CTO and a team of engineers. The ideal candidate will have proven experience with large-scale GPU systems, distributed training, and containerised workloads, alongside expertise in AWS, GCP, or Azure services. Full-time availability and participation in an on-call rotation are required. #J-18808-Ljbffr Outsourceit
- ...in San Francisco is seeking a Senior Site Reliability Engineer to... ...design and operate large-scale GPU infrastructure. This high-impact role... ...reliability and performance, serving as a key technical liaison for... ...customers managing large-scale AI workloads. The position offers...SeniorRemote job
$220k - $320k
...hosts specialized language models for companies that need frontier-quality AI at a fraction of the cost.... ..., always with the goal of serving models faster and cheaper... ...optimize CUDA kernels and GPU utilization across our serving infrastructure Add support for new model...SeniorWork at office- ...own the high-performance network infrastructure for their GPU clusters. This senior role collaborates closely with hardware... ...teams, directly impacting model performance and inference. Responsibilities... ..., defining topology, and leading network performance testing. Ideal...SeniorFlexible hours
- ...generation of inference infrastructure for enterprise AI workloads. We need an AI Infrastructure Lead to own the design and operation of our GPU cluster management layer, model serving pipeline, and low-latency... ...the CTO and a team of four senior engineers. This is a high...SuggestedFull timeContract work
$166k - $225k
...world's best data and AI infrastructure platform so our customers... .... Databricks’ Model Serving product provides enterprises... ...efficiency. As a Senior Engineer, you’ll play... ...inference across CPU and GPU workloads, influence architectural... ...performant systems. Lead technical initiatives...SeniorLocal areaWorldwide- A leading AI infrastructure company is looking for a Senior Site Reliability Engineer to design and operate large-scale GPU clusters. In this role, you will work closely with clients to troubleshoot and optimize AI infrastructure. The ideal candidate has extensive experience...Senior
- ...on a mission to democratize AI by breaking down the barriers... ...globe, we offer an innovative GPU marketplace and AI inference... ...About the Role We're seeking a Senior Infrastructure Engineer to help build and... ...programmable, orchestrated pool that serves thousands of AI developers...SeniorRemote work
$220k
...team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience in software engineering with a focus on ML inference...Senior- A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal...Senior
- Dormont Manufacturing Co in San Francisco is seeking an experienced infrastructure engineer to support GPU clusters and ensure operational efficiency. The role involves debugging performance issues, automating fleet operations, and mentoring junior engineers in a collaborative...SeniorWork at office
- You will lead the design and operation of Sesterce's AI cluster network fabrics — owning InfiniBand and RoCE architectures, RDMA performance, and fabric reliability... ...playbooks; mentor principal and staff engineers and serve as the final escalation point for fabric...
- ...Engineer for their Supercomputing Platform & Infrastructure team. You will design solutions for AI workloads on massive computing clusters, working closely with training and... ...ideal candidate has experience with production GPU deployments, strong software engineering skills...Senior
- 1. Lead the development and strategic management of domestic... ...sales of Keling’s large model offerings and deepen... ..., industry-recognized AI large model benchmark... ...least 3 years dedicated to serving domestic Strategic Key... ...Europe), particularly among senior decision-makers (e.g.,...SeniorContract workOverseas
- ...world's most dynamic AI companies, like... ..., flexible infrastructure, and seamless developer... ...cutting‑edge models into production.... ...foundational engineers to lead our GPU Networking... ...for Disaggregated Serving, Wide Expert Parallelism... ...on bleeding‑edge clusters (H100/H200, B200/...Flexible hours
- A leading data and AI company in San Francisco is seeking a Senior Engineer to enhance their Model Serving platform. This role requires expertise in building large-scale distributed systems and collaboration across teams to optimize performance and reliability. Ideal candidates...Senior
- ...s most dynamic AI companies, like... ...research, flexible infrastructure, and seamless... ...cutting-edge models into production... ...Infrastructure Finance Lead to own the... ...capacity, and serve as the primary... ...our cloud and GPU operating partners... ...insights for senior leadership and...Contract workFlexible hours
$175k - $220k
Togetherai is looking for a Product Manager to manage AI infrastructure products including GPU Clusters and Observability. You will drive product decisions based on data and collaborate closely with engineering teams to ship features that address customer needs. The ideal...$301.75k - $355k
...only vertically integrated AI infrastructure company built from the... ...About This Role The Senior Director for the Model LifeCycle team will undertake... ...years of industry experience leading and driving impactful projects... ...optimizations on GPU systems and inference frameworks...SeniorTemporary work- ...Deployment to build and scale the infrastructure that powers our AI-driven warehouse... ...lifecycle of computer vision models — from training pipelines... ...You\'ll design scalable GPU compute clusters, build robust... ...pipelines, and optimize model serving for low-latency inference...SeniorWork at office3 days per week
$164.2k - $205.2k
...Databricks, the Compute Infrastructure organization... ...runs all Data, AI and stateful... ...thousands of Kubernetes clusters, and must... ...efficiency. As a Senior Software... ...types of workloads (serving, batch, stateful, GPU) with high performance... ...mindset Lead cross‑team initiatives...SeniorLocal area- ...healthcare technology firm in San Francisco is seeking an ML Infrastructure Engineer, Model Inference to build and optimize AI-driven solutions. You will design scalable Kubernetes clusters, enhance ML model serving infrastructure, and collaborate with cross-functional...
$250k
...opportunities? Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI... ...The company is looking for a Senior / Staff Site Reliability Engineer... ...frameworks for GPU compute clusters Collaborate with ML, data, and...SeniorPermanent employmentRemote work$190k - $270k
AI Chopping Block, Inc. is seeking an AI Infrastructure Engineer in San Francisco. This role requires maintaining user-facing services and production systems, specializing in systems while ensuring their reliability and scalability. Candidates should have 5+ years of experience...Senior- A tech startup in AI is seeking a Senior Infrastructure Engineer in San Francisco, CA. This role involves building and scaling a GPU Cloud Marketplace, transforming raw GPUs into a programmable pool for AI developers. Successful candidates will have deep knowledge in infrastructure...Senior
$350 per month
...Senior Infrastructure Engineer Gumloop is the piece of AI infrastructure companies roll out to let everyone... ...data, choose your AI models and host it all in your... ...maintain Kubernetes clusters, CI/CD pipelines, and cloud... ...and model serving Benefits ~ Highly...SeniorTemporary workRemote work- A technology infrastructure firm based in California is looking for an experienced GPU Infrastructure Manager to join their team. The role involves architecting and deploying GPU clusters globally, alongside mentoring junior engineers. Candidates should have 10+ years...Senior
$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building... ...to ensure operational excellence in GPU serving workloads. Competitive salary...$350k
...knowledge and tools to make AI work for their unique... ....ai, open‑weights models like Mistral, as well as... ...at scale, across large GPU fabrics — both the RDMA/... ...dramatically faster, and serve as the technical point of... ...Experience operating large‑scale clusters and container...Local areaVisa sponsorshipRelocation package- Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San... ...Andromeda Andromeda Cluster was founded by... ...works with leading AI labs, data centers... ...large‑scale GPU infrastructure... ...Partnership: Serve as the primary... ...need to write the models, but you need...SeniorFull timeRemote work
- ...the world's most dynamic AI companies, like Cursor,... ...AI research, flexible infrastructure, and seamless developer... ...to bring cutting‑edge models into production. We're... ...Infrastructure Analytics Lead to help Baseten build... ...building dashboards and self‑serve analytics in BI tools...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infrastructure Lead - GPU Clusters & Model Serving. Be the first to apply!
- senior game producer San Francisco, CA
- senior electronic design engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA
- senior java software engineer San Francisco, CA
- senior specialist San Francisco, CA
- senior research manager San Francisco, CA
- senior director corporate development San Francisco, CA
- senior software test engineer San Francisco, CA
- sr project engineer San Francisco, CA
- senior electrical designer San Francisco, CA

