Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Infrastructure Lead - GPU Clusters & Model Serving

Outsourceit

Outsourceit is seeking an AI Infrastructure Lead to design and operate innovative GPU infrastructure for enterprise AI workloads. This role requires a minimum commitment of 6 months and involves working closely with the CTO and a team of engineers. The ideal candidate will have proven experience with large-scale GPU systems, distributed training, and containerised workloads, alongside expertise in AWS, GCP, or Azure services. Full-time availability and participation in an on-call rotation are required. #J-18808-Ljbffr Outsourceit

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Infrastructure Lead - GPU Clusters & Model Serving in San Francisco, CA vacancy
  •  ...in San Francisco is seeking a Senior Site Reliability Engineer to...  ...design and operate large-scale GPU infrastructure. This high-impact role...  ...reliability and performance, serving as a key technical liaison for...  ...customers managing large-scale AI workloads. The position offers... 
    Senior
    Remote job

    Cortes 23

    San Francisco, CA
    3 days ago
  • $220k - $320k

     ...hosts specialized language models for companies that need frontier-quality AI at a fraction of the cost....  ..., always with the goal of serving models faster and cheaper...  ...optimize CUDA kernels and GPU utilization across our serving infrastructure Add support for new model... 
    Senior
    Work at office

    Inference

    San Francisco, CA
    2 days ago
  •  ...own the high-performance network infrastructure for their GPU clusters. This senior role collaborates closely with hardware...  ...teams, directly impacting model performance and inference. Responsibilities...  ..., defining topology, and leading network performance testing. Ideal... 
    Senior
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...generation of inference infrastructure for enterprise AI workloads. We need an AI Infrastructure Lead to own the design and operation of our GPU cluster management layer, model serving pipeline, and low-latency...  ...the CTO and a team of four senior engineers. This is a high... 
    Suggested
    Full time
    Contract work

    Outsourceit

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...world's best data and AI infrastructure platform so our customers...  .... Databricks’ Model Serving product provides enterprises...  ...efficiency. As a Senior Engineer, you’ll play...  ...inference across CPU and GPU workloads, influence architectural...  ...performant systems. Lead technical initiatives... 
    Senior
    Local area
    Worldwide

    Cacheflow

    San Francisco, CA
    3 days ago
  • A leading AI infrastructure company is looking for a Senior Site Reliability Engineer to design and operate large-scale GPU clusters. In this role, you will work closely with clients to troubleshoot and optimize AI infrastructure. The ideal candidate has extensive experience... 
    Senior

    Andromeda

    San Francisco, CA
    4 days ago
  •  ...on a mission to democratize AI by breaking down the barriers...  ...globe, we offer an innovative GPU marketplace and AI inference...  ...About the Role We're seeking a Senior Infrastructure Engineer to help build and...  ...programmable, orchestrated pool that serves thousands of AI developers... 
    Senior
    Remote work

    Hyperbolic Labs

    San Francisco, CA
    4 days ago
  • $220k

     ...team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience in software engineering with a focus on ML inference... 
    Senior

    Perplexity

    San Francisco, CA
    18 hours ago
  • A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal... 
    Senior

    Menlo Ventures

    San Francisco, CA
    4 days ago
  • Dormont Manufacturing Co in San Francisco is seeking an experienced infrastructure engineer to support GPU clusters and ensure operational efficiency. The role involves debugging performance issues, automating fleet operations, and mentoring junior engineers in a collaborative... 
    Senior
    Work at office

    Dormont Manufacturing Company

    San Francisco, CA
    2 days ago
  • You will lead the design and operation of Sesterce's AI cluster network fabrics — owning InfiniBand and RoCE architectures, RDMA performance, and fabric reliability...  ...playbooks; mentor principal and staff engineers and serve as the final escalation point for fabric... 

    Sesterce Group

    San Francisco, CA
    2 days ago
  •  ...Engineer for their Supercomputing Platform & Infrastructure team. You will design solutions for AI workloads on massive computing clusters, working closely with training and...  ...ideal candidate has experience with production GPU deployments, strong software engineering skills... 
    Senior

    Dormont Manufacturing Co

    San Francisco, CA
    4 days ago
  • 1. Lead the development and strategic management of domestic...  ...sales of Keling’s large model offerings and deepen...  ..., industry-recognized AI large model benchmark...  ...least 3 years dedicated to serving domestic Strategic Key...  ...Europe), particularly among senior decision-makers (e.g.,... 
    Senior
    Contract work
    Overseas

    Kuaishou Technology

    San Francisco, CA
    18 hours ago
  •  ...world's most dynamic AI companies, like...  ..., flexible infrastructure, and seamless developer...  ...cutting‑edge models into production....  ...foundational engineers to lead our GPU Networking...  ...for Disaggregated Serving, Wide Expert Parallelism...  ...on bleeding‑edge clusters (H100/H200, B200/... 
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  • A leading data and AI company in San Francisco is seeking a Senior Engineer to enhance their Model Serving platform. This role requires expertise in building large-scale distributed systems and collaboration across teams to optimize performance and reliability. Ideal candidates... 
    Senior

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...s most dynamic AI companies, like...  ...research, flexible infrastructure, and seamless...  ...cutting-edge models into production...  ...Infrastructure Finance Lead to own the...  ...capacity, and serve as the primary...  ...our cloud and GPU operating partners...  ...insights for senior leadership and... 
    Contract work
    Flexible hours

    Baseten

    San Francisco, CA
    18 hours ago
  • $175k - $220k

    Togetherai is looking for a Product Manager to manage AI infrastructure products including GPU Clusters and Observability. You will drive product decisions based on data and collaborate closely with engineering teams to ship features that address customer needs. The ideal... 

    Togetherai

    San Francisco, CA
    2 days ago
  • $301.75k - $355k

     ...only vertically integrated AI infrastructure company built from the...  ...About This Role The Senior Director for the Model LifeCycle team will undertake...  ...years of industry experience leading and driving impactful projects...  ...optimizations on GPU systems and inference frameworks... 
    Senior
    Temporary work

    Jobleads-US

    San Francisco, CA
    18 hours ago
  •  ...Deployment to build and scale the infrastructure that powers our AI-driven warehouse...  ...lifecycle of computer vision models — from training pipelines...  ...You\'ll design scalable GPU compute clusters, build robust...  ...pipelines, and optimize model serving for low-latency inference... 
    Senior
    Work at office
    3 days per week

    Claryo

    San Francisco, CA
    2 days ago
  • $164.2k - $205.2k

     ...Databricks, the Compute Infrastructure organization...  ...runs all Data, AI and stateful...  ...thousands of Kubernetes clusters, and must...  ...efficiency. As a Senior Software...  ...types of workloads (serving, batch, stateful, GPU) with high performance...  ...mindset Lead cross‑team initiatives... 
    Senior
    Local area

    Menlo Ventures

    San Francisco, CA
    2 days ago
  •  ...healthcare technology firm in San Francisco is seeking an ML Infrastructure Engineer, Model Inference to build and optimize AI-driven solutions. You will design scalable Kubernetes clusters, enhance ML model serving infrastructure, and collaborate with cross-functional... 

    Abridge

    San Francisco, CA
    4 days ago
  • $250k

     ...opportunities? Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI...  ...The company is looking for a Senior / Staff Site Reliability Engineer...  ...frameworks for GPU compute clusters Collaborate with ML, data, and... 
    Senior
    Permanent employment
    Remote work
    San Francisco, CA
    a month ago
  • $190k - $270k

    AI Chopping Block, Inc. is seeking an AI Infrastructure Engineer in San Francisco. This role requires maintaining user-facing services and production systems, specializing in systems while ensuring their reliability and scalability. Candidates should have 5+ years of experience... 
    Senior

    AI Chopping Block, Inc.

    San Francisco, CA
    4 days ago
  • A tech startup in AI is seeking a Senior Infrastructure Engineer in San Francisco, CA. This role involves building and scaling a GPU Cloud Marketplace, transforming raw GPUs into a programmable pool for AI developers. Successful candidates will have deep knowledge in infrastructure... 
    Senior

    Hyperbolic Labs

    San Francisco, CA
    1 day ago
  • $350 per month

     ...Senior Infrastructure Engineer Gumloop is the piece of AI infrastructure companies roll out to let everyone...  ...data, choose your AI models and host it all in your...  ...maintain Kubernetes clusters, CI/CD pipelines, and cloud...  ...and model serving Benefits ~ Highly... 
    Senior
    Temporary work
    Remote work

    AgentHub Inc.

    San Francisco, CA
    3 days ago
  • A technology infrastructure firm based in California is looking for an experienced GPU Infrastructure Manager to join their team. The role involves architecting and deploying GPU clusters globally, alongside mentoring junior engineers. Candidates should have 10+ years... 
    Senior

    The San Francisco Compute Company

    San Francisco, CA
    4 days ago
  • $192k - $260k

    A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building...  ...to ensure operational excellence in GPU serving workloads. Competitive salary... 

    Databricks Inc.

    San Francisco, CA
    1 day ago
  • $350k

     ...knowledge and tools to make AI work for their unique...  ....ai, open‑weights models like Mistral, as well as...  ...at scale, across large GPU fabrics — both the RDMA/...  ...dramatically faster, and serve as the technical point of...  ...Experience operating large‑scale clusters and container... 
    Local area
    Visa sponsorship
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    18 hours ago
  • Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San...  ...Andromeda Andromeda Cluster was founded by...  ...works with leading AI labs, data centers...  ...large‑scale GPU infrastructure...  ...Partnership: Serve as the primary...  ...need to write the models, but you need... 
    Senior
    Full time
    Remote work

    Cortes 23

    San Francisco, CA
    4 days ago
  •  ...the world's most dynamic AI companies, like Cursor,...  ...AI research, flexible infrastructure, and seamless developer...  ...to bring cutting‑edge models into production. We're...  ...Infrastructure Analytics Lead to help Baseten build...  ...building dashboards and self‑serve analytics in BI tools... 
    Flexible hours

    Baseten

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Infrastructure Lead - GPU Clusters & Model Serving. Be the first to apply!