Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infrastructure Engineer: Scalable AI Systems

Goliath Partners LP

Goliath Partners Inc. in San Francisco seeks an experienced ML Infrastructure Engineer to help scale the infrastructure behind cutting-edge AI systems. You will own the design and delivery of training and inference pipelines that power large models.

Key tasks include building distributed systems, optimizing GPU workloads, and ensuring reliability across cloud environments using Kubernetes and Docker with AWS/GCP.

#J-18808-Ljbffr
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior ML Infrastructure Engineer: Scalable AI Systems in San Francisco, CA vacancy
  •  ...Claryo is seeking a Senior Software Engineer - ML Infrastructure to own end-to-end ML vision model...  .... You will build scalable GPU compute clusters and...  ...autonomous decision-making in our AI-powered warehouse...  ...experimentation and production-ready systems across SF-office... 
    Senior
    Work at office

    Claryo

    San Francisco, CA
    2 days ago
  •  ...Epsilon Health is seeking an ML infrastructure engineer in San Francisco to design and build core systems enabling scalable training of large models for medical imaging and research. You will own distributed training, RL infrastructure, and inference pipelines from experimentation... 
    Suggested

    Epsilon Health

    San Francisco, CA
    3 days ago
  •  ...insanely fast, globally scalable, cost-efficient, enterprise grade search infrastructure. Powering search and...  ...to determine where new ML capabilities can...  ...quality agentic search systems, addressing tail latency...  ...fragmented systems, mentor senior engineers, and align technical... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    1 day ago
  •  ...Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission is to scale...  ...who are building AI systems to power magical experiences...  ...distributed systems, and HPC infrastructure. You will design and...  ...enable fast, reliable, and scalable model training and build the... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    4 days ago
  • $204k

     ...powerful and accurate AI coding assistant, as well...  ...10 years building infrastructure that’s integral to making...  ...full stack ML engineer with demonstrated industry...  ...analysis and serving systems for features required...  ...Be developing a highly scalable, high-QPS inference service... 
    Senior
    Live in
    Local area
    Remote work

    Sourcegraph

    San Francisco, CA
    3 days ago
  •  ...Epsilon Health in San Francisco is seeking an ML infrastructure engineer to design and build the core systems for scalable training of large models in medical imaging research. You will enable fast experimentation and reliable training, collaborating with researchers... 
    Senior

    Epsilon

    San Francisco, CA
    5 days ago
  •  ...Checkr is seeking a Senior Software Engineer to join the MVR team in San Francisco. You will own design...  ...screenings, building reliable, scalable systems from data sources through processing...  ...product and operations, and embrace AI-assisted tooling to improve accuracy,... 
    Senior

    Checkr

    San Francisco, CA
    4 days ago
  •  ...XPander, Inc. is seeking a senior backend engineer to design and scale the infrastructure powering AI agents on the xpander.ai platform. You will own backend architecture...  ...hands-on focus on performance, reliability, and scalable systems for diverse use cases. #J-18808-Ljbffr
    Senior

    XPANDER

    San Francisco, CA
    1 day ago
  •  ...Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform...  ...and implement scalable search serving infrastructure, including retrieval pipelines...  ...end-to-end delivery of ML components from experimentation...  ...Partner with Rovo and AI platform teams to... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    4 days ago
  •  ...Databricks is seeking a Senior Applied ML Engineer on the Applied AI team to apply ML, scheduling, and optimization to Databricks infrastructure. You will work across the stack—from cluster...  ...customers. You will build end-to-end ML systems, deploy state-of-the-art models,... 
    Senior

    Databricks

    San Francisco, CA
    1 day ago
  •  ...Checkr is hiring an ML Engineer (P3) to build and ship AI-powered systems that power core products. You will own ML services end-to-end, from design to deployment, including LLMs, APIs, monitoring, and tests. This is a production-focused role requiring strong Python... 
    Senior

    Checkr

    San Francisco, CA
    1 day ago
  •  ...Chime is seeking a Senior Software Engineer for the Machine Learning Platform in San Francisco, CA. You will design and build scalable ML infrastructure, enabling data scientists and ML engineers to develop, train, deploy, and monitor models with strong governance and... 
    Senior

    Chime Enterprise

    San Francisco, CA
    3 days ago
  •  ...technology company in San Francisco is seeking an experienced Software Engineer for its Machine Learning Platform team. You will design and...  ...and computer vision efforts. Responsibilities include leading systems architecture for machine learning workloads, collaborating with... 
    Senior

    Apple

    San Francisco, CA
    4 days ago
  •  ...Anthropic is seeking a Senior ML Engineer to join the Core Systems team to optimize training and inference infrastructure for the Claude family of foundation models. You will design high-performance distributed pipelines and work with researchers to remove scaling bottlenecks... 
    Senior

    AI Breaking Wire

    San Francisco, CA
    3 days ago
  • $149.8k - $262.2k

     ...Senior Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - FederalIt all started when engineer...  ...ServiceNow is the AI control tower for business...  ...on reliability, scalability, and operability —...  ..., controllers, infrastructure automation, and platform... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    San Francisco, CA
    4 days ago
  •  ...Axiōma Search is seeking a skilled ML/AI engineer to advance post-training methods and reinforcement learning. You will bridge ML research and systems engineering to optimize training workflows and scale across GPU clusters. The role focuses on improving supervised... 

    Axiōma Search

    San Francisco, CA
    1 day ago
  • $176k - $241k

     ...Senior Systems Engineer, Platform Requirements and Interfaces Who we are Atoms is building the...  ...changing that. Atoms builds Physical AI— real-world robots for the industries that...  ...into something more reliable, more scalable, and more productive. This work requires... 
    Senior
    Full time
    Work experience placement
    Work at office
    Flexible hours

    ATOMS Careers page

    San Francisco, CA
    4 days ago
  •  ...A fast-growing SaaS company in San Francisco is looking for a Senior AI Engineer to design and build scalable, production-grade AI systems. You will develop LLM-powered solutions and architect optimized AI systems. The role demands extensive software engineering experience... 
    Senior

    Harnham

    San Francisco, CA
    1 day ago
  • $182k - $238k

     ...Senior Systems Integration and Test Engineer, Platform Introduction Who we are Atoms is building the machines...  ...that. Atoms builds Physical AI— real-world robots for the industries...  ...into something more reliable, more scalable, and more productive. This work... 
    Senior
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Atoms

    San Francisco, CA
    12 hours ago
  •  ...Deepgram is seeking a backend software engineer to lead the design and implementation of secure, robust, and scalable speech-processing services. You...  ...-to-end features, tackle complex system challenges, and iterate rapidly in a fast-moving AI-first environment. #J-18808-... 
    Senior

    Deepgram

    San Francisco, CA
    2 days ago
  • $117.2k - $313.7k

     ...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents...  ...future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying...  ...-ready.Your Impact:Deliver cloud infrastructure automation tools, frameworks,... 
    Senior
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $200k - $300k

     ...ML Infrastructure EngineerThe company is building one of the leading AI infrastructure platforms powering document...  ...an ML Infrastructure Engineer, you'll own critical...  ...production machine learning systems. You'll work closely...  ..., reliability, scalability, and cost across production... 

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  •  ...Movendi Inc. is seeking a backend engineer to build scalable services powering the Vitesse platform in...  ...management, as well as telemetry pipelines and AI integrations. Ideal candidates have...  ...track record in high-performance systems, REST/gRPC, and both SQL and NoSQL... 
    Senior

    Movendi Inc.

    San Francisco, CA
    5 days ago
  • $175k - $250k

     ...creating cutting-edge AI/ML products that solve healthcare...  ...our AI Research & Engineering team. Operating at the...  ...and production-grade systems, you will drive the...  ...collaborate directly with core infrastructure and platform teams to...  ..., build, and optimize scalable systems and... 
    Senior
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    2 days ago
  •  ...Atlassian’s Agentic AI Integration...  ...to building highly-scalable enterprise-grade AI...  ...and enterprise users.ML performance, quality, and systems acumen-ship: Experience...  ...years of software engineering experience building...  ...layer of enterprise AI infrastructure.Job SummaryCategory... 
    Senior
    Work at office

    Atlassian

    San Francisco, CA
    2 days ago
  •  ...LiveRamp is seeking a Senior Software Engineer for the Identity Engineering...  ...devices. The role focuses on scalability, performance, cost,...  ...and compliance to empower AI-driven marketing insights....  ...applications and modernize infrastructure using Spark, batch processing... 
    Senior

    LiveRamp

    San Francisco, CA
    4 days ago
  •  ...Crusoe is seeking a Production Engineer for our SDN-focused team, responsible for maintaining the reliability and scalability of Crusoe Cloud networking services that power AI workloads. You will build automated, self-healing tooling and work closely with network engineers... 
    Senior

    Crusoe

    San Francisco, CA
    4 days ago
  •  ...Cloudflare is seeking a Senior Engineer to help shape Basin Catalog and Basin SQL, focusing on storage and distributed data systems. You will own features end-to-end, design data models, and optimize storage engines for scalable performance. Proficiency with JavaScript... 
    Senior

    Cloudflare Inc

    San Francisco, CA
    5 days ago
  • $149k - $350k

     ...looking for experienced engineers who’d be excited at...  ..., build and operate scalable data infrastructure. Improve engineering...  ...scaling distributed systems as a team lead Proven...  ...Scientists, Engineers, and ML Engineers to drive...  ...with both junior and senior engineers Experience... 
    Full time
    Remote work
    Work from home

    Figma

    San Francisco, CA
    3 days ago
  •  ...At Atlassian is seeking a Senior Machine Learning Engineer to join the Search & Intelligence organization...  ...of advanced machine learning systems that improve how people...  ...ambiguous product challenges into scalable AI solutions and mentor other ML engineers while #J-18808-... 
    Senior

    WORK180 USA

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infrastructure Engineer: Scalable AI Systems. Be the first to apply!