Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed ML Infra Engineer - Large-Scale Pre-Training

Jobleads-US

The Institute of Foundation Models is seeking a distributed ML infrastructure engineer to extend and scale our training systems. You’ll work with world‑class researchers to extend distributed training frameworks (DeepSpeed, FSDP, FairScale, Horovod) and build robust multi‑node launch scripts.

You will own experiment tracking, metrics logging, and job monitoring for external visibility, and aim to improve reliability and performance of large‑scale pre‑training pipelines.

#J-18808-Ljbffr Jobleads-US
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Distributed ML Infra Engineer - Large-Scale Pre-Training in Sunnyvale, CA vacancy
  •  ...Meta is hiring a Software Engineer for the Systems ML team in Menlo Park, CA. You will design and optimize large-scale ML training and inference systems, spanning the full stack from pipelines to hardware-aware optimizations. You will collaborate with researchers,... 
    Training

    Jobleads-US

    Menlo Park, CA
    7 hours ago
  • $159.3k - $230.7k

     ...real roads, at real scale. Making self-...  ...foundation model pre-training and SFT. We determine...  ...The team delivers ML models that move the...  ...with the very large datasets GM already...  ...As a Senior AI/ML Engineer in the Embodied AI...  ...long-tail and out-of-distribution scenario discovery... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $275.8k - $340.5k

     ...team: The AV ML Infra team at GM builds...  ...productivity of ML engineers, and drive the...  ...performance by running large-scale simulation...  ...andoptimizeslarge-scale ML training and inference...  ...test scalable distributed computing and data...  ...(s) and/or a pre-employment screening... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Mountain View, CA
    2 days ago
  • $150k

     ...foundation model training, alongside world-...  ...scientists, and engineers, tackling the most...  ...re looking for a distributed ML infrastructure engineer...  ...help extend and scale our training...  ...work will support large-scale pre-training, and pre...  ...researchers. Infra Engineering – Write... 
    Training
    Flexible hours

    Jobleads-US

    Sunnyvale, CA
    8 hours ago
  •  ...foundation model training, alongside world-...  ...scientists, and engineers, tackling the most...  ...re looking for a distributed ML infrastructure engineer...  ...help extend and scale our training...  ...work will support large-scale pre-training, and pre...  ...researchers. Infra Engineering – Write... 
    Training
    Flexible hours

    Institute of Foundation Models

    Sunnyvale, CA
    3 days ago
  • $153.2k - $234.1k

     ...transportation on a global scale. Role:Are you...  .... As a Senior ML Infra Engineer, you will work on...  ...generation, training, evaluation and iteration...  .... From enabling large foundational...  ...working on large-scale distributed systems,...  ...assessment(s) and/or a pre-employment... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    17 hours ago
  • $189k - $300k

     ...transportation on a global scale. The Data Scaling team...  ...works on and delivers ML models to the product...  ...team uses existing very large datasets that GM has...  ...up AV foundation model pre-training and fine-tuning with data...  ...high-impact team of AI/ML engineers, data scientists and... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...autonomous systems at scale. We seek a Senior ML Engineer to compose and...  ...AI, simulation, and large-scale model development...  ...architectures, and training methodologies, and actively...  ....Experience in pre-training or refining...  ...scaling AI systems across distributed infrastructure,... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...Amazon Inc. in Cupertino is seeking a Software Engineer- AI/ML to help build and optimize AWS Neuron Training for large-scale model training on Trainium. You will work across PyTorch and Neuron to implement distributed training components and apply parallelism strategies... 
    Training

    Jobleads-US

    Cupertino, CA
    8 hours ago
  •  ...Responsibilities Build scalable systems for training and fine-tuning large-scale models that evaluate driving...  ...tools. Design and scale distributed systems for dataset generation, model...  ...training, and evaluation across the ML lifecycle. Contribute to production... 
    Training
    Full time

    Waymo

    Mountain View, CA
    6 days ago
  • $171.7k - $303.9k

     ...The Data Labeling Engineering team designs,...  ...engineering, and AI/ML, defining the strategies...  ...create reliable training data at scale. Our tools and...  ...data annotation (pre‑labeling,...  ...building robust distributed platforms and applications...  ...or tools used by large labeling... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $207k - $300k

     ...Staff SWE, ML Compiler Performance Engineer Co-Design Share Staff SWE...  ...with performance, large-scale systems data analysis...  ...performance modeling on pre-silicon systems,...  ...information retrieval, distributed computing, large-...  ...relevant education or training. About the job... 
    Training
    Worldwide

    Jobleads-US

    Mountain View, CA
    2 days ago
  •  ...core data logging, processing, and ML model-training pipelines. Develop and scale infrastructure for batch and real-...  ...managers, indexing platform engineers, ranking engineers, and data platform...  ...holidays. ~ Paid parental leave and pre-tax commuter benefits. ~ Free... 
    Training
    Full time

    Coupang

    Mountain View, CA
    17 days ago
  •  .... About our Engineering Teams The Performance...  ...across training and cloud...  ...efficiently at scale. Your day-to...  ...on Profiling ML workloads across...  ...infrastructure, distributed platforms or similar...  ...have optimised large-scale workloads...  ...coded rules or pre mapped... 
    Training
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Jobleads-US

    Sunnyvale, CA
    2 days ago
  • $296.3k - $423.9k

     ...transportation on a global scale.  We are...  ...algorithms and ML systems that...  ...team of engineers building ML-driven...  ...engineers, and lead large cross-...  ...Architect scalable training pipelines using...  ...infrastructure and distributed ML pipelines....  ...assessment(s) and/or a pre-employment... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $150k - $230k

     ...meaningful challenges at scale.Together, we...  ...on Machine Learning Engineer to drive the post-training of our large language models, with...  ...stack — continuous pre-training (CPT),...  ...clusters, applying distributed-training techniques...  ...data engineering for ML. You can independently... 
    Training
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    2 days ago
  • $193.3k - $261.5k

     ...for AWS's custom ML accelerators. Working...  ...boundary, our engineers craft high-performance...  ...ML inference and training performance.As...  ...performance computing, and distributed architectures,...  ...that are very large, yet our teams remain...  ..., reliability and scaling) of new and... 
    Training
    Internship
    Local area
    Work from home
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • $173k - $253k

    Matterport - Senior ML Ops Engineer Job Description CoStar Group is...  ...model architectures, training procedures, and deployment requirements...  ...or MLOps, particularly with large-scale 2D/3D computer vision models...  ...-free workplace and perform pre-employment substance abuse... 
    Training
    Full time
    Work at office
    Work from home

    Matterport

    Sunnyvale, CA
    1 day ago
  •  ...General Motors is seeking a Senior Performance Engineer to join the AV Capacity and Performance Engineering team. You will help develop and optimize large-scale ML infrastructure and GPU platforms for autonomous-vehicle research and deployment. Responsibilities include... 

    Jobleads-US

    Sunnyvale, CA
    3 days ago
  • $175k - $215k

     ...on developing the ML models and integrating...  ...sensors, enabling engineers like you to (1)...  ...learning from large scale real-world data, to...  ...models and model training at scale, to (3) analyze...  ...and recipes for distributed fine-tuning...  ...improving performance of pre-trained and fine-... 
    Training
    Full time
    Temporary work
    Remote work

    Waymo

    Mountain View, CA
    2 days ago
  • $180k - $280k

     ...across real-world scenarios.As a Staff AI/ML Engineer within the Onboard Embodied AI...  ...approaches with sophisticated neural networks trained from large-scale driving data and using state-of-the-...  ...a role-related assessment(s) and/or a pre-employment screening prior to... 
    Training
    Full time
    Local area
    Work from home
    Relocation
    Relocation package

    General Motors

    Sunnyvale, CA
    4 days ago
  • $207k - $300k

     ...through advanced context engineering and agentic feedback...  ...frameworks for Large Language Models (e.g.,...  ...information at massive scale, and extend well beyond...  ...information retrieval, distributed computing, large-scale...  ...relevant education or training. US: $207000 - $300000... 
    Training

    Google

    Mountain View, CA
    2 days ago
  • $170k - $240.8k

     ...-driven expert in ML Training Infrastructure with...  .... As a Senior ML Engineer, you will collaborate...  ...model training at scale.Raise the bar on...  ...to scale distributed training workflows...  ...training for scaling large ML modelsStrong programming...  ...(s) and/or a pre-employment screening... 
    Training
    Full time
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $174.72k - $295.68k

     ...full-time Machine Learning Engineer / Research Scientist to...  ...infrastructure experts to design, train, and deploy large-scale multi-modal models that...  ...thousands of GPUs using distributed training frameworks (FSDP,...  ...cross-functionally with infra, perception, and planning... 
    Training
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $174.72k - $295.68k

     ...seeking Machine Learning Engineers with strong expertise...  ...modeling and large-scale deep learning systems,...  ...learned simulator for training and evaluating driving...  ...and apply predictive pre-training to improve Vision...  ...hands-on experience with distributed training (FSDP, DeepSpeed... 
    Training
    Full time

    XPENG Motors

    Santa Clara, CA
    3 days ago
  • $124k - $250k

     ...LifeAs a member of our software engineering infra team, you'll solve...  ...high availability, globally distributed ecosystem platform of services...  ...model delivery, including training, serving, and optimizations...  ...MakeDesign, develop, and maintain large-scale distributed... 
    Training

    AppLovin

    Palo Alto, CA
    2 days ago
  • $152k - $261k

     ...the resources of a large global public...  ...tracking & attribution. ML opportunities...  ...Drive end-to-end Engineering and Machine learning...  ...degree of ambiguity, scale and...  ...highly available, distributed systemsPreferred Qualifications...  ..., self supervised pre-training, generative modeling... 
    Training
    Temporary work
    Work experience placement
    Flexible hours

    Coupang

    Mountain View, CA
    2 days ago
  • $144.7k - $261.3k

     ...infrastructure, and ML/AI GPU platforms...  ...Capacity and Performance Engineering teamin the...  ...provide input into large scale ML infrastructure...  ...of large-scale ML training and inference environments...  ...large-scale distributed production...  ...assessment(s) and/or a pre-employment screening... 
    Training
    Remote job
    Work at office
    Local area
    Work from home
    Flexible hours

    Jobleads-US

    Sunnyvale, CA
    3 days ago
  •  ...deliver industry-leading training and inference speeds;...  ...750 megawatts of scale, transforming key workloads...  ...validate, and stress distributed hardware systems...  ...closely with hardware engineers to isolate and resolve...  ...conceptsExperience debugging large-scale systems or... 
    Training

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $170.6k - $261.3k

     ...transportation on a global scale.As a Senior Machine Learning Engineer on the State...  ...and improve the ML perception model...  ...'ll DoDesign, train, and evaluate ML...  .... Analyze large‑scale datasets,...  ...with software and infra engineers to integrate...  ...(s) and/or a pre-employment... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed ML Infra Engineer - Large-Scale Pre-Training. Be the first to apply!