Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Lead - Real-Time, Large-Scale Training

TikTok USDS Joint Venture

TikTok USDS Joint Venture LLC is seeking an experienced machine learning infrastructure leader to drive the roadmap for ultra large-scale training and real-time inference across billions-parameter models. You will supervise multi-node GPU clusters, optimize data pipelines, and partner with research teams to push state-of-the-art generative recommendation systems. The role requires on-site presence in Los Angeles, collaboration across cross-functional teams, and a strong focus on security, #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Lead - Real-Time, Large-Scale Training in San Jose, CA vacancy
  •  ...develops system and infrastructure solutions...  ...weights through full-scale deployments....  ...analysis of real-world workloads...  ...a Performance Lead to answer forward...  ...workloads, including training and/or...  ...networking in large-scale distributed...  ...one layer at a time. Nobody designed... 
    Training

    Renice AI, Inc.

    Mountain View, CA
    4 days ago
  • $192.2k - $260k

     ...research and development of real-time multimodal conversational...  ..., and building the post-training systems (reward modeling,...  ...You’ll Do Foundation Model Scaling - Help build and train large-scale multimodal foundation...  ...open-source speech/audio ML systems or widely used research... 
    Training
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    6 days ago
  • $184k - $287.5k

     ...vehicles, robotics, medical training, and gaming to get these technologies...  ...models from research to real-world use? We’d love to hear...  ..., rendering, and real-time inference from prototype through...  ...vehicles, computer vision, or large-scale ML systems.Experience building and... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  •  ...Seed invites an intern to join the Seed Infrastructure team in San Jose. You will conduct research on infrastructure and systems for large-scale models, aiming to improve efficiency, scalability, and reliability across training platforms, inference systems, compilers,... 
    Training
    Internship

    ByteDance

    San Jose, CA
    3 days ago
  • $162k - $387.6k

     ...TikTok Recommendation-Large Recommender Models...  ...advancing large-scale recommender...  ...recommender models, from training and fine-tuning to...  ...functional teams (infrastructure, product, research...  ...of Paid Personal Time (prorated upon...  ...TikTok is the leading destination for short... 
    Training
    Temporary work
    Local area

    TikTok

    San Jose, CA
    4 days ago
  • $186.9k - $267.7k

     ...environment spans hyper-scale data centers, cloud infrastructure, and highly...  ...troubleshoot large-scale...  ..., translating real-world constraints...  ...improve mean time to detect and...  ...and leverage AI/ML or LLM-based approaches...  ...ability to lead technically...  ..., and/or training. The full salary... 
    Training
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    4 days ago
  • $213k - $287.5k

     ...unimaginable a short time ago—even yesterday...  ..., low-cost infrastructure platform in the cloud...  ...member of the Cloud-Scale Machine Learning...  ...learning inference and training datacenter servers...  ...(RTL2GDS) for ML Accelerator chips...  ...gating- Experience leading or solely developing... 
    Training
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  •  ...optimize, and deploy production ML models across our autonomous...  ...perception, prediction, planning, infrastructure, systems, and hardware teams to deliver scalable, real-time ML across on-vehicle and cloud...  ..., including data strategy, training, and deployment #J-18808-... 
    Training
    Work at office

    Gatik AI

    Santa Clara, CA
    3 days ago
  •  ...vision. As a frontend engineer, you'll architect and scale high-performance React and TypeScript apps for real-time surveillance, building UI for video playback,...  ...camera grids. Work closely with Product, Design, and ML engineers to turn AI detection into simple user... 

    Coram AI

    Sunnyvale, CA
    3 days ago
  • $224k - $356.5k

     ...partners solve complex, real-world challenge....  ...ecosystems, large-scale distributed systems, or AI/ML infrastructure — with direct work...  ...scale.Experience leading and growing developer...  ...computing, AI/ML training and inference, and...  ...Seattle; US, CA, Santa ClaraType: Full time
    Training
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    6 days ago
  •  ...~ Full-time Company Description...  ...-native AI infrastructure company,...  ...cluster, model the real TCO, prove...  ...build and lead the sales engineering...  ...bar as we scale headcount and...  ...stood up training and inference...  ...a customer's ML infra lead, and closed large deals with cycles... 
    Training
    Full time

    Mirantis

    San Jose, CA
    17 hours ago
  • $266.1k - $342.9k

     ...solutions that have a real-world impact. In...  ...role at a time when our technology...  ...to life.You will lead a large, highly motivated...  ...customer’s hyperscale infrastructure.Scale Through...  ...interconnect (DCI), and AI/ML cluster...  ...certifications, and/or training. The full salary... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    5 days ago
  • $164k - $295k

     ...platform. We work on large scale distributed systems, processing...  ...understanding of AI/ML security challenges,...  ...Experience with real-time data processing systems...  ...such as Oracle Cloud Infrastructure (OCI), Google Cloud Platform...  ..., selection, training, compensation, benefits... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    10 days ago
  • $229.9k - $262.4k

     ...Platform, Agentic Infrastructure)At Capital One,...  ...learning to create real-time, personalized...  ...applications of AI & ML are bringing...  ...deliver our industry leading capabilities with...  ...foundation model training, large language model inference...  ...— of large scale production AI... 
    Training
    Full time
    Part time
    Local area

    Capital One Group

    San Jose, CA
    4 days ago
  • $229.9k - $262.4k

     ...learning to create real‑time, personalized...  ...investments in technology infrastructure and world‑class...  ...of AI & ML are bringing humanity...  ...deliver our industry leading capabilities with...  ...foundation model training, large language model...  ...— of large scale production AI systems... 
    Training
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    2 days ago
  • $164k - $295k

     ...platform. We work on large scale distributed...  ...Engineering Manager to lead a cloud backend...  ...understanding of AI/ML security challenges...  ...that own platform/infrastructure services consumed...  ...Experience with real-time data processing systems...  ..., selection, training, compensation, benefits... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    17 days ago
  • $136.3k - $199.9k

     ...with the world’s leading technology...  ...scientists and AI infrastructure engineers whose...  ...is to build and scale machine...  ...technologies that enable large-scale AI and...  ...that powers model training, inference,...  ...management.AI/ML Integration: Understanding...  ...(EAP), paid time off and paid... 
    Training
    Minimum wage
    Full time
    Work experience placement
    Flexible hours

    KLA-Tencor

    Milpitas, CA
    8 days ago
  • $156k - $316.8k

     ...Privacy-Preserving Large-Scale Model Training & Architecture...  ...diffusion systems). Lead GPU-centric...  ...efficiency under real-world production...  ...privacy-preserving ML, sensitive data training...  ...in production ML infrastructure supporting...  ...of Paid Personal Time (prorated upon hire... 
    Training
    Temporary work
    Local area

    Ellis Technologies, Inc.

    San Jose, CA
    4 days ago
  • $244.7k - $279.2k

     ...learning to create real-time, personalized...  ...investments in technology infrastructure and world-class...  ...of AI & ML are bringing humanity...  ...deliver our industry leading capabilities with...  ...an AI native, at-scale (15,000+ users at...  ...foundation model training, large language model... 
    Training
    Full time
    Part time
    Local area
    Remote work

    Capital One

    San Jose, CA
    3 days ago
  • $212.7k - $287.7k

     ...delivers best-in-class ML training performance with...  ...Neuron is used at scale by customers such as...  ...learn all of the time. We operate in spaces that are very large, yet our teams remain...  ...SDM III, you will lead a team of experienced...  ...what unblocks real ML workloads on TrainiumA... 
    Training
    Local area
    Work from home
    Relocation
    Flexible hours
    Day shift

    Amazon

    Cupertino, CA
    7 days ago
  • $272k - $431.25k

     ...and optimize AI workloads on large-scale GPU and CPU clusters used for...  ...distributed Deep Learning LLM training and inference. Your primary...  ...and autonomous engineer with a real passion for technology, we...  ...; US, TX, Remote; US, CO, Remote; US, WA, RemoteType: Full time
    Training
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    8 days ago
  • $150k - $387.6k

     ...to create hyper-scale data-center...  ...building a world-leading hyperscale data...  ...center network infrastructure that supports hundreds...  ...of users' real-time access and...  ..., particularly Large Language Models...  ...Smart Runbooks: Train operational Agents...  ...Passion for AIOps/ML/LLM Practices:... 
    Training
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    4 days ago
  • $114.6k - $234.6k

     ...reliably at cloud scale....  ...localization time, accuracy, false...  ...distributed services, large-scale...  ...telemetry pipelines, real-time network...  .... Lead design, and code...  ...security, AI/ML, and product...  ...preparation, training and evaluation...  ...together the data, infrastructure, applications... 
    Training
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    4 days ago
  • $229.9k - $262.4k

     ...learning to create real-time, personalized...  ...investments in technology infrastructure and world‑class...  ...of AI & ML are bringing humanity...  ...deliver our industry leading capabilities with...  ...foundation model training, large language model...  ...— of large scale production AI systems... 
    Training
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    5 days ago
  • $164k - $295k

     ...platform. We work on large scale distributed...  ...Engineering Manager to lead the SGNL backend...  ...plane, providing real-time identity security...  ...product management, infrastructure, and engineering teams...  ...(Kafka/Flink), or ML-based behavioral...  ..., selection, training, compensation, benefits... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week
    3 days per week
    Sunnyvale, CA
    7 days ago
  •  ...in AI cloud infrastructure serving tens...  ...groundbreaking AI training and inference...  ...solutions at scale across object...  ...of large-scale distributed...  ...a technical lead or Staff+ IC...  ...Background in HPC, AI/ML...  ...and IOPS under real workloads using...  ...Flexible paid time off plan that... 
    Training
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    6 days ago
  • $263.7k - $333.4k

     ...purpose-built large language...  ...solving complex, real-world problems...  ...at a global scale.Your ImpactAs...  ...Moving beyond leading individual...  ...end-to-end pre-training and alignment...  ...observability infrastructure.Spearhead...  ...of generative ML models to highly...  ...periods of time.U.S. employees... 
    Training
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    4 days ago
  • $184.7k - $324.8k

     ...ML Infrastructure Engineer - ML Compute CapacityScaling machine learning workloads across...  ...build the infrastructure that powers large-scale ML training and inference workloads, bringing together...  ..., and dashboards — that surfaces real-time fleet health and efficiency... 
    Training
    Relocation

    Apple

    Santa Clara, CA
    3 days ago
  • $90k - $120k

     ...are looking for an ML Engineer to own model...  ...performed against large linked datasets...  ...architecture selection, training, calibration and...  ...committing to full-scale training. Benchmark...  ...prevention on real observational data....  ...Employment Type: Full-time, W-2. Eligibility... 
    Training
    Full time
    Remote work

    iAdeptive Technologies

    Santa Clara, CA
    3 days ago
  •  ...the end-to-end inference stack for real-time multimodal conversational AI. You...  ...serving paths, and develop offline training and RL/evaluation infrastructure. Expect cross-team collaboration...  ...architecture co-design, optimize large-scale inference, and implement #J-18808-... 
    Training

    Amazon

    Sunnyvale, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Lead - Real-Time, Large-Scale Training. Be the first to apply!