Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, ML Training Infrastructure

$140k - $260k
Full-time

Woven by Toyota

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

About The Team

Enterprise AI is a platform that provides end-to-end machine learning tooling experience to support and accelerate machine learning development, including autonomous driving and other related projects. Our platform serves customers as a standardized machine learning platform within Woven by Toyota as the larger Toyota Group companies.

The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies.

The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal.

We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform.

WHO ARE WE LOOKING FOR?

As the Engineering Manager, ML Training Infrastructure, you will lead the team responsible for building and operating the infrastructure that powers machine learning training workloads across Woven by Toyota.

You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use.

This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads.

You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform.

What You Will Enable

In this role, you will help build the infrastructure that enables teams across Woven by Toyota to train and operate increasingly large and sophisticated machine learning workloads.

Your work will directly support engineers and researchers working on AD/ADAS, Woven City, and other mobility initiatives by making compute resources easier to access, workloads more reliable, and ML development faster and more scalable.

You will have the opportunity to shape both the technical architecture of a critical ML infrastructure platform and the engineering culture of the team building it.

Responsibilities

  • Lead engineers and foster a collaborative and innovative environment.
  • Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.
  • Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.
  • Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.
  • Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
  • Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
  • Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
  • Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.
  • Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.
  • Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.
  • Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.
  • Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.
  • Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.
  • Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.
  • Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.
  • Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.

Minimum Qualifications

  • 8+ years of experience in software engineering, with at least 2 years in a leadership role.
  • Proven track record mentoring and managing high-performing software or platform teams.
  • Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure.
  • Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems.
  • Hands-on exposure to cloud platform architectures and highly resilient distributed systems.
  • Background engineering platform foundation layers designed for machine learning model development or data pipeline intensive workloads.
  • Practical understanding of massive GPU cluster management, hardware scheduling algorithms, and capacity efficiency tuning.
  • Operational background overseeing high-availability environments, leading post-incident reviews, and advancing monitoring capabilities.
  • Excellent interpersonal abilities to align technical roadmaps across diverse engineering partners and leadership stakeholders.

NICE TO HAVES

  • Experience working with Japanese customers or clients.
  • Experience with Golang development (especially for cloud services)
  • Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).
  • Experience working in environments with a focus on security and safety.
  • English/Japanese bilingual ability

The base pay for this position ranges from $ 140,000 - $ 260,000 a year.

Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.

What We Offer

We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.

・Excellent health, wellness, dental and vision coverage

・A rewarding 401k program

・Flexible vacation policy

・Family planning and care benefits

Our Commitment

・We are an equal opportunity employer and value diversity.

・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, ML Training Infrastructure in California vacancy
  • $260k - $350k

     ...started. Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible...  ...infrastructure that enables Harvey to train, evaluate, deploy, and operate our...  ...infrastructure, model training platforms, or ML infrastructure. Familiarity with... 
    Training
    Full time

    Harvey

    San Francisco, CA
    9 days ago
  • $114.6k - $234.6k

     ...analysis while maintaining engineering, security, and quality standards...  ...operations, security, AI/ML, and product teams to deliver...  ...including data preparation, training and evaluation, deployment,...  ...Oracle brings together the data, infrastructure, applications, and expertise... 
    Training
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    2 days ago
  • $164k - $295k

     ...seeking an experienced SDET Engineering Manager to lead our quality...  ...products Understanding of AI/ML security challenges, threats...  ...experience with Oracle Cloud Infrastructure (OCI), Google Cloud...  ...including recruitment, selection, training, compensation, benefits, discipline... 
    Training
    Permanent employment
    Contract work
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    a month ago
  • $164k - $295k

     ...with you. About the Role: CrowdStrike is hiring an Engineering Manager for the Infrastructure team to lead and grow our global team of engineers...  ...employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions,... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    California
    a month ago
  • $224k - $356.5k

     ...unified computing architecture enables training deep neural networks in the data...  ...integrity data and sensor processing infrastructure that forms a core element of the NVIDIA...  ...pipeline. We are seeking a seasoned Engineering Manager to lead our rapidly growing NvStreams... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $188.4k - $276.32k

     ...sustainability, design and engineering, ambition and...  ...mobility.The ADAS Data Infrastructure team builds and operates...  ...looking for an Engineering Manager to lead the team that...  ...partner with ADAS, ML, and platform customers...  ..., education and training; certifications; and other... 
    Training
    Hourly pay

    Lucid Motors

    Newark, CA
    3 days ago
  •  ...and Cloud & AI, the digital infrastructure powering our collaborative foundation...  .... The Enterprise AI ML Training Infrastructure team builds...  ...infrastructure that enables engineers and researchers to train,...  ...looking for an Engineering Manager to lead a team to help shape... 
    Training
    Work at office

    woven-by-toyota

    Palo Alto, CA
    5 days ago
  • $262k - $364k

     ...future requirements and infrastructure needs.Oversee systems...  ..., lead large-scale ML infrastructure optimization...  ...in a people management, supervision/team leadership...  ...across multiple software engineering, research, product...  ...relevant education or training. US: $262000 - $364000... 
    Training

    Google

    Mountain View, CA
    1 day ago
  • $207k - $300k

     ...future requirements and infrastructure needs.Design, guide...  ...solutions in specialized ML areas, optimize ML...  ...experience in a people management or team leadership role...  ...Master’s degree or PhD in Engineering, Computer Science, or...  ...features supporting training and inference across... 
    Training
    Immediate start
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $295.25k - $345.04k

     ...large scale ads machine learning infrastructure to deliver effective...  ...Machine Learning Infrastructure Engineer, you’ll build scalable, reliable...  ...infrastructure that powers ML systems across our organization...  ...boundaries of large-scale training and serving. Your work will span... 
    Training
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $262.5k - $394k

     ...systems powering Apple Foundation Models and large-scale ML training. We are designing and building an AI-native table format from...  ...of GPUs and TPUs.DescriptionAs a Staff/Principal ML Infrastructure Engineer on the team, you will architect the on-disk format, indexing... 
    Training
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • $276k - $343k

     ...executing our mission. Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The...  ...models across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization... 
    Training
    Full time
    Temporary work
    Relocation package

    Zoox

    San Mateo, CA
    1 day ago
  •  ...executing our mission.    Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The...  ...across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization... 
    Training
    Full time

    zoox

    Foster, CA
    5 days ago
  • $140k - $220k

     ...seeking an experienced SDET Engineering Manager to lead our quality...  ...productsUnderstanding of AI/ML security challenges, threats...  ...experience with Oracle Cloud Infrastructure (OCI), Google Cloud Platform...  ...including recruitment, selection, training, compensation, benefits,... 
    Training
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week

    CrowdStrike

    Sunnyvale, CA
    5 days ago
  • $180k - $205k

     ...belong. About the Role The Manager of Infrastructure - Platform Engineering is an integral part of Latham’s Technology...  ...application hosting and AI/ML workload placementContributing...  ...allocation, and storage patterns for model training and inferenceDemonstrate advanced... 
    Training
    Work experience placement
    Work at office
    Flexible hours

    Latham&Watkins

    Los Angeles, CA
    4 days ago
  • $164k - $295k

     ...is seeking an experienced Engineering Manager to lead a cloud backend team...  ...Deep understanding of AI/ML security challenges, threats...  ...managing teams that own platform/infrastructure services consumed by...  ...including recruitment, selection, training, compensation, benefits,... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    a month ago
  • $192k - $278k

    Direct, manage, and set strategy for the power grid...  ...degree in Electrical Engineering, Computer Engineering,...  ...shape the future of AI/ML hardware acceleration....  ...and tapeout.The AI and Infrastructure team is redefining...  ...relevant education or training. US: $192000 - $278000... 
    Training
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $295.25k - $345.04k

     ...Observability team builds the infrastructure that empowers engineers to understand, operate,...  ...for an Engineering Manager to lead the next generation...  ...observability platforms or AI/ML-powered infrastructure is...  ...professional background, training, work experience, location... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $295.25k - $345.04k

     ...shared experiences for everyone.Engineering Manager, Home InfrastructureThe Home Infrastructure team builds the mission-critical...  ...platforms, data infrastructure, or ML-powered serving systems....  ...such as professional background, training, work experience, location, business... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    3 days ago
  • $171.6k - $245k

     ...Meet the TeamThe Network Engineering group is at the...  ...transformation as next-generation infrastructure is developed to support rapidly growing AI/ML workloads and the ever...  ...Cisco. This team manages quality and security...  ..., and/or training. The full salary range... 
    Training
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    4 days ago
  • $215k - $315k

     ...customers. You’ll lead the engineering team that takes the services...  ...regulated, high-assurance infrastructure, without forking the product...  ...monitoring, vulnerability management, incident response, and the...  ...and relevant education or training. #LI-CG1 Actual compensation... 
    Training
    Local area
    Remote work
    Shift work

    Snorkel AI

    San Francisco, CA
    9 days ago
  • $144.6k - $263.8k

     ...seeking a Technical Program Manager to drive high-performance ML frameworks and...  ...platforms. We support ML engineers andscientists through technologies...  ...Apple silicon and infrastructure, unlocking the creation...  ...including experience with ML training (e.g. train/test,... 
    Training
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $175.5k - $311.7k

     ...critical intersection of our ML organizations, underlying compute infrastructure, and core platform...  ...Apple’s software engineering teams with efficient, scalable...  ...ML compute lifecycle management to build and own our governance...  ...with ML training infrastructure concepts... 
    Training
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...LayoutGen), and the evaluation science and infrastructure that tells us what actually works. You...  ...from creator outcomes back into training data, model updates, and release decisions...  ...roles overseeing applied AI or ML engineering organizations that have shipped generative... 
    Training
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    1 day ago
  • $307k - $427k

     ...policy enforcement, and ML systems. Own the...  ...translating it into concrete engineering requirements and...  ...shared safety and security infrastructure that AI workloads...  ...technical direction without managing people: defining...  ...relevant education or training. US: $307000 - $427000... 
    Training

    Google

    Sunnyvale, CA
    1 day ago
  •  ...applications and platforms. How consumers manage their money, how developers build...  ...beyondResponsibilities:Lead a team of 6 engineers, ranging from junior to staff,...  ...such as agents, RAG, or evalsExperience training or serving ML models in productionExperience working... 
    Training
    Work experience placement
    Work at office
    Local area

    Plaid Financial

    San Francisco, CA
    4 days ago
  • $302k

     ...large-scale Foundation Models trained on Uber's proprietary...  ...marketplace behavior, improve existing ML systems, and unlock entirely...  ...for an exceptional Principal Engineer, Machine Learning / AI to...  ...the development of training infrastructure, distributed computing capabilities... 
    Training
    Full time
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    4 days ago
  • $190k - $260k

     ...as the speed at which we can train it. Every improvement to our...  ...scale world models - depends on infrastructure that turns thousands of hours...  .... We are looking for engineers who make model training fast:...  ...streamable formatsPartner with ML teams to scale new architectures... 
    Training
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    1 day ago
  • $254.4k - $381.6k

     ...DescriptionWe are seeking an exceptional Senior Engineering Manager to lead the engineering organization...  ...reasoning capabilities, retrieval infrastructure, and knowledge generation platforms...  ...and R&D experience in LLM post-training, reinforcement learning for language... 
    Training
    Worldwide
    Relocation

    Apple

    Santa Clara, CA
    3 days ago
  • $280k - $385k

     ...world's best data and AI infrastructure platform, so our...  ...to their missions.Our engineering teams build highly technical...  ...data analytics and ML platform in the world....  ...Trust, Safety, Identity Management, Access Control, Key...  ...relevant certifications and training, and specific work... 
    Training
    Local area
    Remote work
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, ML Training Infrastructure. Be the first to apply!