Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, ML Training Infrastructure

$140k - $260k
Full-time

Woven by Toyota

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

About The Team

Enterprise AI is a platform that provides end-to-end machine learning tooling experience to support and accelerate machine learning development, including autonomous driving and other related projects. Our platform serves customers as a standardized machine learning platform within Woven by Toyota as the larger Toyota Group companies.

The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies.

The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal.

We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform.

WHO ARE WE LOOKING FOR?

As the Engineering Manager, ML Training Infrastructure, you will lead the team responsible for building and operating the infrastructure that powers machine learning training workloads across Woven by Toyota.

You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use.

This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads.

You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform.

What You Will Enable

In this role, you will help build the infrastructure that enables teams across Woven by Toyota to train and operate increasingly large and sophisticated machine learning workloads.

Your work will directly support engineers and researchers working on AD/ADAS, Woven City, and other mobility initiatives by making compute resources easier to access, workloads more reliable, and ML development faster and more scalable.

You will have the opportunity to shape both the technical architecture of a critical ML infrastructure platform and the engineering culture of the team building it.

Responsibilities

  • Lead engineers and foster a collaborative and innovative environment.
  • Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.
  • Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.
  • Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.
  • Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
  • Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
  • Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
  • Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.
  • Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.
  • Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.
  • Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.
  • Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.
  • Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.
  • Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.
  • Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.
  • Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.

Minimum Qualifications

  • 8+ years of experience in software engineering, with at least 2 years in a leadership role.
  • Proven track record mentoring and managing high-performing software or platform teams.
  • Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure.
  • Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems.
  • Hands-on exposure to cloud platform architectures and highly resilient distributed systems.
  • Background engineering platform foundation layers designed for machine learning model development or data pipeline intensive workloads.
  • Practical understanding of massive GPU cluster management, hardware scheduling algorithms, and capacity efficiency tuning.
  • Operational background overseeing high-availability environments, leading post-incident reviews, and advancing monitoring capabilities.
  • Excellent interpersonal abilities to align technical roadmaps across diverse engineering partners and leadership stakeholders.

NICE TO HAVES

  • Experience working with Japanese customers or clients.
  • Experience with Golang development (especially for cloud services)
  • Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).
  • Experience working in environments with a focus on security and safety.
  • English/Japanese bilingual ability

The base pay for this position ranges from $ 140,000 - $ 260,000 a year.

Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.

What We Offer

We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.

・Excellent health, wellness, dental and vision coverage

・A rewarding 401k program

・Flexible vacation policy

・Family planning and care benefits

Our Commitment

・We are an equal opportunity employer and value diversity.

・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Engineering Manager, ML Training Infrastructure in California vacancy
  • $295.25k - $345.04k

     ...scale ads machine learning infrastructure to deliver effective...  ...lead a team of exceptional ML infrastructure engineers, build scalable, reliable,...  ...ML systems including model training, data pipelines, feature engineering...  ....2+ years of experience managing ML infrastructure... 
    Training
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $188.4k - $276.32k

     ...sustainability, design and engineering, ambition and...  ...mobility.The ADAS Data Infrastructure team builds and operates...  ...looking for an Engineering Manager to lead the team that...  ...partner with ADAS, ML, and platform customers...  ..., education and training; certifications; and other... 
    Training
    Hourly pay

    Lucid Motors

    Newark, CA
    2 days ago
  • $114.6k - $234.6k

     ...analysis while maintaining engineering, security, and quality standards...  ...operations, security, AI/ML, and product teams to deliver...  ...including data preparation, training and evaluation, deployment,...  ...Oracle brings together the data, infrastructure, applications, and expertise... 
    Training
    Temporary work
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    2 days ago
  • $295.25k - $345.04k

     ...large scale ads machine learning infrastructure to deliver more value to our...  ...Learning Infrastructure Engineer, you’ll build scalable, reliable...  ...infrastructure that powers ML systems across our organization...  ...boundaries of large-scale training and serving. Your work will span... 
    Training
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $224k - $356.5k

     ...unified computing architecture enables training deep neural networks in the data...  ...integrity data and sensor processing infrastructure that forms a core element of the NVIDIA...  ...pipeline. We are seeking a seasoned Engineering Manager to lead our rapidly growing NvStreams... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $164k - $295k

     ...seeking an experienced SDET Engineering Manager to lead our quality...  ...products Understanding of AI/ML security challenges, threats...  ...experience with Oracle Cloud Infrastructure (OCI), Google Cloud...  ...including recruitment, selection, training, compensation, benefits, discipline... 
    Training
    Permanent employment
    Contract work
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    20 days ago
  • $207k - $300k

     ...future requirements and infrastructure needs.Design, guide...  ...code developed by other engineers and provide feedback...  ...experience in a people management or team leadership role...  ...demands of the AI/ML hardware landscape. The...  ...relevant education or training. US: $207000 - $300000... 
    Training
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  •  ...or SSMs, a new primitive for training efficient, large-scale...  ...model innovation and systems engineering paired with a design-minded...  ...We're hiring an Engineering Manager to lead one of Cartesia's core...  ...Background in machine learning, AI infrastructure, or generative models.... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia, Inc.

    San Francisco, CA
    11 hours ago
  • $292k - $417.2k

     ...Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure...  ....What You'll Do: Lead and manage high-performing teams across...  ..., feature engineering, model training, evaluation, and serving.... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    1 day ago
  • $207k - $300k

     ...future requirements and infrastructure needs.Design, guide...  ...solutions in specialized ML areas, optimize ML...  ...experience in a people management or team leadership role...  ...Master’s degree or PhD in Engineering, Computer Science, or...  ...features supporting training and inference across... 
    Training
    Immediate start
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $207k - $300k

     ...and Antigravity.Scale infrastructure to maintain availability...  ...a team of software engineers, fostering a collaborative...  ...in a people management or team leadership role...  ...Java and working with ML inference.Like Google'...  ...relevant education or training. US: $207000 - $300000... 
    Training

    Google

    Mountain View, CA
    5 days ago
  • $168k - $270.25k

     ...optimized GPU programs for training and inference. As AI...  ...large-scale systems engineering. To address these...  ...seeking an Engineering Manager to spearhead our strategy...  ...development, CUDA software, ML framework, runtime,...  ...scalable verification infrastructure, improve engineering... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $302k - $355k

     ...Company.We are hiring a Senior Engineering Manager to lead the Machine...  ...team inside Checkr’s Data & ML organization. This team sits...  ...sophisticated hiring fraudML and agent infrastructure: evaluation systems,...  ...evaluation, golden sets, training-data provenance, model and... 
    Training
    Work at office
    Local area
    Remote work
    Relocation
    3 days per week

    Checkr

    San Francisco, CA
    5 days ago
  • $164k - $295k

     ...with you. About the Role: CrowdStrike is hiring an Engineering Manager for the Infrastructure team to lead and grow our global team of engineers...  ...employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions,... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    California
    20 days ago
  • $400k

     ...Engineering ManagerThe mission of Thinking Machines is to build AI...  ...will and judgment. We are training frontier models with Inkling...  ...We're hiring an Engineering Manager to lead a team of senior...  ...staff-level engineers across ML infrastructure and product. You will help... 
    Training
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    2 days ago
  • $276k - $343k

     ...executing our mission. Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The...  ...models across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization... 
    Training
    Full time
    Temporary work
    Relocation package

    Zoox

    San Mateo, CA
    1 day ago
  • $192k - $278k

    Direct, manage, and set strategy for the power grid...  ...degree in Electrical Engineering, Computer Engineering,...  ...shape the future of AI/ML hardware acceleration....  ...and tapeout.The AI and Infrastructure team is redefining...  ...relevant education or training. US: $192000 - $278000... 
    Training
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $295.25k - $345.04k

     ...Observability team builds the infrastructure that empowers engineers to understand, operate,...  ...for an Engineering Manager to lead the next generation...  ...observability platforms or AI/ML-powered infrastructure is...  ...professional background, training, work experience, location... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $295.25k - $345.04k

     ...shared experiences for everyone.Engineering Manager, Home InfrastructureThe Home Infrastructure team builds the mission-critical...  ...platforms, data infrastructure, or ML-powered serving systems....  ...such as professional background, training, work experience, location, business... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    3 days ago
  • $140k - $260k

     ...and Cloud & AI, the digital infrastructure powering our collaborative foundation...  .... The Enterprise AI ML Training Infrastructure team builds...  ...infrastructure that enables engineers and researchers to train,...  ...looking for an Engineering Manager to lead a team to help shape... 
    Training
    Temporary work
    Work at office
    Immediate start
    Flexible hours

    Woven by Toyota

    Palo Alto, CA
    1 day ago
  • $164k - $295k

     ...is seeking an experienced Engineering Manager to lead a cloud backend team...  ...Deep understanding of AI/ML security challenges, threats...  ...managing teams that own platform/infrastructure services consumed by...  ...including recruitment, selection, training, compensation, benefits,... 
    Training
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week
    Sunnyvale, CA
    20 days ago
  •  ...LayoutGen), and the evaluation science and infrastructure that tells us what actually works. You...  ...from creator outcomes back into training data, model updates, and release decisions...  ...roles overseeing applied AI or ML engineering organizations that have shipped generative... 
    Training
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    1 day ago
  • $307k - $427k

     ...policy enforcement, and ML systems. Own the...  ...translating it into concrete engineering requirements and...  ...shared safety and security infrastructure that AI workloads...  ...technical direction without managing people: defining...  ...relevant education or training. US: $307000 - $427000... 
    Training

    Google

    Sunnyvale, CA
    5 days ago
  • $220.4k - $297.4k

     ...world's best data and AI infrastructure platform, so our...  ...to their missions.Our engineering teams build highly technical...  ...data analytics and ML platform in the world....  ...Authentication, Identity Management, Access Control, Key...  ...certifications and training, and specific work location... 
    Training
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $200k - $275k

     ...Principal Forward Deployed Engineer to partner directly with business...  ...AI productivity, knowledge management, customer support,...  ...including software, data, AI/ML, cloud infrastructure, and platform engineering....  ...location, experience, education, training, external market data,... 
    Training
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    5 days ago
  • $237.6k - $362.34k

     ...- from how consumers understand and manage their finances, to how developers build...  ...will lead a team of 4 engineers, ranging from junior to staff, developing...  ...applications spaceNice to have:Experience training and/or serving ML models in production, or fine-tuning... 
    Training
    Full time
    Work experience placement
    Local area
    Shift work

    Plaid Financial

    San Francisco, CA
    4 days ago
  • $171.6k - $245k

     ...Center Networking is the infrastructure foundation for the AI...  ...a Senior Product Manager to manage our product...  ...for secure, scalable AI/ML fabrics and enterprise...  ...customersInfluence and work with engineering, supply chain, finance...  ..., and/or training. The full salary range... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    3 days ago
  • $199k - $234k

     ...giving a growing number of engineers and employees an AI...  ...matter!As Engineering Manager, you will lead the...  ...in developing critical infrastructure for Agentic applications...  ...expertise in applied ML at scale. You'll partner...  ...include education, training, experience, location,... 
    Training
    Work at office
    Flexible hours
    Shift work

    Robinhood Financial

    Menlo Park, CA
    5 days ago
  • $190k - $240k

     ...As part of this effort, we’re hiring an Engineering Manager to lead our Machine Learning...  ...Experience applying, developing, and deploying ML models for significant business impact...  ...depth of experience, relevant education or training, and additional role-related... 
    Training
    Full time
    Remote work
    Flexible hours

    ZipRecruiter

    Los Angeles, CA
    4 days ago
  • $207k - $300k

     ...abreast of the latest advancements in AI/ML, particularly in GenAI, and guide...  ...for enterprise use cases.Manage and mentor a team of Software Engineers, fostering their growth and development...  ...experience, and relevant education or training. US: $207000 - $300000 (USD) + 20%... 
    Training

    Google

    Sunnyvale, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, ML Training Infrastructure. Be the first to apply!