Engineering Manager, ML Training Infrastructure
$140k - $260kFull-time
Woven by Toyota
Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society. Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all. About The Team Enterprise AI is a platform that provides end-to-end machine learning tooling experience to support and accelerate machine learning development, including autonomous driving and other related projects. Our platform serves customers as a standardized machine learning platform within Woven by Toyota as the larger Toyota Group companies. The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies. The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal. We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform. WHO ARE WE LOOKING FOR? As the Engineering Manager, ML Training Infrastructure, you will lead the team responsible for building and operating the infrastructure that powers machine learning training workloads across Woven by Toyota. You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use. This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads. You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform. What You Will Enable In this role, you will help build the infrastructure that enables teams across Woven by Toyota to train and operate increasingly large and sophisticated machine learning workloads. Your work will directly support engineers and researchers working on AD/ADAS, Woven City, and other mobility initiatives by making compute resources easier to access, workloads more reliable, and ML development faster and more scalable. You will have the opportunity to shape both the technical architecture of a critical ML infrastructure platform and the engineering culture of the team building it. Responsibilities
- Lead engineers and foster a collaborative and innovative environment.
- Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.
- Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.
- Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.
- Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
- Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
- Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
- Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.
- Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.
- Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.
- Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.
- Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.
- Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.
- Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.
- Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.
- Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.
- 8+ years of experience in software engineering, with at least 2 years in a leadership role.
- Proven track record mentoring and managing high-performing software or platform teams.
- Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure.
- Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems.
- Hands-on exposure to cloud platform architectures and highly resilient distributed systems.
- Background engineering platform foundation layers designed for machine learning model development or data pipeline intensive workloads.
- Practical understanding of massive GPU cluster management, hardware scheduling algorithms, and capacity efficiency tuning.
- Operational background overseeing high-availability environments, leading post-incident reviews, and advancing monitoring capabilities.
- Excellent interpersonal abilities to align technical roadmaps across diverse engineering partners and leadership stakeholders.
- Experience working with Japanese customers or clients.
- Experience with Golang development (especially for cloud services)
- Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).
- Experience working in environments with a focus on security and safety.
- English/Japanese bilingual ability
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, ML Training Infrastructure in California vacancy
$260k - $350k
...started. Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible... ...infrastructure that enables Harvey to train, evaluate, deploy, and operate our... ...infrastructure, model training platforms, or ML infrastructure. Familiarity with...TrainingFull time$114.6k - $234.6k
...analysis while maintaining engineering, security, and quality standards... ...operations, security, AI/ML, and product teams to deliver... ...including data preparation, training and evaluation, deployment,... ...Oracle brings together the data, infrastructure, applications, and expertise...TrainingTemporary workFlexible hours$164k - $295k
...seeking an experienced SDET Engineering Manager to lead our quality... ...products Understanding of AI/ML security challenges, threats... ...experience with Oracle Cloud Infrastructure (OCI), Google Cloud... ...including recruitment, selection, training, compensation, benefits, discipline...TrainingPermanent employmentContract workWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$164k - $295k
...with you. About the Role: CrowdStrike is hiring an Engineering Manager for the Infrastructure team to lead and grow our global team of engineers... ...employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions,...TrainingPermanent employmentWork experience placementWork at officeLocal areaRemote work$224k - $356.5k
...unified computing architecture enables training deep neural networks in the data... ...integrity data and sensor processing infrastructure that forms a core element of the NVIDIA... ...pipeline. We are seeking a seasoned Engineering Manager to lead our rapidly growing NvStreams...TrainingFull time$188.4k - $276.32k
...sustainability, design and engineering, ambition and... ...mobility.The ADAS Data Infrastructure team builds and operates... ...looking for an Engineering Manager to lead the team that... ...partner with ADAS, ML, and platform customers... ..., education and training; certifications; and other...TrainingHourly pay- ...and Cloud & AI, the digital infrastructure powering our collaborative foundation... .... The Enterprise AI ML Training Infrastructure team builds... ...infrastructure that enables engineers and researchers to train,... ...looking for an Engineering Manager to lead a team to help shape...TrainingWork at office
$262k - $364k
...future requirements and infrastructure needs.Oversee systems... ..., lead large-scale ML infrastructure optimization... ...in a people management, supervision/team leadership... ...across multiple software engineering, research, product... ...relevant education or training. US: $262000 - $364000...Training$207k - $300k
...future requirements and infrastructure needs.Design, guide... ...solutions in specialized ML areas, optimize ML... ...experience in a people management or team leadership role... ...Master’s degree or PhD in Engineering, Computer Science, or... ...features supporting training and inference across...TrainingImmediate startWorldwide$295.25k - $345.04k
...large scale ads machine learning infrastructure to deliver effective... ...Machine Learning Infrastructure Engineer, you’ll build scalable, reliable... ...infrastructure that powers ML systems across our organization... ...boundaries of large-scale training and serving. Your work will span...TrainingFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$262.5k - $394k
...systems powering Apple Foundation Models and large-scale ML training. We are designing and building an AI-native table format from... ...of GPUs and TPUs.DescriptionAs a Staff/Principal ML Infrastructure Engineer on the team, you will architect the on-disk format, indexing...TrainingRelocation$276k - $343k
...executing our mission. Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The... ...models across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization...TrainingFull timeTemporary workRelocation package- ...executing our mission. Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The... ...across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization...TrainingFull time
$140k - $220k
...seeking an experienced SDET Engineering Manager to lead our quality... ...productsUnderstanding of AI/ML security challenges, threats... ...experience with Oracle Cloud Infrastructure (OCI), Google Cloud Platform... ...including recruitment, selection, training, compensation, benefits,...TrainingFull timeContract workWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$180k - $205k
...belong. About the Role The Manager of Infrastructure - Platform Engineering is an integral part of Latham’s Technology... ...application hosting and AI/ML workload placementContributing... ...allocation, and storage patterns for model training and inferenceDemonstrate advanced...TrainingWork experience placementWork at officeFlexible hours$164k - $295k
...is seeking an experienced Engineering Manager to lead a cloud backend team... ...Deep understanding of AI/ML security challenges, threats... ...managing teams that own platform/infrastructure services consumed by... ...including recruitment, selection, training, compensation, benefits,...TrainingPermanent employmentWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$192k - $278k
Direct, manage, and set strategy for the power grid... ...degree in Electrical Engineering, Computer Engineering,... ...shape the future of AI/ML hardware acceleration.... ...and tapeout.The AI and Infrastructure team is redefining... ...relevant education or training. US: $192000 - $278000...TrainingWorldwide$295.25k - $345.04k
...Observability team builds the infrastructure that empowers engineers to understand, operate,... ...for an Engineering Manager to lead the next generation... ...observability platforms or AI/ML-powered infrastructure is... ...professional background, training, work experience, location...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$295.25k - $345.04k
...shared experiences for everyone.Engineering Manager, Home InfrastructureThe Home Infrastructure team builds the mission-critical... ...platforms, data infrastructure, or ML-powered serving systems.... ...such as professional background, training, work experience, location, business...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$171.6k - $245k
...Meet the TeamThe Network Engineering group is at the... ...transformation as next-generation infrastructure is developed to support rapidly growing AI/ML workloads and the ever... ...Cisco. This team manages quality and security... ..., and/or training. The full salary range...TrainingFull timeTemporary workWork experience placementLocal areaFlexible hours$215k - $315k
...customers. You’ll lead the engineering team that takes the services... ...regulated, high-assurance infrastructure, without forking the product... ...monitoring, vulnerability management, incident response, and the... ...and relevant education or training. #LI-CG1 Actual compensation...TrainingLocal areaRemote workShift work$144.6k - $263.8k
...seeking a Technical Program Manager to drive high-performance ML frameworks and... ...platforms. We support ML engineers andscientists through technologies... ...Apple silicon and infrastructure, unlocking the creation... ...including experience with ML training (e.g. train/test,...TrainingRelocation$175.5k - $311.7k
...critical intersection of our ML organizations, underlying compute infrastructure, and core platform... ...Apple’s software engineering teams with efficient, scalable... ...ML compute lifecycle management to build and own our governance... ...with ML training infrastructure concepts...TrainingRelocation- ...LayoutGen), and the evaluation science and infrastructure that tells us what actually works. You... ...from creator outcomes back into training data, model updates, and release decisions... ...roles overseeing applied AI or ML engineering organizations that have shipped generative...TrainingFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday
$307k - $427k
...policy enforcement, and ML systems. Own the... ...translating it into concrete engineering requirements and... ...shared safety and security infrastructure that AI workloads... ...technical direction without managing people: defining... ...relevant education or training. US: $307000 - $427000...Training- ...applications and platforms. How consumers manage their money, how developers build... ...beyondResponsibilities:Lead a team of 6 engineers, ranging from junior to staff,... ...such as agents, RAG, or evalsExperience training or serving ML models in productionExperience working...TrainingWork experience placementWork at officeLocal area
$302k
...large-scale Foundation Models trained on Uber's proprietary... ...marketplace behavior, improve existing ML systems, and unlock entirely... ...for an exceptional Principal Engineer, Machine Learning / AI to... ...the development of training infrastructure, distributed computing capabilities...TrainingFull timeWork at officeRemote work$190k - $260k
...as the speed at which we can train it. Every improvement to our... ...scale world models - depends on infrastructure that turns thousands of hours... .... We are looking for engineers who make model training fast:... ...streamable formatsPartner with ML teams to scale new architectures...TrainingTemporary workWork at officeVisa sponsorship$254.4k - $381.6k
...DescriptionWe are seeking an exceptional Senior Engineering Manager to lead the engineering organization... ...reasoning capabilities, retrieval infrastructure, and knowledge generation platforms... ...and R&D experience in LLM post-training, reinforcement learning for language...TrainingWorldwideRelocation$280k - $385k
...world's best data and AI infrastructure platform, so our... ...to their missions.Our engineering teams build highly technical... ...data analytics and ML platform in the world.... ...Trust, Safety, Identity Management, Access Control, Key... ...relevant certifications and training, and specific work...TrainingLocal areaRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, ML Training Infrastructure. Be the first to apply!
Related searches
- principal infrastructure engineer California
- infrastructure engineering manager California
- infrastructure developer California
- infrastructure engineer California
- remote infrastructure engineer California
- data infrastructure engineer California
- senior infrastructure engineer California
- IT operations director California
- machine learning California
- machine learning research scientist California



