Engineering Manager, AI/ML Training Infra
$207k - $300kSet and communicate team priorities that support the broader organization's goals. Align strategy, processes, and decision-making across teams.Set clear expectations with individuals based on their level and role and aligned to the broader organization's goals. Meet regularly with individuals to discuss performance and development and provide feedback and coaching.Develop the mid-term technical vision and roadmap within the scope of your often multiple teams. Evolve the roadmap to meet anticipated future requirements and infrastructure needs.Design, guide and vet systems designs within the scope of the broader area, and write product or system development code to solve ambiguous problems.Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.Minimum qualifications:Bachelor’s degree or equivalent practical experience.8 years of experience in software development.5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field.3 years of experience in a technical leadership role.2 years of experience in a people management or team leadership role.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Experience with distributed systems and have a passion for building reliability, scalable and efficient infrastructure. Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.In this role, you will lead and manage a high-performing team of Software Engineers (SWEs) focused on the design, implementation, and launch of critical scheduling features supporting training and inference across Alphabet. You will support key internal customers and products including DeepMind (DM), Google Search, YouTube, Ads, and Waymo while partnering closely with leadership and engineering teams across Compute infrastructure, SRE, Scheduling, XManager, Uniserve, and other key infrastructure stakeholders to drive aligned technical roadmaps. Additionally, you will shape the technical direction for next-generation scheduling infrastructure, balancing long-term architectural health with immediate business delivery needs.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor’s degree or equivalent practical experience.8 years of experience in software development.5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field.3 years of experience in a technical leadership role.2 years of experience in a people management or team leadership role.
$168k - $270.25k
...computing, and modern AI. Today, NVIDIA high-performance... ...GPU programs for training and inference. As AI... ...and large-scale systems engineering. To address these complex... ...seeking an Engineering Manager to spearhead our... ...development, CUDA software, ML framework, runtime, product...TrainingFull time$207k - $300k
...and system design for the ML Efficiency Hub, driving complex 1-6 month Engineers and 2-4 week Strike... ...integrating generative AI tools or LLM interfaces... ...Search. Software Engineering Managers have not only the technical... ...relevant education or training. US: $207000 - $300000 (...TrainingPermanent employment$140k - $215k
...with the world’s most advanced AI-native platform. We work on... ...seeking an experienced SDET Engineering Manager to lead our quality engineering... ...productsUnderstanding of AI/ML security challenges, threats,... ...including recruitment, selection, training, compensation, benefits,...TrainingFull timeContract workWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week$364k
...planes that orchestrate, validate, and manage bare-metal systems, custom AI silicon, and distributed data... ...environments.Design and deploy self-training ML-driven monitoring and telemetry... ...silicon, and distributed systems engineering teams to ensure the reliability and...TrainingWorldwide$240k - $290k
...driving the transformation to AI-enabled software-defined... ...looking for an experienced Senior Engineering Manager to build and lead our AI... ...end validation strategy for AI/ML models, LLMs, RAG pipelines,... ...from data pipelines and model training through cloud services and in...TrainingWork at officeWorldwideFlexible hoursShift work$207k - $300k
Engineering Manager, Paladin, AI and Data Platforms Share Engineering Manager, Paladin, AI and Data Platforms... ...(e.g., sequential decision making), ML infrastructure, or specialization in... ...experience, and relevant education or training. US: $207000 - $300000 (USD) + 20%...Training$307k - $427k
...expertise to best serve AI and agentic workloads.... ...serving.Partner with product management and directly with... ...requirements.Lead software engineers within the service... ...of experience serving ML, AI, or agentic workloads... ...platform for large model training or serving.Strategic...Training$140k - $215k
...with the world’s most advanced AI-native platform. We work on... ...CrowdStrike is seeking an experienced Engineering Manager to lead a cloud backend team... ...understanding of AI/ML security challenges, threats,... ...including recruitment, selection, training, compensation, benefits,...TrainingFull timeWork experience placementWork at officeLocal areaWorldwide2 days per week3 days per week- Senior Engineering Manager - AI Products Join to apply for the Senior Engineering Manager - AI Products... ...closely with the Core Research / Post-Training, Inference and Search teams. •... ...engineering experience. • 3+ years of ML / deep learning experience. • 5+ years...TrainingFull timeH1b
$224k - $356.5k
We are now looking for an AI Developer Technology Engineering Manager:Join our global Developer Technology (DevTech) team at NVIDIA, where we drive innovation... ...algebra and performance optimization of Deep Learning training and inferenceBackground in parallel programming, e.g.,...TrainingFull timeTemporary work$307k - $427k
...technology to empower Content understanding and AI Generated Content framework. Conduct... ....15 years of experience in software engineering, with experience building technical products... ...skills, experience, and relevant education or training. US: $307000 - $427000 (USD) + 30% bonus...Training$160k - $220k
...an experienced and innovative Principal AI Security Engineer to join our Corporate Information... ...teamwork is required. Coach peers in AI/ML security concepts and best practices.Minimum... ..., and foundational concepts like training, vector databases, memory, tool usage,...TrainingFull timeWork experience placementWorldwide$204k - $337k
...NY. Team Overview: The Video AI team sits at the heart of our... ...Responsibilities: As a Senior Engineering Manager you will lead a team of 15-20... ...and efficiency: Partner with infra and platform teams to... ...professional experience in AI/ML Engineering and/or leadership...For contractorsWork at officeFlexible hours- ...backbone of Atlassian’s Agentic AI Integration Products : The Agentic... ...coach, and mentor a team of software engineers.Technical Strategy: Deliver... ...with at least 4+ years in people management.AI Expertise: Hands-on experience with AI/ML platform engineering, model serving...Work at officeLocal area
$224k - $356.5k
...tapping into the unlimited potential of AI to define the next era of computing.... ..., and scaling. As Technical Lead Manager, you will lead the engineering team within NVIDIA’s Dynamo organization... ...performance-critical infrastructure, ML tooling, or distributed systems.3+...Full timeLocal areaRemote workWorldwide$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...work. Today, ServiceNow is the AI control tower for business reinvention... ..., engineers, and product managers with a dual mission. We build... ...technically leading high-performing AI/ML teams.Experience in leveraging...Work experience placementWork at officeImmediate startRemote workFlexible hoursShift work$254k
...the Group Director, Applied AI & Engineering you will lead an elite, high-... ...large-scale foundational models trained on our massive, multi-modal... ...across Walmart. It develops and manages shared platforms,... ...-performing data science and ML engineering teams, with at least...TrainingFull timeTemporary workPart timeShift work$296.3k - $423.9k
...Principal Technical Lead Manager (TLM) to lead the... ...team within the Embodied AI organization. This role... ...shape the algorithms and ML systems that translate... ...high-performing team of engineers building ML-driven trajectory... .... Architect scalable training pipelines using large-...TrainingFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$175.8k - $293k
...We're looking for a Principal AI Engineer to architect, build, and... ...routing, prompt and context management, orchestration runtimes, and... ...significant recent depth in AI/ML. ~ Proven experience designing... ...to skill sets; experience and training, licensure, and certifications...Training$203.3k - $305.6k
...Summary The Apple Services Engineering team is one of the most... ...countries. Our Program Managers partner with engineers... ...the development of our AI platform software stack... ...systems that power AI/ML development across... ...ML/AI infrastructure: training clusters, model serving...TrainingRelocation packageFlexible hours$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...transform how businesses manage supplier lifecycles, procurement... ..., domain expertise, AI/ML fluency) and address... ...hiring and interview training of other managers;...TrainingWork at officeImmediate startRemote workFlexible hours$144.6k - $263.8k
...Engineering Project Manager - AI Features InternationalizationApple's Software Engineering Operations (SWE... ...Intelligence and new hardware with integrated ML capabilities.In this role, you will... ...-functional dependencies—from model training and fine-tuning to UI implementation...TrainingWorldwideRelocation$224k - $356.5k
...and DGX Station systems.We are looking for an Engineering Manager to build and lead the team developing local and hybrid AI agent technology. You will set technical direction... ....cpp, vLLM, PyTorch, ONNX Runtime, Windows ML, model optimization, or quantization.Experience...Full timeLocal area$272k - $431.25k
...tapping into the unlimited potential of AI to define the next era of computing. An era... ...R&D group requires a senior software engineer. In this exciting role, you will profile,... ...clusters used for distributed Deep Learning LLM training and inference. Your primary focus will be...TrainingFull timeRemote work$250.6k - $362.6k
...hardware platforms central to the AI era, powering Cisco’s core... ...QualificationsBachelor’s degree in Engineering and 15+ years of ASIC related... ...placement and routing (MLPD / ML-driven PnR), and OpenAI APIs (... ..., certifications, and/or training. The full salary range for certain...TrainingFull timeTemporary workLocal areaFlexible hours- Sr. Product Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services (AWS) job... ...and container ecosystems, enabling ML training and inference at scale, optimal... ...ability to contribute to and influence engineering discussions around technology decisions...Training
$185.2k - $299.48k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...Job Summary We are hiring AI Engineers at the Principal and Senior... ...engineering role, not a data science or ML research role. You will act as... ...analysis, adversarial training). Strategic Leadership &...TrainingFull timeWork at office$193.93k - $352.29k
...and profound opportunity for AI to drive positive change in the... ...autonomously inside Nuro's own engineering organization, under the same... ...Nuro that loop runs against the training pipelines behind the driving... ...it helped. ~ Experience with ML training or research infrastructure...TrainingImmediate startFlexible hours- ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN company, is the Kubernetes... ...someone who has genuinely stood up training and inference workloads, argued interconnect topology with a customer's ML infra lead, and closed large deals with cycles...Training
- Apple in Santa Clara, CA seeks a seasoned Engineering Manager to build and lead a backend infra and ML engineering team. You will own the technical roadmap for large-scale indexing and serving systems and drive execution against ambitious scale, reliability, latency, and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, AI/ML Training Infra. Be the first to apply!
- artificial intelligence - machine learning intern Sunnyvale, CA
- internship machine learning Sunnyvale, CA
- machine learning researcher Sunnyvale, CA
- machine learning Sunnyvale, CA
- machine learning scientist Sunnyvale, CA
- data engineer machine learning Sunnyvale, CA
- machine learning remote Sunnyvale, CA
- machine learning part time Sunnyvale, CA
- machine learning research scientist Sunnyvale, CA
- machine learning intern Sunnyvale, CA


