Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, AI/ML Training Infra

$207k - $300k

Google

Set and communicate team priorities that support the broader organization's goals. Align strategy, processes, and decision-making across teams.Set clear expectations with individuals based on their level and role and aligned to the broader organization's goals. Meet regularly with individuals to discuss performance and development and provide feedback and coaching.Develop the mid-term technical vision and roadmap within the scope of your often multiple teams. Evolve the roadmap to meet anticipated future requirements and infrastructure needs.Design, guide and vet systems designs within the scope of the broader area, and write product or system development code to solve ambiguous problems.Lead the design and implementation of solutions in specialized ML areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.Minimum qualifications:Bachelor’s degree or equivalent practical experience.8 years of experience in software development.5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field.3 years of experience in a technical leadership role.2 years of experience in a people management or team leadership role.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Experience with distributed systems and have a passion for building reliability, scalable and efficient infrastructure. Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.In this role, you will lead and manage a high-performing team of Software Engineers (SWEs) focused on the design, implementation, and launch of critical scheduling features supporting training and inference across Alphabet. You will support key internal customers and products including DeepMind (DM), Google Search, YouTube, Ads, and Waymo while partnering closely with leadership and engineering teams across Compute infrastructure, SRE, Scheduling, XManager, Uniserve, and other key infrastructure stakeholders to drive aligned technical roadmaps. Additionally, you will shape the technical direction for next-generation scheduling infrastructure, balancing long-term architectural health with immediate business delivery needs.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor’s degree or equivalent practical experience.8 years of experience in software development.5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), or specialization in another ML field.3 years of experience in a technical leadership role.2 years of experience in a people management or team leadership role.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Engineering Manager, AI/ML Training Infra in Sunnyvale, CA vacancy
  • $168k - $270.25k

     ...computing, and modern AI. Today, NVIDIA high-performance...  ...GPU programs for training and inference. As AI...  ...and large-scale systems engineering. To address these complex...  ...seeking an Engineering Manager to spearhead our...  ...development, CUDA software, ML framework, runtime, product... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $207k - $300k

     ...and system design for the ML Efficiency Hub, driving complex 1-6 month Engineers and 2-4 week Strike...  ...integrating generative AI tools or LLM interfaces...  ...Search. Software Engineering Managers have not only the technical...  ...relevant education or training. US: $207000 - $300000 (... 
    Training
    Permanent employment

    Google

    Mountain View, CA
    1 day ago
  • $140k - $215k

     ...with the world’s most advanced AI-native platform. We work on...  ...seeking an experienced SDET Engineering Manager to lead our quality engineering...  ...productsUnderstanding of AI/ML security challenges, threats,...  ...including recruitment, selection, training, compensation, benefits,... 
    Training
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week

    CrowdStrike

    Sunnyvale, CA
    4 days ago
  • $364k

     ...planes that orchestrate, validate, and manage bare-metal systems, custom AI silicon, and distributed data...  ...environments.Design and deploy self-training ML-driven monitoring and telemetry...  ...silicon, and distributed systems engineering teams to ensure the reliability and... 
    Training
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $240k - $290k

     ...driving the transformation to AI-enabled software-defined...  ...looking for an experienced Senior Engineering Manager to build and lead our AI...  ...end validation strategy for AI/ML models, LLMs, RAG pipelines,...  ...from data pipelines and model training through cloud services and in... 
    Training
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    1 day ago
  • $207k - $300k

    Engineering Manager, Paladin, AI and Data Platforms Share Engineering Manager, Paladin, AI and Data Platforms...  ...(e.g., sequential decision making), ML infrastructure, or specialization in...  ...experience, and relevant education or training. US: $207000 - $300000 (USD) + 20%... 
    Training

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $307k - $427k

     ...expertise to best serve AI and agentic workloads....  ...serving.Partner with product management and directly with...  ...requirements.Lead software engineers within the service...  ...of experience serving ML, AI, or agentic workloads...  ...platform for large model training or serving.Strategic... 
    Training

    Google

    Sunnyvale, CA
    3 days ago
  • $140k - $215k

     ...with the world’s most advanced AI-native platform. We work on...  ...CrowdStrike is seeking an experienced Engineering Manager to lead a cloud backend team...  ...understanding of AI/ML security challenges, threats,...  ...including recruitment, selection, training, compensation, benefits,... 
    Training
    Full time
    Work experience placement
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week

    CrowdStrike

    Sunnyvale, CA
    4 days ago
  • Senior Engineering Manager - AI Products Join to apply for the Senior Engineering Manager - AI Products...  ...closely with the Core Research / Post-Training, Inference and Search teams. •...  ...engineering experience. • 3+ years of ML / deep learning experience. • 5+ years... 
    Training
    Full time
    H1b

    Jobright.ai

    Palo Alto, CA
    2 days ago
  • $224k - $356.5k

    We are now looking for an AI Developer Technology Engineering Manager:Join our global Developer Technology (DevTech) team at NVIDIA, where we drive innovation...  ...algebra and performance optimization of Deep Learning training and inferenceBackground in parallel programming, e.g.,... 
    Training
    Full time
    Temporary work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $307k - $427k

     ...technology to empower Content understanding and AI Generated Content framework. Conduct...  ....15 years of experience in software engineering, with experience building technical products...  ...skills, experience, and relevant education or training. US: $307000 - $427000 (USD) + 30% bonus... 
    Training

    Google

    Mountain View, CA
    14 hours ago
  • $160k - $220k

     ...an experienced and innovative Principal AI Security Engineer to join our Corporate Information...  ...teamwork is required. Coach peers in AI/ML security concepts and best practices.Minimum...  ..., and foundational concepts like training, vector databases, memory, tool usage,... 
    Training
    Full time
    Work experience placement
    Worldwide

    Fortinet

    Sunnyvale, CA
    4 days ago
  • $204k - $337k

     ...NY. Team Overview: The Video AI team sits at the heart of our...  ...Responsibilities: As a Senior Engineering Manager you will lead a team of 15-20...  ...and efficiency: Partner with infra and platform teams to...  ...professional experience in AI/ML Engineering and/or leadership... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  •  ...backbone of Atlassian’s Agentic AI Integration Products : The Agentic...  ...coach, and mentor a team of software engineers.Technical Strategy: Deliver...  ...with at least 4+ years in people management.AI Expertise: Hands-on experience with AI/ML platform engineering, model serving... 
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    2 days ago
  • $224k - $356.5k

     ...tapping into the unlimited potential of AI to define the next era of computing....  ..., and scaling. As Technical Lead Manager, you will lead the engineering team within NVIDIA’s Dynamo organization...  ...performance-critical infrastructure, ML tooling, or distributed systems.3+... 
    Full time
    Local area
    Remote work
    Worldwide

    Nvidia

    Santa Clara, CA
    1 day ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote code that...  ...work. Today, ServiceNow is the AI control tower for business reinvention...  ..., engineers, and product managers with a dual mission. We build...  ...technically leading high-performing AI/ML teams.Experience in leveraging... 
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    14 hours ago
  • $254k

     ...the Group Director, Applied AI & Engineering you will lead an elite, high-...  ...large-scale foundational models trained on our massive, multi-modal...  ...across Walmart. It develops and manages shared platforms,...  ...-performing data science and ML engineering teams, with at least... 
    Training
    Full time
    Temporary work
    Part time
    Shift work

    Walmart

    Sunnyvale, CA
    1 day ago
  • $296.3k - $423.9k

     ...Principal Technical Lead Manager (TLM) to lead the...  ...team within the Embodied AI organization. This role...  ...shape the algorithms and ML systems that translate...  ...high-performing team of engineers building ML-driven trajectory...  .... Architect scalable training pipelines using large-... 
    Training
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    4 days ago
  • $175.8k - $293k

     ...We're looking for a Principal AI Engineer to architect, build, and...  ...routing, prompt and context management, orchestration runtimes, and...  ...significant recent depth in AI/ML. ~ Proven experience designing...  ...to skill sets; experience and training, licensure, and certifications... 
    Training

    BMC Software

    Santa Clara, CA
    3 days ago
  • $203.3k - $305.6k

     ...Summary The Apple Services Engineering team is one of the most...  ...countries. Our Program Managers partner with engineers...  ...the development of our AI platform software stack...  ...systems that power AI/ML development across...  ...ML/AI infrastructure: training clusters, model serving... 
    Training
    Relocation package
    Flexible hours

    Apple

    Cupertino, CA
    2 days ago
  • $201.3k - $352.3k

     ...DescriptionIt all started when engineer Fred Luddy wrote code...  ..., ServiceNow is the AI control tower for...  ...transform how businesses manage supplier lifecycles, procurement...  ..., domain expertise, AI/ML fluency) and address...  ...hiring and interview training of other managers;... 
    Training
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $144.6k - $263.8k

     ...Engineering Project Manager - AI Features InternationalizationApple's Software Engineering Operations (SWE...  ...Intelligence and new hardware with integrated ML capabilities.In this role, you will...  ...-functional dependencies—from model training and fine-tuning to UI implementation... 
    Training
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $224k - $356.5k

     ...and DGX Station systems.We are looking for an Engineering Manager to build and lead the team developing local and hybrid AI agent technology. You will set technical direction...  ....cpp, vLLM, PyTorch, ONNX Runtime, Windows ML, model optimization, or quantization.Experience... 
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...tapping into the unlimited potential of AI to define the next era of computing. An era...  ...R&D group requires a senior software engineer. In this exciting role, you will profile,...  ...clusters used for distributed Deep Learning LLM training and inference. Your primary focus will be... 
    Training
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $250.6k - $362.6k

     ...hardware platforms central to the AI era, powering Cisco’s core...  ...QualificationsBachelor’s degree in Engineering and 15+ years of ASIC related...  ...placement and routing (MLPD / ML-driven PnR), and OpenAI APIs (...  ..., certifications, and/or training. The full salary range for certain... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    4 days ago
  • Sr. Product Manager - Runtime Infra, AI/ML, Annapurna Labs (Cupertino) An Amazon Web Services (AWS) job...  ...and container ecosystems, enabling ML training and inference at scale, optimal...  ...ability to contribute to and influence engineering discussions around technology decisions... 
    Training

    Downtown Boulder Partnership

    Cupertino, CA
    4 days ago
  • $185.2k - $299.48k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything...  ...Job Summary We are hiring AI Engineers at the Principal and Senior...  ...engineering role, not a data science or ML research role. You will act as...  ...analysis, adversarial training). Strategic Leadership &... 
    Training
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    14 hours ago
  • $193.93k - $352.29k

     ...and profound opportunity for AI to drive positive change in the...  ...autonomously inside Nuro's own engineering organization, under the same...  ...Nuro that loop runs against the training pipelines behind the driving...  ...it helped. ~ Experience with ML training or research infrastructure... 
    Training
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    8 days ago
  •  ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN company, is the Kubernetes...  ...someone who has genuinely stood up training and inference workloads, argued interconnect topology with a customer's ML infra lead, and closed large deals with cycles... 
    Training

    Mirantis

    San Jose, CA
    2 days ago
  • Apple in Santa Clara, CA seeks a seasoned Engineering Manager to build and lead a backend infra and ML engineering team. You will own the technical roadmap for large-scale indexing and serving systems and drive execution against ambitious scale, reliability, latency, and... 

    Apple

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, AI/ML Training Infra. Be the first to apply!