Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure

$262k - $364k

Google

Lead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.Design, develop, and oversee simulation frameworks, cycle-accurate performance models, and system analysis tools to evaluate architectural trade-offs.Architect scalable software solutions, kernels, and execution pipelines that bridge frontier ML model architectures with next-generation custom silicon accelerators.Drive system-level performance optimization across distributed ML infrastructure, balancing compute, memory bandwidth, and inter-chip networking requirements.Provide technical leadership and mentorship across hardware, compiler, and ML research teams to align on goals and transition co-design innovations into production.Minimum qualifications:Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.8 years of experience in software development, systems engineering, or hardware/software co-design.5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.Experience with ML frameworks (e.g., JAX, PyTorch, TensorFlow) and large language model (LLM) inference or training workloads.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.5 years of experience in a technical leadership role leading project teams and setting technical directionExperience driving multi-generational hardware/software co-design or performance optimizations for massive-scale ML inference and training.Experience with accelerator programming, ML compilers, and deep learning execution models.Experience analyzing system-level performance across compute, memory, interconnects, and packaging trajectories.In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems.In this role, you will bridge the gap between model architecture innovation and next-generation hardware design. Operating at the intersection of cutting-edge AI research and infrastructure engineering, you will define the long-term strategic goal and architectural roadmap for the future machine learning training and serving capabilities. You will lead the integration of foundational ML research with advanced architectures to deliver industry-defining, high-performance, and power-efficient accelerators.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $262000 - $364000 (USD) + 25% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.8 years of experience in software development, systems engineering, or hardware/software co-design.5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.Experience with ML frameworks (e.g., JAX, PyTorch, TensorFlow) and large language model (LLM) inference or training workloads.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure in Sunnyvale, TX vacancy
  • $262k - $364k

     ...enhance large scale software solutions.Provide...  ...team of engineers.Drive technical project...  ...lead large-scale ML infrastructure optimization, and...  ...language modeling, computer vision).Preferred...  ...projects.Google's software engineers...  ...technology forward.Google Cloud accelerates every... 
    Google
    Cloud computing
    Senior

    Google

    Sunnyvale, TX
    3 days ago
  • $262k - $364k

     ...enhance large scale software solutions.Provide...  ...team of engineers.Drive technical project...  ...lead large-scale ML infrastructure optimization, and...  ...in Engineering, Computer Science, or a related...  ...projects.Google's software engineers...  ...technology forward.AI will change the future... 
    Google
    Senior

    Google

    Sunnyvale, TX
    4 days ago
  • $262k - $364k

     ...and systems engineering.Architect and...  ...build generative AI tools,...  ...schematics, software contracts, and...  ...deployed across Google’s next-generation compute, accelerator...  ...and storage infrastructure.Empower Diagnostic...  ...strategy, ML design, and end...  ..., Google Cloud customers, and... 
    Google
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $262k - $364k

     ...distributed engineering team, fostering...  ...scalable software and advanced...  ..., RDMA, and ML workloads.Strategic...  ..., and AI/ML, staying...  ...Performance Computing, Remote Direct...  ...Learning Infrastructure.Google's software engineers...  ...and Google Cloud .TheHPN team...  ...(GDS).As a Senior Staff Software... 
    Google
    Senior
    Remote work
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $262k - $364k

     ...and training AI infrastructure from SRE side,...  ...closely with senior technical leads...  ...solutions for all of Google, acting as the...  ...’s degree in Computer Science, a...  ...with software development in...  ...Computer Science or Engineering.Site Reliability...  ...ensures that Google Cloud's services—... 
    Google
    Senior

    Google

    Sunnyvale, TX
    2 days ago
  • $262k - $364k

     ...architecture for AI-ready data foundations...  ...the Data and AI engineering track. Guide...  ...testing/launching software products.Experience...  ...PhD in Engineering, Computer Science, or a related...  ...systems.Google's software engineers...  ...technology forward.Google Cloud Business Platform... 
    Google
    Senior

    Google

    Sunnyvale, TX
    2 days ago
  • $262k - $364k

     ...Serving using AI-assisted development...  ...AI-first engineering practices for...  ...teams across Google.Minimum qualifications...  ...or launching software products....  ...large-scale infrastructure or distributed...  ...Engineering, Computer Science, or a...  ...availability.Google Cloud accelerates... 
    Google
    Senior

    Google

    Sunnyvale, TX
    3 days ago
  • $262k - $364k

     ...solve their ML model performance...  ...at Google fleet-wide scale...  ...experience in software development....  ...performance engineering techniques....  ...on AI accelerators...  ...Engineering, Computer Science, or...  ....The AI and Infrastructure team is redefining...  ...Googlers, Google Cloud customers,... 
    Google
    Senior
    Immediate start
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $207k - $300k

     ...batch processing infrastructure for Gmail in...  ...of experience in software development.5 years...  ...Learning (ML) design and optimizing...  ...projects.Google Cloud's software engineers develop the next...  ...retrieval, distributed computing, large-scale...  ...for our customers.AI will change the... 
    Google

    Google

    Sunnyvale, TX
    14 hours ago
  • $207k - $300k

     ...Intelligence-First Software Engineer who engages...  ....Use Agentic AI and Spec...  ...developing large-scale infrastructure, distributed...  ...with compute technologies,...  ...stakeholders.Google's software engineers...  ...as an AI-First Staff Software Engineer...  ..., Google Cloud customers, and... 
    Google
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $207k - $300k

     ...deep expertise in AI/ML integration within infrastructure.Lead cross-functional...  ...of experience in software development....  ...degree or PhD in Engineering, Computer Science, or a related...  ...conducting code reviews.Google's software...  ...Google products and cloud customers.Our team... 
    Google
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $262k - $364k

     ...architecture for Google’s next-...  ...mentoring executive engineers and fostering...  ...ASIC-Software teams.Forge partnerships...  ..., software infrastructure, and data...  ...maximize AI accelerator performance...  ...Engineering, Computer Science, or a...  ...for ML practitioners...  ...system.Google Cloud accelerates every... 
    Google
    Senior

    Google

    Sunnyvale, TX
    4 days ago
  • $174k - $252k

     ...experience with software development in C++...  ...large-scale infrastructure, distributed systems...  ...experience with compute technologies,...  ...accessible technologies. Google's software engineers develop the next...  ...possible.The AI and...  ...Googlers, Google Cloud customers, and billions... 
    Google
    Cloud computing
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    4 days ago
  • $174k - $252k

     ...and mentor other engineers on the team....  ...Bachelor’s degreein Computer Science, a...  ...experience in software development using...  ...systems or backend infrastructure.1 year of...  ...experience leveraging AI tools or...  ...scalable solutions on Cloud Computing...  ...mentoring engineers.Google's software... 
    Google
    Cloud computing
    Senior

    Google

    Sunnyvale, TX
    4 days ago
  • $163k - $236k

     ...functionally across Google to pull together a...  ...full end-to-end software stack for cloud and shared compute infrastructure.Have a strong sense...  ....Engage with engineering directors, product...  ...Experience utilizing AI productivity tools...  ...product roadmap of AI/ML and Standard... 
    Google
    Cloud computing

    Google

    Sunnyvale, TX
    2 days ago
  • $207k - $300k

     ...and portable AI agent...  ...from laptop to cloud.Lead technical...  ...alignment across Google Cloud, AI/ML teams,...  ...and mentoring engineers across the team...  ...with software development...  ...or AI/cloud infrastructure.3 years of experience...  ..., Computer Science, or...  ...substrate. As a Staff Software Engineer... 
    Google
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $262k - $364k

     ...define the long-term software architecture for Google's next-...  ...Unified Traffic Engineering systems.Design,...  ...network programming infrastructure.Drive strategic...  ...integrating generative AI tools or LLM...  ...in Engineering, Computer Science, or a...  ...Googlers, Google Cloud customers, and billions... 
    Google
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $174k - $252k

     ...teams across Workspace, Cloud AI and Gemini.Build evaluation infrastructure, datasets, and...  ...of experience with software development in one or...  ...'s degree or PhD in Computer Science or related technical...  ...Go, Python, or C++.Google Cloud's software engineers develop the next-... 
    Google
    Senior

    Google

    Sunnyvale, TX
    1 day ago
  • $174k - $252k

     ...experience with software development in one...  ...modeling, computer vision).Preferred...  ...experience with ML/AI algorithms and tools...  ...processing.Google's software engineers develop the next...  ...Gen AI models and infrastructure to build an AI platform...  ...and home.Google Cloud accelerates... 
    Google
    Senior
    Work from home

    Google

    Sunnyvale, TX
    14 hours ago
  • $174k - $252k

     ...Machine Learning (ML) infrastructure, and...  ...s degree in Computer Science, a related...  ...in software development...  ...working with Google internal infrastructure...  ....Google Cloud’s mission is...  ...through AI by combining...  ...ML software engineers in Cloud bridge...  .... As a Senior Software/Machine... 
    Google
    Senior

    Google

    Sunnyvale, TX
    1 day ago
  • $207k - $300k

     ...large scale software solutions.Provide...  ...team of engineers.Lead the design...  ...specialized ML areas, optimize ML infrastructure, and guide the...  ...Engineering, Computer Science, or a...  ...business projects.Google's software...  ...process.The AI and...  ...Googlers, Google Cloud customers, and... 
    Google
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $174k - $252k

    Lead engineering projects that improve our...  ...with adjacent infrastructure teams to align...  ...with software development in...  ...degree or PhD in Computer Science or related...  ...and protocols. Google's software...  ...devices, including AI/ML and optical...  ...repositories.Google Cloud accelerates... 
    Google
    Senior
    Shift work

    Google

    Sunnyvale, TX
    14 hours ago
  • $159k - $230k

     ...in Electrical Engineering, Computer Engineering, Physics...  ...the future of Google's direct-to-...  ...within Platforms Infrastructure Engineering,...  ...next generation AI hardware for AL/ML, server, networking...  ..., Google Cloud customers, and...  ...the future. From software to hardware our... 
    Google
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    1 day ago
  • $207k - $300k

     ...and optimize ML models for Intelligent...  ...with security engineers to identify...  ...low-latency Google Cloud serving....  ...experience in software development.5...  ...decision making), ML infrastructure, or...  ...Engineering, Computer Science, or a...  ...secure a world of AI agents and automated... 
    Google

    Google

    Sunnyvale, TX
    14 hours ago
  • $207k - $300k

     ...enterprise AI applications...  ...points with core Cloud and Alphabet...  ...and mentor engineers across the...  ...in software development....  ...decision making), ML infrastructure, or specialization...  ..., Computer Science, or...  ...organizations.Google Cloud's software...  ...Operations.As a Staff Software... 
    Google

    Google

    Sunnyvale, TX
    2 days ago
  • $159k - $230k

     ...complex, messy infrastructure logs and...  ...Infrastructure Engineers, Applied Data...  ...Experience researching AI/ML products,...  ...manipulation and computational statistics (e....  ...methods.At Google, we "Focus on...  ...you thrive.As a Senior Quantitative UX...  ....Google Cloud accelerates every... 
    Google
    Senior

    Google

    Sunnyvale, TX
    1 day ago
  • $240k - $333k

     ...projects, tools, or infrastructure.Preferred...  ...development, engineering/technical program...  ...Manager at Google, you’ll use your...  ...will join the AI and...  ...Googlers, Google Cloud customers, and...  ...unparalleled computing power to global...  ...future. From software to hardware our... 
    Google
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $188k - $274k

     ...availability for Google's first-party...  ...TPU Hardware Engineering, Logistics,...  ...next-generation ML deployments.Manage...  ...or enterprise cloud infrastructure...  ...deadlines. The AI and Infrastructure...  ...unparalleled computing power to global...  ...future. From software to hardware our... 
    Google
    Senior
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $192k - $278k

     ...availability for Google's ML delivery...  ...Data Center and software stacks to drive...  ...within technology, infrastructure, or industrial...  ...levels of seniority, from field...  ...Economics, Finance, Engineering, or a related...  ...leveraging AI/ML tools or automated...  ...systems (AI compute/accelerators),... 
    Google
    Senior

    Google

    Sunnyvale, TX
    4 days ago
  • $163k - $236k

     ...deployment of advanced AI/ML solutions,...  ...Statistics, Engineering, Sciences, a...  ...or PhD in Computer Science, Artificial...  ...stakeholders.Google's leadership...  ...recommendations to senior-level...  ...recommendations. Google Cloud provides...  ...with leading infrastructure, platform capabilities... 
    Google
    Senior

    Google

    Sunnyvale, TX
    14 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure. Be the first to apply!