Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure
$262k - $364kLead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.Design, develop, and oversee simulation frameworks, cycle-accurate performance models, and system analysis tools to evaluate architectural trade-offs.Architect scalable software solutions, kernels, and execution pipelines that bridge frontier ML model architectures with next-generation custom silicon accelerators.Drive system-level performance optimization across distributed ML infrastructure, balancing compute, memory bandwidth, and inter-chip networking requirements.Provide technical leadership and mentorship across hardware, compiler, and ML research teams to align on goals and transition co-design innovations into production.Minimum qualifications:Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.8 years of experience in software development, systems engineering, or hardware/software co-design.5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.Experience with ML frameworks (e.g., JAX, PyTorch, TensorFlow) and large language model (LLM) inference or training workloads.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.5 years of experience in a technical leadership role leading project teams and setting technical directionExperience driving multi-generational hardware/software co-design or performance optimizations for massive-scale ML inference and training.Experience with accelerator programming, ML compilers, and deep learning execution models.Experience analyzing system-level performance across compute, memory, interconnects, and packaging trajectories.In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems.In this role, you will bridge the gap between model architecture innovation and next-generation hardware design. Operating at the intersection of cutting-edge AI research and infrastructure engineering, you will define the long-term strategic goal and architectural roadmap for the future machine learning training and serving capabilities. You will lead the integration of foundational ML research with advanced architectures to deliver industry-defining, high-performance, and power-efficient accelerators.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $262000 - $364000 (USD) + 25% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.8 years of experience in software development, systems engineering, or hardware/software co-design.5 years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.Experience with ML frameworks (e.g., JAX, PyTorch, TensorFlow) and large language model (LLM) inference or training workloads.
$262k - $364k
...enhance large scale software solutions.Provide... ...team of engineers.Drive technical project... ...lead large-scale ML infrastructure optimization, and... ...language modeling, computer vision).Preferred... ...projects.Google's software engineers... ...technology forward.Google Cloud accelerates every...GoogleCloud computingSenior$262k - $364k
...enhance large scale software solutions.Provide... ...team of engineers.Drive technical project... ...lead large-scale ML infrastructure optimization, and... ...in Engineering, Computer Science, or a related... ...projects.Google's software engineers... ...technology forward.AI will change the future...GoogleSenior$262k - $364k
...and systems engineering.Architect and... ...build generative AI tools,... ...schematics, software contracts, and... ...deployed across Google’s next-generation compute, accelerator... ...and storage infrastructure.Empower Diagnostic... ...strategy, ML design, and end... ..., Google Cloud customers, and...GoogleSeniorWorldwide$262k - $364k
...distributed engineering team, fostering... ...scalable software and advanced... ..., RDMA, and ML workloads.Strategic... ..., and AI/ML, staying... ...Performance Computing, Remote Direct... ...Learning Infrastructure.Google's software engineers... ...and Google Cloud .TheHPN team... ...(GDS).As a Senior Staff Software...GoogleSeniorRemote workWorldwide$262k - $364k
...and training AI infrastructure from SRE side,... ...closely with senior technical leads... ...solutions for all of Google, acting as the... ...’s degree in Computer Science, a... ...with software development in... ...Computer Science or Engineering.Site Reliability... ...ensures that Google Cloud's services—...GoogleSenior$262k - $364k
...architecture for AI-ready data foundations... ...the Data and AI engineering track. Guide... ...testing/launching software products.Experience... ...PhD in Engineering, Computer Science, or a related... ...systems.Google's software engineers... ...technology forward.Google Cloud Business Platform...GoogleSenior$262k - $364k
...Serving using AI-assisted development... ...AI-first engineering practices for... ...teams across Google.Minimum qualifications... ...or launching software products.... ...large-scale infrastructure or distributed... ...Engineering, Computer Science, or a... ...availability.Google Cloud accelerates...GoogleSenior$262k - $364k
...solve their ML model performance... ...at Google fleet-wide scale... ...experience in software development.... ...performance engineering techniques.... ...on AI accelerators... ...Engineering, Computer Science, or... ....The AI and Infrastructure team is redefining... ...Googlers, Google Cloud customers,...GoogleSeniorImmediate startWorldwide$207k - $300k
...batch processing infrastructure for Gmail in... ...of experience in software development.5 years... ...Learning (ML) design and optimizing... ...projects.Google Cloud's software engineers develop the next... ...retrieval, distributed computing, large-scale... ...for our customers.AI will change the...Google$207k - $300k
...Intelligence-First Software Engineer who engages... ....Use Agentic AI and Spec... ...developing large-scale infrastructure, distributed... ...with compute technologies,... ...stakeholders.Google's software engineers... ...as an AI-First Staff Software Engineer... ..., Google Cloud customers, and...GoogleWorldwide$207k - $300k
...deep expertise in AI/ML integration within infrastructure.Lead cross-functional... ...of experience in software development.... ...degree or PhD in Engineering, Computer Science, or a related... ...conducting code reviews.Google's software... ...Google products and cloud customers.Our team...GoogleWorldwide$262k - $364k
...architecture for Google’s next-... ...mentoring executive engineers and fostering... ...ASIC-Software teams.Forge partnerships... ..., software infrastructure, and data... ...maximize AI accelerator performance... ...Engineering, Computer Science, or a... ...for ML practitioners... ...system.Google Cloud accelerates every...GoogleSenior$174k - $252k
...experience with software development in C++... ...large-scale infrastructure, distributed systems... ...experience with compute technologies,... ...accessible technologies. Google's software engineers develop the next... ...possible.The AI and... ...Googlers, Google Cloud customers, and billions...GoogleCloud computingSeniorWorldwide$174k - $252k
...and mentor other engineers on the team.... ...Bachelor’s degreein Computer Science, a... ...experience in software development using... ...systems or backend infrastructure.1 year of... ...experience leveraging AI tools or... ...scalable solutions on Cloud Computing... ...mentoring engineers.Google's software...GoogleCloud computingSenior$163k - $236k
...functionally across Google to pull together a... ...full end-to-end software stack for cloud and shared compute infrastructure.Have a strong sense... ....Engage with engineering directors, product... ...Experience utilizing AI productivity tools... ...product roadmap of AI/ML and Standard...GoogleCloud computing$207k - $300k
...and portable AI agent... ...from laptop to cloud.Lead technical... ...alignment across Google Cloud, AI/ML teams,... ...and mentoring engineers across the team... ...with software development... ...or AI/cloud infrastructure.3 years of experience... ..., Computer Science, or... ...substrate. As a Staff Software Engineer...GoogleWorldwide$262k - $364k
...define the long-term software architecture for Google's next-... ...Unified Traffic Engineering systems.Design,... ...network programming infrastructure.Drive strategic... ...integrating generative AI tools or LLM... ...in Engineering, Computer Science, or a... ...Googlers, Google Cloud customers, and billions...GoogleSeniorWorldwide$174k - $252k
...teams across Workspace, Cloud AI and Gemini.Build evaluation infrastructure, datasets, and... ...of experience with software development in one or... ...'s degree or PhD in Computer Science or related technical... ...Go, Python, or C++.Google Cloud's software engineers develop the next-...GoogleSenior$174k - $252k
...experience with software development in one... ...modeling, computer vision).Preferred... ...experience with ML/AI algorithms and tools... ...processing.Google's software engineers develop the next... ...Gen AI models and infrastructure to build an AI platform... ...and home.Google Cloud accelerates...GoogleSeniorWork from home$174k - $252k
...Machine Learning (ML) infrastructure, and... ...s degree in Computer Science, a related... ...in software development... ...working with Google internal infrastructure... ....Google Cloud’s mission is... ...through AI by combining... ...ML software engineers in Cloud bridge... .... As a Senior Software/Machine...GoogleSenior$207k - $300k
...large scale software solutions.Provide... ...team of engineers.Lead the design... ...specialized ML areas, optimize ML infrastructure, and guide the... ...Engineering, Computer Science, or a... ...business projects.Google's software... ...process.The AI and... ...Googlers, Google Cloud customers, and...GoogleWorldwide$174k - $252k
Lead engineering projects that improve our... ...with adjacent infrastructure teams to align... ...with software development in... ...degree or PhD in Computer Science or related... ...and protocols. Google's software... ...devices, including AI/ML and optical... ...repositories.Google Cloud accelerates...GoogleSeniorShift work$159k - $230k
...in Electrical Engineering, Computer Engineering, Physics... ...the future of Google's direct-to-... ...within Platforms Infrastructure Engineering,... ...next generation AI hardware for AL/ML, server, networking... ..., Google Cloud customers, and... ...the future. From software to hardware our...GoogleSeniorWorldwide$207k - $300k
...and optimize ML models for Intelligent... ...with security engineers to identify... ...low-latency Google Cloud serving.... ...experience in software development.5... ...decision making), ML infrastructure, or... ...Engineering, Computer Science, or a... ...secure a world of AI agents and automated...Google$207k - $300k
...enterprise AI applications... ...points with core Cloud and Alphabet... ...and mentor engineers across the... ...in software development.... ...decision making), ML infrastructure, or specialization... ..., Computer Science, or... ...organizations.Google Cloud's software... ...Operations.As a Staff Software...Google$159k - $230k
...complex, messy infrastructure logs and... ...Infrastructure Engineers, Applied Data... ...Experience researching AI/ML products,... ...manipulation and computational statistics (e.... ...methods.At Google, we "Focus on... ...you thrive.As a Senior Quantitative UX... ....Google Cloud accelerates every...GoogleSenior$240k - $333k
...projects, tools, or infrastructure.Preferred... ...development, engineering/technical program... ...Manager at Google, you’ll use your... ...will join the AI and... ...Googlers, Google Cloud customers, and... ...unparalleled computing power to global... ...future. From software to hardware our...GoogleSeniorWorldwide$188k - $274k
...availability for Google's first-party... ...TPU Hardware Engineering, Logistics,... ...next-generation ML deployments.Manage... ...or enterprise cloud infrastructure... ...deadlines. The AI and Infrastructure... ...unparalleled computing power to global... ...future. From software to hardware our...GoogleSeniorWorldwide$192k - $278k
...availability for Google's ML delivery... ...Data Center and software stacks to drive... ...within technology, infrastructure, or industrial... ...levels of seniority, from field... ...Economics, Finance, Engineering, or a related... ...leveraging AI/ML tools or automated... ...systems (AI compute/accelerators),...GoogleSenior$163k - $236k
...deployment of advanced AI/ML solutions,... ...Statistics, Engineering, Sciences, a... ...or PhD in Computer Science, Artificial... ...stakeholders.Google's leadership... ...recommendations to senior-level... ...recommendations. Google Cloud provides... ...with leading infrastructure, platform capabilities...GoogleSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure. Be the first to apply!
- senior devops cloud engineer Sunnyvale, TX
- senior cloud engineer Sunnyvale, TX
- senior cloud security engineer Sunnyvale, TX
- senior cloud infrastructure engineer Sunnyvale, TX
- senior cloud network engineer Sunnyvale, TX
- cloud network engineer Sunnyvale, TX
- senior aws cloud engineer Sunnyvale, TX
- informatica cloud developer Sunnyvale, TX
- cloud developer Sunnyvale, TX
- cloud engineer Sunnyvale, TX

