Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers
$207k - $300kLead the design and end-to-end software delivery of specialized AI compute platforms, ensuring high availability for massive-scale workloads.Establish observability and hardening strategies for the lower-half software stack, including firmware, and hardware qualification.Architect robust integration interfaces between custom compute topologies and industry-standard workload schedulers like Kubernetes and GKE.Architect secure boot and cryptographic remote attestation flows for distributed hardware platforms.Partner closely with hardware engineering and chip design teams to influence future architectures for large-scale deployment.Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.8 years of experience with data structures/algorithms.3 years of experience in a technical leadership role leading project teams and setting technical direction.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Experience with lower-half server architectures, hardware-adjacent orchestration, and low-level security implementations.Experience with Kubernetes and Google-internal cluster systems, alongside a proven ability to build telemetry pipelines and monitoring systems for distributed hardware.Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.The Emergent AI infrastructure team in Google is looking to build the next generation of on-prem AI infrastructure to bring the best of Google to empower Frontier model and AI solution builders to advance AI around the world. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.
$207k - $301k
...critical system software that enables TPU Machine Learning... ...optimize large-scale ML systems.Lead... ...to software engineers to foster their... ...with large-scale infrastructure, distributed systems... ...Learning Supercomputer (MLSC) team, you... ...generations.The AI and Infrastructure...SuggestedWorldwide$207k - $301k
...Google e.g., Borg team, ML teams, HW platform... ...Warsaw.Develop junior engineers on the team.Minimum qualifications... ...testing, and launching software products.5 years of... ...developing large-scale infrastructure, distributed systems or... ...successful through AI by combining cutting-edge...SuggestedWorldwide$262k - $365k
...specific models of in app AI (tiny Gemma/Juno Nano)... ...in Google's on-device ML infrastructure (e.g., LiteRT, LiteRT-... ...(GPU /Pixel TPU /NPUs/CPU) on Android,... ...years of experience in software development.7 years of... ...Master’s degree or PhD in Engineering, Computer Science, or...Suggested$207k - $301k
...Interfaces (APIs), Software Development Kits (... ...Software Engineers, specifically around... ...optimizing Generative AI performance across... ...including Android ML, ML Compiler, and... ...decision making), ML infrastructure, or specialization... ...e.g., GPU / Pixel TPU / NPUs / CPU) on Android...SuggestedShift work$262k - $365k
...setting the standard for engineering excellence.Act as a technical... ...8 years of experience in software development.5 years of... ...of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,... ...Experience with shipping 0-to-1 AI applications, with a...Suggested$207k - $301k
...coach a distributed team of engineers.Facilitate alignment and... ...and enhance large scale software solutions.Minimum... ...years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,... ...Management offers centralized and AI-assisted capabilities for...$262k - $365k
...maintain, and enhance large scale software solutions.Provide technical... ...coach a distributed team of engineers.Drive technical project strategy, lead large-scale ML infrastructure optimization, and oversee the... ...forward.The Google Cloud AI Research team addresses AI challenges...$207k - $301k
...team of high-performing engineers who design and model... ...roadmap for modeling infrastructure, exercising strong technical... ...testing and launching software products and working... ...and passionate Staff Software Engineering to... ...of both networking and AI/ML landscapes. Effectively...Remote workWorldwide$207k - $300k
...coach a distributed team of engineers.Facilitate alignment and clarity... ..., and enhance large scale software solutions.Minimum qualifications... ...and developing large-scale infrastructure, distributed systems or networks... ...software solutions.The AI and Infrastructure team is redefining...Worldwide$207k - $300k
...generation control planes and software infrastructure for highly-available ML network fabrics.Design... ...and Cloud with senior engineers and product managers.Mentor... ...technology forward.As a Staff Engineer on the ML Network... ...the full stack.The AI and Infrastructure team is...Worldwide$207k - $300k
...test, deploy, maintain, and enhance large scale software solutions.Provide technical leadership on high-... .... Influence and coach a distributed team of engineers.Lead the design of GenAI solutions, optimize ML infrastructure, and guide the development of data preparation...$163k - $237k
...degree in Electrical Engineering, Computer Engineering,... ...to shape the future of AI/ML hardware acceleration.... ...to drive cutting-edge TPU (Tensor Processing Unit... ...scenarios.The AI and Infrastructure team is redefining what... ...the future. From software to hardware our teams...Worldwide$139.3k - $203.6k
...are received.Senior Kubernetes Platform Engineer - AI Infrastructure - hybrid (2013580)***hybrid role... ...infrastructure powering next-generation AI/ML platforms, including GPU-enabled... ...Qualifications / Required Experience8+ years of software engineering experience4+ years of...Full timeTemporary workLocal areaFlexible hours$172.5k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...is seeking experienced engineers to join its Core Infrastructure organization — the team responsible... ...infrastructure engineers, ML engineers, product... ...and ship production-grade software using modern engineering practices...Full time$138k - $198k
...degree in Electrical Engineering, Computer Engineering,... ...to shape the future of AI/ML hardware acceleration.... ...to drive cutting-edge TPU (Tensor Processing Unit... ....As an SoC Test Infrastructure Engineer, you will drive... ...build the future. From software to hardware our teams...Worldwide$192k - $279k
...of the hardware/software stack to enable... ...of large ML models.Collaborate... ...in Electrical Engineering, Computer Engineering... ...the future of AI/ML hardware... ...opportunity to drive TPU (Tensor... ...driven systems.As a Staff Co-Design... ...accelerators.The AI and Infrastructure team is...Worldwide$138k - $197k
...digital designs within the TPU.Develop high-quality,... ...degree in Electrical Engineering, Computer Engineering,... ...solutions employing software based construction,... ...to shape the future of AI/ML hardware acceleration.... ...environment.The AI and Infrastructure team is redefining what...Worldwide$163k - $236k
...partitioning expertise.Utilize software-based construction to... ...degree in Electrical Engineering, Computer Engineering,... ...shape the future of AI/ML hardware acceleration.... ...opportunity to drive TPU (Tensor Processing... ...schedules.The AI and Infrastructure team is redefining what...Worldwide$207k - $300k
...coach a distributed team of engineers.Facilitate alignment and... ..., and enhance large-scale software solutions.Minimum qualifications... ...SoCs, machine learning (ML) Systems (TPU/GPU) and compute servers.... ...image processing etc.The AI and Infrastructure team is redefining what’s...Worldwide$192k - $279k
...significant portions of TPU designs, developing... ...functional verification infrastructure such as subchip,... ...degree in Electrical Engineering, Computer Engineering,... ...to shape the future of AI/ML hardware acceleration.... ...build the future. From software to hardware our teams...Worldwide$174k - $252k
...implement GenAI solutions, leverage ML infrastructure, and evaluate tradeoffs... ..., maintaining, or launching software products, and 1 year of... ...technologies.Google's software engineers develop the next-generation... ...to push technology forward.AI will change the future of work...$147k - $211k
...Implement computer vision solutions, utilize ML infrastructure, and contribute to model optimization... ...accessible technologies.Google's software engineers develop the next-generation... ...push technology forward.The Google Cloud AI Research team addresses AI challenges...$147k - $211k
...quality.Implement GenAI solutions, utilize ML infrastructure, and contribute to data preparation,... ...accessible technologies.Google's software engineers develop the next-generation technologies... ...continue to push technology forward.The AI and Infrastructure team is redefining...Worldwide$207k - $301k
...machine learning software/hardware stacks through... ..., HLO profiles, ML graph summaries.... ...scaling for upcoming TPU chips) by making... ...degree or PhD in Engineering, Computer Science,... ...different compute infrastructure, Cloud, and Open Source... ...system.The AI and Infrastructure...Worldwide$147k - $211k
...Artificial Intelligence (GenAI) solutions, utilize ML infrastructure, and contribute to data preparation,... ...optimization.Passionate about pushing the boundaries of AI adoption in the enterprise world.Our mission is to engineer the platform for building and running AI agents...$116k - $166k
...interacting with design engineers to identify important... ...shape the future of AI/ML hardware acceleration.... ...to drive cutting-edge TPU (Tensor Processing Unit... ...accelerators.The AI and Infrastructure team is redefining... ...build the future. From software to hardware our teams...Worldwide$207k - $301k
...within the Cloud AI Quality Evaluation... ...at scale, design infrastructure and product features... ...of experience in software development.5 years... ...experience leading ML design and... ...degree or PhD in Engineering, Computer Science,... ...technology to Cloud. As a Staff Software Engineer...$174k - $252k
...orchestration layer for Google's AI workloads.Partner with... ...priorities and engineering roadmaps.Navigate open... ...the broader Compute Infrastructure organization to drive... ...of experience with software development in one or... ...scheduling of virtually all ML and non-ML workloads...Worldwide$174k - $253k
...testing, maintaining, or launching software products, and 1 year of... ...experience developing large-scale infrastructure, distributed systems or... ...technologies. Google's software engineers develop the next-generation... ...fastest experience possible. The AI and Infrastructure team is...Worldwide$207k - $301k
...boundaries.Lead the development of software that improves the velocity,... ...systems across various engineering teams.Define and lead the... ...Experience integrating generative AI tools or LLM interfaces into... ...forward.The AI and Infrastructure team is redefining what’s possible...Worldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers. Be the first to apply!
- id software Sunnyvale, TX
- software implementation project manager Sunnyvale, TX
- software Sunnyvale, TX
- remote software sales Sunnyvale, TX
- entry level software sales Sunnyvale, TX
- senior infrastructure engineer
- infrastructure engineering manager
- infrastructure engineer
- junior infrastructure engineer
- security infrastructure engineer
