Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers

$207k - $300k

Google

Lead the design and end-to-end software delivery of specialized AI compute platforms, ensuring high availability for massive-scale workloads.Establish observability and hardening strategies for the lower-half software stack, including firmware, and hardware qualification.Architect robust integration interfaces between custom compute topologies and industry-standard workload schedulers like Kubernetes and GKE.Architect secure boot and cryptographic remote attestation flows for distributed hardware platforms.Partner closely with hardware engineering and chip design teams to influence future architectures for large-scale deployment.Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.8 years of experience with data structures/algorithms.3 years of experience in a technical leadership role leading project teams and setting technical direction.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Experience with lower-half server architectures, hardware-adjacent orchestration, and low-level security implementations.Experience with Kubernetes and Google-internal cluster systems, alongside a proven ability to build telemetry pipelines and monitoring systems for distributed hardware.Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.The Emergent AI infrastructure team in Google is looking to build the next generation of on-prem AI infrastructure to bring the best of Google to empower Frontier model and AI solution builders to advance AI around the world. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers in Sunnyvale, CA vacancy
  • $207k - $301k

     ...critical system software that enables TPU Machine Learning...  ...optimize large-scale ML systems.Lead...  ...to software engineers to foster their...  ...with large-scale infrastructure, distributed systems...  ...Learning Supercomputer (MLSC) team, you...  ...generations.The AI and Infrastructure... 
    Suggested
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $207k - $301k

     ...Google e.g., Borg team, ML teams, HW platform...  ...Warsaw.Develop junior engineers on the team.Minimum qualifications...  ...testing, and launching software products.5 years of...  ...developing large-scale infrastructure, distributed systems or...  ...successful through AI by combining cutting-edge... 
    Suggested
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $193.93k - $352.29k

     ...profound opportunity for AI to drive positive...  ...fungible is the infrastructure that decides...  ...inside Nuro's own engineering organization, under...  ...About You5+ years of software engineering...  ...practical experience. Staff-level candidates should...  ....Experience with ML training or... 
    Suggested
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  • $207k - $300k

     ...scaling, and steering the next-generation infrastructure that powers our AI/ML applications. You will operate at...  ..., including creative data engines, generation and rendering pipelines,...  ...experience.8 years of experience in software development.5 years of experience testing... 
    Suggested

    Google

    Mountain View, CA
    3 days ago
  • $262k - $365k

     ...specific models of in app AI (tiny Gemma/Juno Nano)...  ...in Google's on-device ML infrastructure (e.g., LiteRT, LiteRT-...  ...(GPU /Pixel TPU /NPUs/CPU) on Android,...  ...years of experience in software development.7 years of...  ...Master’s degree or PhD in Engineering, Computer Science, or... 
    Suggested

    Google

    Sunnyvale, CA
    1 day ago
  • $207k - $301k

     ...Interfaces (APIs), Software Development Kits (...  ...Software Engineers, specifically around...  ...optimizing Generative AI performance across...  ...including Android ML, ML Compiler, and...  ...decision making), ML infrastructure, or specialization...  ...e.g., GPU / Pixel TPU / NPUs / CPU) on Android... 
    Shift work

    Google

    Sunnyvale, CA
    2 days ago
  • $169k - $224k

     ...disciplinary organization of scientists, engineers, and physicians and we are...  ...please visit grail.com The Staff Software Development Engineer - Enterprise AI Infrastructure is a senior technical role...  ...software development tools, AI/ML platforms, cloud infrastructure... 
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work

    GRAIL

    Sunnyvale, CA
    18 days ago
  • $174k - $253k

     ...in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise...  ...maintaining, or launching software products, and 1 year of...  ...technologies.Google's software engineers develop the next-...  ...push technology forward.The AI and Infrastructure team is... 
    Worldwide

    Google

    Mountain View, CA
    2 days ago
  • $262k - $365k

     ...maintain, and enhance large scale software solutions.Provide technical...  ...coach a distributed team of engineers.Drive technical project strategy, lead large-scale ML infrastructure optimization, and oversee the...  ...forward.The Google Cloud AI Research team addresses AI challenges... 

    Google

    Sunnyvale, CA
    1 day ago
  • $207k - $301k

     ...coach a distributed team of engineers.Facilitate alignment and...  ...and enhance large scale software solutions.Minimum...  ...years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,...  ...Management offers centralized and AI-assisted capabilities for... 

    Google

    Sunnyvale, CA
    2 days ago
  • $262k - $365k

     ...years of experience in software development.7 years of...  ...technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment...  ...’s degree or PhD in Engineering, Computer Science, or a...  ...solutions.The User-AI Flywheel team in Search... 

    Google

    Mountain View, CA
    1 day ago
  • $262k - $365k

     ...setting the standard for engineering excellence.Act as a technical...  ...8 years of experience in software development.5 years of...  ...of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,...  ...Experience with shipping 0-to-1 AI applications, with a... 

    Google

    Sunnyvale, CA
    2 days ago
  • $207k - $301k

     ...co-evolve ads, leverage AI to maintain business...  ...advertisers.Leverage AI/ML advancements, including...  ...years of experience in software development.8 years of...  ...with ML design and ML infrastructure (e.g., model deployment...  ...practices.Google's software engineers develop the next-... 

    Google

    Mountain View, CA
    2 days ago
  • $127.1k - $185k

     ...a talented early-career engineer to join our team that owns...  ...stack for EC2 distributed AI/ML systems. You'll work on software that enables the world's...  ...networking, and machine learning infrastructure - building the systems...  ..., supervisors, and staff; adhere to standards of excellence... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $207k - $301k

     ...team of high-performing engineers who design and model...  ...roadmap for modeling infrastructure, exercising strong technical...  ...testing and launching software products and working...  ...and passionate Staff Software Engineering to...  ...of both networking and AI/ML landscapes. Effectively... 
    Remote work
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $207k - $340k

     ...the team.LinkedIn's AI and Machine Learning Engineers are both data/research scientists and software engineers, who develop...  .... As a Principal Staff Software Engineer you...  ...lead who will use AI/ML to push the...  ...strengthen LinkedIn’s AI infrastructure.QualificationsBasic... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $193.93k - $352.29k

     ...and profound opportunity for AI to drive positive change in...  ....About the RoleThe Autonomy ML Infrastructure team is responsible for building...  .... Work with autonomy engineers to optimize, validate, and deploy...  ....Write robust, high quality software to increase our confidence... 
    Work experience placement
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $175k - $287k

     ...of the largest privately managed compute infrastructures in the world outside the public cloud providers. As a Staff Software Engineer on the Compute Infrastructure team, you will...  ...processing petabytes daily, and the AI/ML infrastructure driving recommendations, search... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    17 hours ago
  • $200k - $322k

     ...deep learning ignited modern AI — the next era of computing....  ...to join us today.Design-for-X Engineering at NVIDIA works on groundbreaking...  ...AI projects that requires ML & Gen AI expertise.You will...  ...deployment cycles as part of the AI Infrastructure requirements at an org-wide... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $190k - $260k

     ...artificial intelligence (AI) powered technology...  ...commercial self-driving software to develop, test and deploy...  ...models - depends on infrastructure that turns thousands of...  ...throughput. We are looking for engineers who make model training...  ...formatsPartner with ML teams to scale new... 
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    4 days ago
  • $198k - $326k

     ...As part of our world-class software engineering team, you will take the lead...  ...the next-generation infrastructure and platforms for LinkedIn,...  ...search platform, best-in-class AI/ML infrastructure, Kubernetes...  ...within our company.As a Sr. Staff Software Engineer, you will... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $198k - $326k

     ...business needs of the team. LinkedIn’s AI Infrastructure organization is responsible for...  ...frameworks.We are looking for a Senior Staff Software Engineer with deep expertise at the intersection...  ...performance improvementsPartner closely with ML, infrastructure, and product teams to... 
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    4 days ago
  • $147k - $210k

     ...components of scalable machine learning (ML) and agentic AI infrastructure for manufacturing.Maintain and...  ...:Bachelor's degree in Electrical Engineering, Computer Science, relevant technical...  ....2 years of experience with software development in one or more programming... 

    Google

    Mountain View, CA
    4 days ago
  • $175k - $287k

     ...scaling LinkedIn’s AI model training, feature engineering and serving with hundreds...  ...infra, compute software, and hardware to...  ...queries Model Training Infrastructure: As an engineer on...  ...hundreds of new ML models per quarter...  ...performance possible.As a Staff Software Engineer,... 
    For contractors
    Work experience placement
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    17 hours ago
  • $193.93k - $352.29k

     ...profound opportunity for AI to drive positive...  ...driving technology. In an ML-first system, the overall...  ...and reliable data infrastructure. This infrastructure is...  ...collaborates closely with system engineers to thoroughly validate...  ...across broader software organizationA bachelor'... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    4 days ago
  • $184k - $287.5k

     ...product that powers innovative AI research and developers. We focus on building the AI/ML platform for improving...  ...well as developing scalable AI infrastructure services globally. We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    17 hours ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...We are hiring a AI Research Scientist - Infrastructure Engineer, Reinforcement Learning, to own reinforcement...  ...track record in machine learning (ML) platforms with deep systems expertise and... 

    AMD

    Santa Clara, CA
    2 days ago
  • $174k - $252k

     ...and implement GenAI solutions, leverage ML infrastructure, and evaluate tradeoffs between...  ...experience testing, maintaining, or launching software products.1 year of experience with...  ...accessible technologies.Google's software engineers develop the next-generation... 

    Google

    Mountain View, CA
    2 days ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...THE OPPORTUNITYWe're looking for a senior software engineer who combines deep systems performance work...  ...cuDNN, CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as PyTorch, TensorFlow... 
    Shift work

    AMD

    Santa Clara, CA
    3 days ago
  •  ...areMoveworks is the Agentic AI Assistant platform that...  ...Moveworks’ Reasoning Engine and natural language...  ...DescriptionThe RoleAre you a software engineer who has honed...  ...the role for you.As a staff software engineer on...  ...fast on scalable infrastructure, solving challenging product... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers. Be the first to apply!