Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers
$207k - $300kLead the design and end-to-end software delivery of specialized AI compute platforms, ensuring high availability for massive-scale workloads.Establish observability and hardening strategies for the lower-half software stack, including firmware, and hardware qualification.Architect robust integration interfaces between custom compute topologies and industry-standard workload schedulers like Kubernetes and GKE.Architect secure boot and cryptographic remote attestation flows for distributed hardware platforms.Partner closely with hardware engineering and chip design teams to influence future architectures for large-scale deployment.Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field.8 years of experience with data structures/algorithms.3 years of experience in a technical leadership role leading project teams and setting technical direction.3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.Experience with lower-half server architectures, hardware-adjacent orchestration, and low-level security implementations.Experience with Kubernetes and Google-internal cluster systems, alongside a proven ability to build telemetry pipelines and monitoring systems for distributed hardware.Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.The Emergent AI infrastructure team in Google is looking to build the next generation of on-prem AI infrastructure to bring the best of Google to empower Frontier model and AI solution builders to advance AI around the world. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor's degree or equivalent practical experience.8 years of software development experience in C, C++, Go, or Python.5 years of experience testing, and launching software products.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.3 years of experience designing, building, and operating large-scale distributed systems, high-performance networking stacks, or operating system internals.
$207k - $301k
...critical system software that enables TPU Machine Learning... ...optimize large-scale ML systems.Lead... ...to software engineers to foster their... ...with large-scale infrastructure, distributed systems... ...Learning Supercomputer (MLSC) team, you... ...generations.The AI and Infrastructure...SuggestedWorldwide$207k - $301k
...Google e.g., Borg team, ML teams, HW platform... ...Warsaw.Develop junior engineers on the team.Minimum qualifications... ...testing, and launching software products.5 years of... ...developing large-scale infrastructure, distributed systems or... ...successful through AI by combining cutting-edge...SuggestedWorldwide$193.93k - $352.29k
...profound opportunity for AI to drive positive... ...fungible is the infrastructure that decides... ...inside Nuro's own engineering organization, under... ...About You5+ years of software engineering... ...practical experience. Staff-level candidates should... ....Experience with ML training or...SuggestedImmediate startFlexible hours$207k - $300k
...scaling, and steering the next-generation infrastructure that powers our AI/ML applications. You will operate at... ..., including creative data engines, generation and rendering pipelines,... ...experience.8 years of experience in software development.5 years of experience testing...Suggested$262k - $365k
...specific models of in app AI (tiny Gemma/Juno Nano)... ...in Google's on-device ML infrastructure (e.g., LiteRT, LiteRT-... ...(GPU /Pixel TPU /NPUs/CPU) on Android,... ...years of experience in software development.7 years of... ...Master’s degree or PhD in Engineering, Computer Science, or...Suggested$207k - $301k
...Interfaces (APIs), Software Development Kits (... ...Software Engineers, specifically around... ...optimizing Generative AI performance across... ...including Android ML, ML Compiler, and... ...decision making), ML infrastructure, or specialization... ...e.g., GPU / Pixel TPU / NPUs / CPU) on Android...Shift work$169k - $224k
...disciplinary organization of scientists, engineers, and physicians and we are... ...please visit grail.com The Staff Software Development Engineer - Enterprise AI Infrastructure is a senior technical role... ...software development tools, AI/ML platforms, cloud infrastructure...Full timeTemporary workWork at officeLocal areaFlexible hoursShift work$174k - $253k
...in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise... ...maintaining, or launching software products, and 1 year of... ...technologies.Google's software engineers develop the next-... ...push technology forward.The AI and Infrastructure team is...Worldwide$262k - $365k
...maintain, and enhance large scale software solutions.Provide technical... ...coach a distributed team of engineers.Drive technical project strategy, lead large-scale ML infrastructure optimization, and oversee the... ...forward.The Google Cloud AI Research team addresses AI challenges...$207k - $301k
...coach a distributed team of engineers.Facilitate alignment and... ...and enhance large scale software solutions.Minimum... ...years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,... ...Management offers centralized and AI-assisted capabilities for...$262k - $365k
...years of experience in software development.7 years of... ...technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment... ...’s degree or PhD in Engineering, Computer Science, or a... ...solutions.The User-AI Flywheel team in Search...$262k - $365k
...setting the standard for engineering excellence.Act as a technical... ...8 years of experience in software development.5 years of... ...of experience leading ML design and optimizing ML infrastructure (e.g., model deployment,... ...Experience with shipping 0-to-1 AI applications, with a...$207k - $301k
...co-evolve ads, leverage AI to maintain business... ...advertisers.Leverage AI/ML advancements, including... ...years of experience in software development.8 years of... ...with ML design and ML infrastructure (e.g., model deployment... ...practices.Google's software engineers develop the next-...$127.1k - $185k
...a talented early-career engineer to join our team that owns... ...stack for EC2 distributed AI/ML systems. You'll work on software that enables the world's... ...networking, and machine learning infrastructure - building the systems... ..., supervisors, and staff; adhere to standards of excellence...InternshipLocal areaFlexible hours$207k - $301k
...team of high-performing engineers who design and model... ...roadmap for modeling infrastructure, exercising strong technical... ...testing and launching software products and working... ...and passionate Staff Software Engineering to... ...of both networking and AI/ML landscapes. Effectively...Remote workWorldwide$207k - $340k
...the team.LinkedIn's AI and Machine Learning Engineers are both data/research scientists and software engineers, who develop... .... As a Principal Staff Software Engineer you... ...lead who will use AI/ML to push the... ...strengthen LinkedIn’s AI infrastructure.QualificationsBasic...For contractorsWork experience placementWork at officeFlexible hours$193.93k - $352.29k
...and profound opportunity for AI to drive positive change in... ....About the RoleThe Autonomy ML Infrastructure team is responsible for building... .... Work with autonomy engineers to optimize, validate, and deploy... ....Write robust, high quality software to increase our confidence...Work experience placementImmediate startFlexible hours$175k - $287k
...of the largest privately managed compute infrastructures in the world outside the public cloud providers. As a Staff Software Engineer on the Compute Infrastructure team, you will... ...processing petabytes daily, and the AI/ML infrastructure driving recommendations, search...For contractorsWork experience placementWork at officeFlexible hours$200k - $322k
...deep learning ignited modern AI — the next era of computing.... ...to join us today.Design-for-X Engineering at NVIDIA works on groundbreaking... ...AI projects that requires ML & Gen AI expertise.You will... ...deployment cycles as part of the AI Infrastructure requirements at an org-wide...Full time$190k - $260k
...artificial intelligence (AI) powered technology... ...commercial self-driving software to develop, test and deploy... ...models - depends on infrastructure that turns thousands of... ...throughput. We are looking for engineers who make model training... ...formatsPartner with ML teams to scale new...Temporary workWork at officeVisa sponsorship$198k - $326k
...As part of our world-class software engineering team, you will take the lead... ...the next-generation infrastructure and platforms for LinkedIn,... ...search platform, best-in-class AI/ML infrastructure, Kubernetes... ...within our company.As a Sr. Staff Software Engineer, you will...For contractorsWork at officeFlexible hours$198k - $326k
...business needs of the team. LinkedIn’s AI Infrastructure organization is responsible for... ...frameworks.We are looking for a Senior Staff Software Engineer with deep expertise at the intersection... ...performance improvementsPartner closely with ML, infrastructure, and product teams to...For contractorsWork at officeFlexible hours$147k - $210k
...components of scalable machine learning (ML) and agentic AI infrastructure for manufacturing.Maintain and... ...:Bachelor's degree in Electrical Engineering, Computer Science, relevant technical... ....2 years of experience with software development in one or more programming...$175k - $287k
...scaling LinkedIn’s AI model training, feature engineering and serving with hundreds... ...infra, compute software, and hardware to... ...queries Model Training Infrastructure: As an engineer on... ...hundreds of new ML models per quarter... ...performance possible.As a Staff Software Engineer,...For contractorsWork experience placementWork at officeFlexible hours$193.93k - $352.29k
...profound opportunity for AI to drive positive... ...driving technology. In an ML-first system, the overall... ...and reliable data infrastructure. This infrastructure is... ...collaborates closely with system engineers to thoroughly validate... ...across broader software organizationA bachelor'...Immediate startFlexible hours$184k - $287.5k
...product that powers innovative AI research and developers. We focus on building the AI/ML platform for improving... ...well as developing scalable AI infrastructure services globally. We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental...Full timeRemote work- ...next-generation computing experiences—from AI and data centers, to PCs, gaming and... ...We are hiring a AI Research Scientist - Infrastructure Engineer, Reinforcement Learning, to own reinforcement... ...track record in machine learning (ML) platforms with deep systems expertise and...
$174k - $252k
...and implement GenAI solutions, leverage ML infrastructure, and evaluate tradeoffs between... ...experience testing, maintaining, or launching software products.1 year of experience with... ...accessible technologies.Google's software engineers develop the next-generation...- ...next-generation computing experiences—from AI and data centers, to PCs, gaming and... ...THE OPPORTUNITYWe're looking for a senior software engineer who combines deep systems performance work... ...cuDNN, CUTLASS, Thrust, CUB, NCCL), and ML framework cores such as PyTorch, TensorFlow...Shift work
- ...areMoveworks is the Agentic AI Assistant platform that... ...Moveworks’ Reasoning Engine and natural language... ...DescriptionThe RoleAre you a software engineer who has honed... ...the role for you.As a staff software engineer on... ...fast on scalable infrastructure, solving challenging product...Work at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, AI/ML Infrastructure, TPU Supercomputers. Be the first to apply!
- senior infrastructure engineer Sunnyvale, CA
- infrastructure engineering manager Sunnyvale, CA
- infrastructure engineer Sunnyvale, CA
- infrastructure developer Sunnyvale, CA
- principal infrastructure engineer Sunnyvale, CA
- remote infrastructure engineer Sunnyvale, CA
- software engineer - cloud services Sunnyvale, CA
- id software Sunnyvale, CA
- healthcare software sales Sunnyvale, CA
- software technical support Sunnyvale, CA
