Principal Software Engineer, ML System Architect
$349k - $431kWaymo
Overview Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. Waymo's Systems Intelligence and ML team works with Research and Production teams to develop and deploy models that are core to our autonomous driving software. Waymo's AI is at the heart of this mission, and we are increasingly leveraging large-scale Foundation Models to unlock new capabilities for the Waymo Driver. Join Waymo to architect and build a unified, large-scale AI platform leveraging Google DeepMind's latest foundation models (like Gemini) for comprehensive world understanding and generation, to accelerate the development and distillation of models powering the world's most experienced driver. In this hybrid role, you will report to our Director of Engineering who leads Systems Intelligence and Machine Learning. We are seeking a deeply experienced Principal Software Engineer to provide the overarching technical vision, architectural design, and cross-team leadership to make Waymo's foundation model systems nextgen a success. This role is pivotal in transforming Waymo's offboard ML landscape from a fragmented set of models and tools into a cohesive, efficient, and powerful platform centered around a unified foundation model recipe, deeply integrated with Google Deepmind's latest innovations with Gemini. You will be the technical authority defining how Waymo builds, trains, and utilizes these large models offboard to ultimately accelerate onboard deployment and improvements. You will: Architect ML Systems: Define and drive the technical roadmap for the platform, encompassing codebase unification, data pipelines, model architecture, training recipes, and evaluation frameworks. Codebase Consolidation & Best Practices: Lead the unification of existing forked locations of foundation model component codebases into a production-hardened, shared repository. Establish and enforce rigorous coding standards, testing practices, and API designs to ensure long-term codebase health and developer velocity. Google Deepmind Integration & API Definition: Serve as the primary technical interface between Waymo's offboard model development and Google Deepmind's core model and framework teams. Define clear APIs and integration patterns, ensuring Waymo can seamlessly leverage and contribute to Google Deepmind's advancements while maintaining stability and control. Unify Core Components: Drive the consolidation of tokenization/de-tokenization strategies, data formats, input pipelines, and evaluation methodologies across all offboard Foundation Model use cases. Scalable Training & Distillation: Architect for efficient large-scale distributed training and establish a common, efficient distillation setup to transfer knowledge from large teacher models to onboard student models. Technical Leadership & Influence: Provide technical mentorship, guidance, and direction to engineers across multiple teams within SIML and AI Foundations. Drive alignment on technical decisions with senior stakeholders across Waymo and Google Deepmind. Drive Efficiency: Instill a culture of efficiency in model development, training, and resource utilization, aiming for high ML Productivity. You have: Master's degree or PhD in Computer Science or a related field. 12+ years of experience in software engineering, with at least 8+ years focused on large-scale machine learning systems, deep learning frameworks, and AI infrastructure. A track record of architecting and delivering complex, high-impact ML platforms or models. Deep expertise in Python, C++, and ML frameworks like JAX and TensorFlow. Extensive experience with large-scale distributed training on TPUs/GPUs and associated challenges. Demonstrated ability to design robust, scalable, and maintainable software architectures and APIs. Understanding of data pipelines, storage systems, and tokenization techniques. Experience working effectively with research and product teams, and influencing across organizational boundaries. Technical leadership skills, with the ability to drive strategy, influence across teams, and mentor other engineers. Communication skills, with the ability to articulate complex technical vision and drive alignment, capable of conveying complex technical ideas clearly. We prefer: Experience with multimodal and generative models. Experience in autonomous vehicle systems or robotics. Contributions to open-source ML frameworks or widely used internal tools. Experience with simulation systems. Compensation and Benefits Salary Range: $349,000 - $431,000 USD Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. #J-18808-Ljbffr
$286.8k - $344.1k
...technology. Our advanced AI software and foundation models... ...of automated driving systems. Our vision is to... ...looking for a System Architect – Robotaxi to help shape... ...across hardware, software, ML, safety, and vehicle... ...architecture, systems engineering, or solution...SuggestedFull timeRemote work$272k - $425.5k
Principal Software Engineer – Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software Engineer – Large-Scale LLM... ...large-scale LLM inference.* Architect and implement deep integrations... ...high-performance storage, or ML systems infrastructure in C/C++...SuggestedLocal areaRemote work$231.4k - $331.8k
...Cisco's Platform & Identity Engineering Group, a foundational group responsible... ...to provide the underlying systems that support Cisco's... ...technical direction of Cisco's software and technology solutions, influencing... ..., data platforms, or AI/ML-driven systems. Track...SuggestedFull timeTemporary workLocal areaFlexible hours- ...innovation, we’d love to hear from you. What to Expect As a Software Engineer (Systems), you will be responsible for building out the core software... ...software and working cross-functionally with our Software, ML, Controls, and Hardware teams. What You’ll Do Help...SuggestedFull time
$249k - $348.5k
Principal Software Development Engineer Our Technology Team partners with teams across Expedia... ...cloud‑native distributed systems and platform services on... ...driven systems and applying AI/ML concepts to cloud or... ...capabilities. A Systems Architect: Deep plumbing knowledge of...SuggestedFlexible hours- ...skilled and experienced Principal AI/ML and Gen AI Engineer to join our dynamic team... ...COSMIC (CCB Operational Systems for Machine Intelligence... ...organization's strategy. Architects and governs agentic AI-enabled... ...of tools within the Software Development Life Cycle toolchain...
$141.3k - $226k
...Job Description Broadcom is looking for a Software Systems Engineer (P5) to join VMware Cloud Foundation’s (VCF) AI and Advanced Services team. This... ...‑based platform services: Model Gallery, Model Runtime, ML API Gateway, Data Indexing and Retrieval, and Agent Builder....Full timeWork at officeLocal area- ...transition. About The Role As an AI/ML Engineer at Powerline, you will be instrumental... ...with MLOps and building AI/ML systems end to end. ~ Strong communication skills... ...collaborate with diverse teams, including software engineers, optimization engineers, and energy...Full time
$170k - $190k
...focus on outcomes. ASAPP’s AI Engineering team is seeking an... ...a highly experienced Lead AI/ML Engineer to join our Core GenerativeAgent... ...deploying cutting-edge AI systems that power mission-critical enterprise... ...-on technical leader who can architect low-latency, highly reliable...Full time$210k - $247k
...impact opportunity for a Principal Cloud Platform Software Engineer to join our world-class engineering... ..., you will be the lead architect owning the cloud-to-field... ...-grade, uptime-critical systems where software decisions... ...success in leveraging AI/ML to drive developer...Local areaRemote workFlexible hours- ...right place. As a Principal Engineer at JPMorganChase... ...Job responsibilities Architect the composable virtual... ...knowledge of tools within the Software Development Life Cycle... ...-as-a-service systems, or large-scale infrastructure... ...dashboards AI/ML for infra optimization...Shift work
$120k - $400k
...integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust... ...or equivalent degree Excellent software engineering skills, with a focus on maintainable performant...Full timeWork experience placementLocal area$204k - $259k
...across 15+ U.S. states. The Waymo ML Frameworks & Efficiency team partners... ...that are core to our autonomous driving software. We help our partners by offering the... ...autonomous driving. We are looking for engineers with ML system expertise to help us train and improve...Full timeRemote work$145k - $219k
...efficiently. We continuously refine our routing engine to calculate more efficient routes,... ...on building and scaling both the backend systems and onboard modules for the Routing team.... ...Experience in training and inferencing ML models. You have extensive experience working...Full time$165k - $225k
...and enhance core components of the ML infrastructure, including systems for offline and online model training... ...production. Collaborate with ML engineers to build robust model pipelines... ...related discipline. Familiarity with software development processes, including...Full timeWork experience placementLocal area$166k - $244k
...Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more,... ...order to set you up for success as an Senior Software Engineer in the Gemini App team, we look... ...data analysis skills Experience with ML, especially LLMs Ability to thrive and...Full time$120k - $400k
...integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust... ...degree Possess outstanding software engineering skills with a focus on efficiency and performance...Full timeWork experience placementLocal area$10,000 per month
...Palantir builds the world’s leading software for data-driven decisions and... .... The Role Software Engineers at Palantir build software at... ...planning tools driven by rich-ML models. Our customers use our... ...with data structures, storage systems, cloud infrastructure, front-...Work experience placementInternshipWork at officeRemote workWork from home$120k - $400k
...integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust... ...partnership with our ML Research and Hardware Engineering teams Provide expertise and guidance on...Full timeWork experience placementLocal area$153k - $222k
...defense. As a full-stack engineer, you'll be involved in all aspects... ...the latest and greatest software advancements to the warfighter... ...training, and inference Work on ML-adjacent tooling and... ...ownership of key components Help architect and scale our product as it...Full timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift- ...and operations at scale. About The Role The Principal Compiler Engineer - ML Systems position will be responsible for working with the different... ...fundamentals. Experience building and deploying software products. Experience with one or more deep learning...Full timeTemporary workLocal areaFlexible hours
$162k - $260k
...Localization team is responsible for the software that safely and accurately... ...for a Senior Software Engineer to join us in solving these technical... ...of the localization system Collaborate with engineers... ...applications Prior experience with ML solutions and/or GPU...Full time$149.37k
...Applied Intuition is a vehicle software supplier that accelerates the... ...cycles, deliver high-quality systems, and accelerate the production... ...behavior software and leverage ML components to achieve highway... ...Collaborate with customers’ engineers and manage customer relationships...Full timeFor contractorsFor subcontractorWork at officeWorldwide$170k - $216k
...discoveries to directly feed the ML training flywheel and ensure... ...role, you will report to an engineering manager. You will:... ...events from perception evaluation systems. Build and maintain... ...related field. ~2+ years of software development experience (3+ years...Full timeRemote work- ...What to Expect As a Software Engineer (Full Stack), you will be responsible... ...manufacturing, operations, ML, and robotics. This will... ...robust backend services, and architecting distributed data processing... ...implementing cloud-native distributed systems Experience building React...Full time
$272k - $431.25k
...NVIDIA is seeking a highly motivated Principal System Software Engineer to drive next-generation innovations in automotive platform software, system architecture... .... Experience with GPU-accelerated computing and AI/ML software platforms. Contributions to Linux kernel, open-...- ...AI/ML Engineering Intern Company: Synopsys Location: Mountain View, CA (On-site, Remote) Category: Interns/Temp Hire Type: Intern Job ID... ...researchers, and gain hands‑on experience building intelligent software solutions. The ideal candidate is curious, technically strong...Full timeTemporary workPart timeSummer workInternshipSummer internshipWork at officeRemote work
$170k - $230k
...Site Reliability Engineer (SRE) Palo Alto / San Francisco Bay Area About Mithril... ...allocated, and monitored across providers. The systems you build will have a direct line to... ...with GPU/TPU-accelerated workloads or AI/ML infrastructure. Exposure to multi-cloud...Work at officeLocal area1 day per week- ...with detailed steps, metrics, and automation in place. Key Responsibilities Run and manage manual evaluation experiments across AI/ML systems. Develop and maintain automation infrastructure (scripts, pipelines, tools) to reduce manual evaluation work. Design and execute...
- Bachelor's or Master's degree in Computer science, Software Engineering, or related field. 10+ years of experience in Android mobile app development... ...3+ years in medical device application. Experience of architecting, designing and developing of mobile applications. Strong...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer, ML System Architect. Be the first to apply!
- system performance engineer Mountain View, CA
- software system engineer Mountain View, CA
- advanced systems engineer Mountain View, CA
- distributed systems engineer Mountain View, CA
- senior staff systems engineer Mountain View, CA
- senior linux systems engineer Mountain View, CA
- sr systems engineer Mountain View, CA
- computer system validation engineer Mountain View, CA
- operations support system engineer Mountain View, CA
- operating system engineer Mountain View, CA


