Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, ML Compilers, TPU

$207k - $300k

Google

Contribute to the compiler for a novel processor designed to accelerate machine learning workloads.Target and compile high-performance implementations of operations at distributed scale.Design and implement new compiler passes that extract more performance out of current and next-generation TPUs, directly impacting fleet efficiency.Collaborate closely with hardware designers to co-design future processors.Research high-level representations to effectively program large-scale, distributed, and heterogeneous systems.Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of experience programming in C++ or Python.5 years of experience testing, and launching software products.5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.3 years of experience with software design and architecture.Preferred qualifications:Experience with state-of-the-art ML compilers and their internals, experience writing compiler optimization passes.Experience with debugging correctness and performance issues at all levels of the ML software stack.Familiarity with accelerator HW architectures (TPUs/GPUs).Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.As a part of this team, you will build the Accelerated Linear Algebra (XLA) compiler which enables Tensor Processing Unit (TPUs), Google's in-house custom designed processor, to accelerate machine learning and other scientific computing workloads for both internal Google customers and external Cloud customers.You will need to support new workloads, optimize for new models and new characteristics, as well as support new TPU hardware across multiple generations.In this role, you will be working on a state-of-the-art TPU compiler with opportunities to work up and down the compiler stack, as well as on end user ML models and on Hardware (HW)/Software (SW) co-design.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Note: By applying to this position you will have an opportunity to share your preferred working location from the following: New York, NY, USA; Sunnyvale, CA, USA.Bachelor's degree or equivalent practical experience.8 years of experience programming in C++ or Python.5 years of experience testing, and launching software products.5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.3 years of experience with software design and architecture.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, ML Compilers, TPU in New York, NY vacancy
  • $207k - $300k

    Contribute to the compiler for a novel processor designed...  ...testing, and launching software products.5 years of...  ...with state-of-the-art ML compilers and their internals...  ...).Google's software engineers develop the next-generation...  ...as well as support new TPU hardware across... 
    Suggested
    Worldwide

    Google

    New York, NY
    6 days ago
  • $207k - $300k

     ...experience. 8 years of experience in software development. 5 years of...  ...Master’s degree or PhD in Engineering, Computer Science, or a...  ...physical design software, such as compilation, performance optimization, libraries...  ..., and algorithms, covering ML model design, optimization... 
    Suggested

    Google DeepMind

    New York, NY
    4 days ago
  • $188k - $275k

     ...Nasdaq: CRWV) in March 2025. Learn more at .What you’ll doAs a Staff Software Engineer on the Identity & Access Management (IAM) team, you will be...  ...lifecycleEmerging Tech Knowledge: Familiarity with AI/ML workloads, GPU-based infrastructure, and the unique security... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Immediate start
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $235.7k - $277k

     ...platform they already use to move and process events at scale.As an engineer, you'll own delivery of significant pieces of this product — not...  ..., or streaming data systems.You don't need a background in ML research or model training — this role is about building and operating... 
    Suggested
    Live in

    Confluent

    New York, NY
    1 day ago
  •  ...insights products that enable Credit underwriting use casesMentoring engineers and contributing to a strong, inclusive team culture....  ...building and maintaining production systems that serve and support ML models, both in online and offline settings - as well as working... 
    Suggested
    Work experience placement
    Work at office
    Local area

    Plaid Financial

    New York, NY
    2 days ago
  • $252k - $315k

     ...evaluation, and more. We are looking for a strong engineer to join our team and help us build and...  ...will have a strong understanding of software engineering principles and practices, as...  ...frontend, and interacting with LLMs and ML models. You will solve hard engineering problems... 
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $234k - $300k

    The ML Observability team builds cutting-edge tools to monitor, explain, and improve...  ...to ship AI with confidence.As a Staff Engineer, you’ll lead the development of new features...  ...deep understanding of both AI systems and software engineering to solve open-ended problems... 
    Work at office

    Datadog

    New York, NY
    4 days ago
  •  ...analytics. We’re a mix of machine engineering engineers and full-stack software engineers impacting ~every Stripe transaction...  ...for their needs.What you'll doAs a Staff Engineer on Payment Intelligence,...  ...the stack and interacting with ML teams and models.... 

    Stripe

    New York, NY
    23 hours ago
  • $50 per hour

    Staff Software EngineerThe global capital markets are among the largest markets in the world valued...  ...of legal terms.As a Staff Software Engineer, Full Stack at Noetica, you'll help build...  ...collaborate with a talented team of AI/ML PhDs, legal SMEs, and market strategists... 
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    New York, NY
    2 days ago
  • $252k - $315k

    Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through...  ...AI.This is a horizontal, high-impact L6 Staff Fullstack Engineer & Architect position...  .... They work at the intersection of ML, operations, and analytics to ensure we deliver... 
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $248.4k - $310.5k

    Staff Software Engineer, Full-Stack - Enterprise Gen AIScale GP (Scale Generative AI Platform) is an enterprise-grade AI platform providing APIs...  ...TailwindWork closely with product managers, designers, and AI/ML teams to create seamless, intuitive, and impactful user... 
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $136k - $253k

    We're looking for a Lead Engineer to join the CoCounsel Application Experience team and play...  ...Experience: 6+ years of professional software engineering experience building and shipping...  ...production environment.Familiarity with AI/ML infrastructure including vector databases... 
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    2 days ago
  • $207k - $301k

     ..., test, deploy, maintain, and enhance large scale software solutions.Provide technical leadership on high-impact...  .... Influence and coach a distributed team of engineers.Lead the design of GenAI solutions, optimize ML infrastructure, and guide the development of data... 

    Google

    New York, NY
    2 days ago
  • $195k - $408k

     ...impact, and the team operates with the high engineering rigor that this demands.About the RoleWe're hiring a Senior Software Engineer (Staff scope) to help scale and evolve this...  ...including state of the art pacing engine, scoring/ML engine, modularizing designed for agentic... 
    Work at office
    Local area
    Immediate start
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    3 days ago
  • $240k - $300k

     ...platform; you make it real across the stack.) This is a platform-engineering role first, so you'll go where the priorities are: the...  ...real-time matching to autonomous vetting pipelines powered by ML and agents.Own architecture for the platform, thinking ahead to... 
    Temporary work
    Local area
    Shift work

    Traba

    New York, NY
    23 hours ago
  • $262k - $364k

     ...practical experience. 8 years of experience in software development.7 years of experience with...  ...with how AI-driven signals and ML models translate into retail-specific business...  ...influence and align stakeholders across engineering, product, and sales.Google's software engineers... 

    Google

    New York, NY
    2 days ago
  • $207k - $300k

     ...practical experience.8 years of experience in software development.5 years of experience with...  ...(e.g., sequential decision making), ML infrastructure, or specialization in another...  ...qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical... 

    Google

    New York, NY
    2 days ago
  • $190k - $270k

    Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with enabling data teams to solve the world’s toughest...  ...or security.You’ll partner closely with research scientists, ML engineers, and platform teams to turn experimental workloads... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    3 days ago
  • $188k - $275k

     ...environments, enjoy tackling challenging engineering problems, and are excited by...  ...systems.About the Role: As a Staff Engineer on Marimo's molab...  ...Are:8+ years of experience in software engineeringStrong fundamentals...  ...and researchers in AI, ML, data engineering, NLP, or other... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Worldwide
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $160k - $180k

     ...WHO WE ARE .The Role We'rehiring multiple Staff Engineers to join a small, high-performance group supporting the engineering organizations...  ...initiatives. Incorporate modern industry patterns — including AI/ML tooling — into our technical strategy where it genuinely moves... 

    Jobiqo

    New York, NY
    2 days ago
  •  ...Software Engineer Opportunity At Extend Extend is building a modern document processing cloud. We're on a mission to transform how the world...  ...end, operating with high agency ~ Experience deploying AI/ML systems into production environments ~ Experience with... 
    Work at office
    Local area
    Relocation

    Extend

    New York, NY
    4 days ago
  • $201k - $250.5k

     ...healthcare for women. The Opportunity We're looking for a Staff Software Engineer to help build the technical foundation that will scale our...  ...base Own technical initiatives across the stack, from AI/ML-powered health guidance tools to EMR, billing, and... 
    Temporary work
    Work at office
    Local area
    Work from home
    Flexible hours
    3 days per week

    Allara Health

    New York, NY
    11 hours ago
  •  ...Staff Software Engineer About Titan: Titan is an AI holding company transforming IT services with its Augmented AI platform. We acquire...  ...architectures (AWS, GCP, or Azure). ~ Familiarity with AI/ML-driven systems or real-time data processing is a plus. ~ User... 

    Titan

    New York, NY
    1 day ago
  • $209.7k - $283.8k

     ...The opportunity Unity Vector builds an offline ML platform that powers insight, experimentation, attribution, and AI-driven...  ..., scalable, and architecturally sound. We are seeking a staff ML engineer to design and evolve the large-scale offline platform. This role... 
    Work at office
    Worldwide
    Relocation package

    Unity

    New York, NY
    23 hours ago
  • $175k - $250k

     ...on placing the best product managers, software, and hardware talent at innovative companies...  ...States to help them hire. Senior/Staff Software Engineer Location: New York City, NY (...  ...operations, commercial graph infrastructure, AI/ML workflows, frontend platforms, and core... 
    Contract work
    H1b
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    New York, NY
    1 day ago
  • $320k - $405k

     ...growing group of committed researchers, engineers, policy experts, and business leaders working...  ...applications that utilize modern ML/AI technology 3D graphics, visual effects...  ...hybrid policy: Currently, we expect all staff to be in one of our offices at least 25%... 
    Visa sponsorship

    Anthropic

    New York, NY
    4 days ago
  • $190k - $261.25k

     ...can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve...  ...of distributed AI workloadsCollaborate with platform, infra, and ML teams to deliver seamless end-to-end experiencesShape how... 
    Local area
    Worldwide

    DataBricks

    New York, NY
    2 days ago
  •  ...About the Role We’re seeking a Staff Software Engineer to lead technical direction and architectural decisions for a secure, AI-enabled...  ...Contribute hands-on across backend services, infrastructure, and ML-enabled components Shape engineering culture and best... 
    Full time

    Next Ventures

    New York, NY
    a month ago
  • $220k - $300k

     ...4) Fast Company Most Innovative Companies (2020, 2023) Fortune Best Workplaces NY (2020, 2021, 2022, 2023, 2024) As a Staff ML/AI Engineer at Maven, you will: Design, build, and deploy end-to-end AI-powered solutions using AI models (e.g., OpenAI, Gemini) and... 
    Full time
    Contract work
    Work at office
    Immediate start
    Remote work
    Flexible hours
    3 days per week

    NextGen

    New York, NY
    20 days ago
  •  ...this vision. Our exceptionally strong founding team includes software engineers, AI researchers, security engineers, and product designers hailing...  ...across disciplines. Work closely with security engineers, AI/ML researchers and product design to bring new capabilities into... 
    Full time

    Stealth Cybersecurity AI Startup

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, ML Compilers, TPU. Be the first to apply!