Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff GPU Performance Engineer: Lead Fleet-Scale ML Optimizations

Google Inc.

Google Inc. is seeking a Staff Software Engineer focused on GPU Performance in New York, NY. The ideal candidate will have deep expertise in software development and experience with modern GPU architectures. Responsibilities include maintaining benchmarks for LLM training and collaborating with teams like DeepMind to enhance model performance. The role offers a competitive salary, equity, and extensive benefits, including 20 vacation days per year, health, and a retirement plan. #J-18808-Ljbffr Google Inc.

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Staff GPU Performance Engineer: Lead Fleet-Scale ML Optimizations in New York, NY vacancy
  •  ...skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement...  ...demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron.... 
    Suggested

    Reflection

    New York, NY
    1 day ago
  • $174k - $253k

     ...searching for experienced Software Engineers to develop optimizations for the latest generation of GPUs, crucial...  ..., alongside expertise in modern GPU architectures and low-level GPU...  ...programming. This role involves addressing performance bottlenecks and influencing GPU... 
    Suggested

    Google

    New York, NY
    15 hours ago
  • $207k - $301k

    Staff Software Engineer, GPU Performance Advanced Experience owning outcomes...  ...solve challenging ML model performance...  ...solutions at Google fleet‑wide scale. Run performance...  ...technical leadership role leading project teams and...  ...with compiler optimization, code generation,... 
    Fleet
    Temporary work
    Worldwide

    Google Inc.

    New York, NY
    15 hours ago
  • $166k - $244k

    Senior Software Engineer, GPU Performance Apply X Note: By...  ...Experience with compiler optimization, code generation,...  ...at massive scale, and extend well...  ...performance for our ML models, adapting...  ...future of world-leading hyperscale...  ...of Google’s GPU fleet by working with various... 
    Fleet
    Full time
    Worldwide

    Google Inc.

    New York, NY
    1 day ago
  • $125k - $200k

     ...accurate insights at any scale, cost-effectively....  ..., automotive and fleet telematics...  ...sellers, presales engineers, customers, and community...  ...interoperability, GPU/NVIDIA acceleration...  ...using attributes, and optimizing data storage/...  ...Data Driven: We lead with instinct and follow... 
    Fleet

    Kx

    New York, NY
    3 days ago
  •  ...greenest municipal vehicle fleet in the country. Leading the City’s efforts to reduce...  ...best practices. The Senior Engineer will work within the DEM’s Building Optimization Team (BOT), under the guidance...  ...and centrally at DEM. Performance management - Monitor, report... 
    Fleet
    Full time
    Apprenticeship
    Local area

    New-York-City-Department-of-Citywide-Administrative-Services

    New York, NY
    15 hours ago
  •  ...greenest municipal vehicle fleet in the country. - Leading the City's efforts to reduce...  ...practices. The Senior Engineer will work within the DEM’s Building Optimization Team (BOT), under the guidance...  ...centrally at DEM. 3. Performance management | Monitor, report... 
    Fleet
    Full time
    Apprenticeship
    Local area

    City of New York

    New York, NY
    25 days ago
  • $152k - $228k

     ...Nebius Nebius is leading a new era in...  ...in-house AI/ML teams. Our employees...  ...leaders and engineers in the field....  ...building a high-performance AI inference platform...  ...workloads at scale. In AI...  ...latency constraints, GPU economics, and...  ...and required optimization depth ~ Align... 
    Temporary work
    Immediate start
    Remote work
    Flexible hours

    GrabJobs

    New York, NY
    4 days ago
  •  ...greenest municipal vehicle fleet in the country. - Leading the City's efforts to...  ..., technical expertise, staff resources, strategic...  ...analytics. The Associate Engineer, Building Optimization will work within DEM’s...  ...optimization and (3) performing project inspections.... 
    Fleet
    Permanent employment
    Full time
    For contractors

    City of New York

    New York, NY
    25 days ago
  • Obsidian is seeking an MLOps Engineer to join their AI lab's cutting-edge GenAI team in New York. This full...  ...candidate should have 2+ years of experience in ML infrastructure, with skills in custom GPU kernel optimization. This position offers a chance to be at the forefront... 
    Full time

    Obsidian

    New York, NY
    2 days ago
  • $178.97k - $268.46k

     ...establishing a culture of engineering performance, scalability, and financial optimization through the strategic adoption...  ...building foundational AI/ML models. Responsibilities Lead the identification, prioritization...  ...with Aerospike and large‑scale distributed data platforms.... 
    Work experience placement

    SwiftCruit

    New York, NY
    2 days ago
  • $135k - $165k

     ...based planning and optimization software deployed...  ...our RL and platform engineers to translate...  ...simulation, or applied ML. Lean / Six...  ...operation is really performing, the answer comes...  ...job is to keep the fleet moving — the consequences...  ...logistics at the scale of a military... 
    Fleet
    Live in
    Visa sponsorship

    Tagup

    New York, NY
    1 day ago
  • $83k - $110k

     ...innovators to build and scale AI with...  .... Trusted by leading AI labs, startups...  ...infrastructure performance with deep...  ...You'll Do: The Fleet Reliability Operations...  ...of committed engineers working to...  ...flexibility and optimism anticipating shifting...  ...administering GPU-related... 
    Fleet
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    New York, NY
    16 days ago
  • $125k - $155k

     ...Partnering with Machine Learning Engineers, Data Scientists, and...  ...for deploying, operating, scaling, monitoring, and governing ML workloads so they run...  ...processing. ~ Own GPU and CPU infrastructure selection, scaling, and optimization, including instance benchmarking... 

    Associated Press

    New York, NY
    4 days ago
  • $175k - $300k

     ...Fluidstack Production Engineering Team Examples of key exciting problems...  ...device and link. At 10 GW scale, you cannot operate what you cannot...  ...match reality: integrate fleet state as a machine-readable source...  ..., so every new site and GPU generation lands cleanly from... 
    Fleet
    Local area

    FluidStack

    New York, NY
    2 days ago
  • $165k - $242k

     ...Systems Kernel Engineer Livingston, NJ / New...  ...innovators to build and scale AI with confidence. Trusted by leading AI labs, startups,...  ...infrastructure performance with deep technical...  ...storage, virtualization, GPU/DPU enablement)....  ...with HPC and Fleet teams to ensure kernel... 
    Fleet
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • A growing e-commerce jewelry brand is seeking a Senior Performance Marketing Manager to optimize and scale their paid media strategy. This role involves hands-on campaign management across platforms like Meta and Google, alongside analytics to track performance. Ideal candidates... 
    Remote work

    Wear Felicity

    New York, NY
    4 days ago
  • $300 per month

     ...for hours at a time, performing end-to-end work for some...  ...advanced applied ML at production scale. Our investors include...  ...Prashant Mital, Applied AI Lead, OpenAI Location: NYC...  ...looking for a Growth Engineer to own our go-to-...  ...: Stand up and optimize paid channels (search... 
    Work at office

    Basis AI

    New York, NY
    1 day ago
  • $123k - $165k

     ...Site Reliability Engineer II Req ID: 10...  ...Our engineering fleet is a horizontal set...  ...to come. Reach, Scale & Impact: More than...  ...drives improvements in performance, resiliency, and...  ..., and performance optimization. This role...  ...Understanding foundational AI/ML concepts,... 
    Fleet
    Full time

    Disney Media & Entertainment Distribution

    New York, NY
    more than 2 months ago
  •  ...company is looking for exceptional generalist engineers who thrive with autonomy. This fully...  ...impact projects across the vLLM stack, from optimizing CUDA kernels to designing distributed...  ...strong track record in systems programming or ML infrastructure. Competitive compensation... 
    Remote job

    Inferact

    New York, NY
    4 days ago
  • Goldman Sachs Group, Inc. is seeking a Machine Learning Engineer, Vice President in New York. The role involves developing and deploying...  ...models in a dynamic environment and working with large-scale data. Candidates should have substantial experience in machine... 

    Goldman Sachs Group, Inc.

    New York, NY
    15 hours ago
  • $131.25k - $153.75k

     ...Senior Value Engineer - Banking New York, US, New York...  ...Client Onboarding to optimizing Capital Markets...  ...solutions using the world's leading Process Intelligence (PI...  ...combination with top AI and ML technology partners. By...  ...Banking value chain, scaling knowledge across the... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Celonis

    New York, NY
    5 hours ago
  • $131k - $154k

     ...Description As a Senior Value Engineer specializing in CPG,...  ...Store Delivery (DSD) optimization and dynamic logistics...  ...solutions using the world’s leading Process Intelligence (...  ...with top AI and ML technology partners such...  ...tangible ROI from AI at scale by shifting from rule‑based... 
    Shift work

    Dormont Manufacturing Co

    New York, NY
    15 hours ago
  • $75k - $125k

     ...investment. Backed by leading investors...  ...America, Formic is scaling rapidly and building...  ...new era of high-performance, Made in America...  ...About the team: The Fleet Operations Team...  ...of automation engineering and real-world factory...  ...for: Fearless Optimism: You make bold bets... 
    Fleet
    Full time
    Temporary work
    Local area
    Remote work
    Home office
    Flexible hours
    Shift work
    Night shift

    Blackhornvc

    New York, NY
    4 days ago
  •  ...patient calls while staff drowns in administrative...  ...an ex-Amazon Alexa engineer who led AI/ML teams at Salesforce,...  ...teams to deploy and optimize AI agents in live healthcare...  ...to ensure seamless performance. Drive customer...  ...sensitive patient data. Scale personalization :... 
    Work at office
    Flexible hours

    Clarion

    New York, NY
    15 hours ago
  • $200k

     ...Overview Manager / Lead Tech Recruiter – AI & ML | U.S. Market From London | Ex-France...  ...hiring a Machine Learning Engineer with deep expertise in...  ...prompt conditioning, etc.) Optimize inference pipelines for low...  ...Experience deploying ML models at scale (Docker, Kubernetes, cloud... 
    Full time
    Visa sponsorship

    Harnham

    New York, NY
    4 days ago
  •  ...Fleetline writes optimization algorithms for large trucking companies; after a recent spike in contracted...  ...the team and looking for founding engineers. A bit about us Booked out for the next 5 months by enterprise trucking fleets. Lean, welcoming, and dedicated founding team... 
    Fleet

    Fleetline

    New York, NY
    1 day ago
  • $315k

     ...committed researchers, engineers, policy experts,...  ...innovations in GPU performance and systems engineering...  ...at unprecedented scale, developing cutting-edge optimizations that directly enable...  ...improvements in production ML systems and will be...  ..., we expect all staff to be in one of our... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    more than 2 months ago
  • $120k - $140k

     ...in the nuclear and energy space creating a never before seen fleet-scale approach to building nuclear reactors. Through its design-once...  ...Company is seeking a highly motivated and detail-oriented Licensing Engineer to join our Regulatory team in Columbia, South Carolina. This... 
    Fleet
    Work at office
    Local area

    Dormont Manufacturing Company

    New York, NY
    15 hours ago
  • $175k - $200k

     ...Forward Deployed Engineer Location: New York Who We Are Founded in New York and backed...  ...alerts, remediate CVEs, automate fleet-wide upgrades, and close infrastructure tickets...  ..., and shared success. Help build and scale the forward deployment and customer... 
    Fleet

    Plural

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff GPU Performance Engineer: Lead Fleet-Scale ML Optimizations. Be the first to apply!