Staff GPU Performance Engineer: Lead Fleet-Scale ML Optimizations
Google Inc.
Google Inc. is seeking a Staff Software Engineer focused on GPU Performance in New York, NY. The ideal candidate will have deep expertise in software development and experience with modern GPU architectures. Responsibilities include maintaining benchmarks for LLM training and collaborating with teams like DeepMind to enhance model performance. The role offers a competitive salary, equity, and extensive benefits, including 20 vacation days per year, health, and a retirement plan. #J-18808-Ljbffr Google Inc.
- ...skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement... ...demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron....Suggested
$174k - $253k
...searching for experienced Software Engineers to develop optimizations for the latest generation of GPUs, crucial... ..., alongside expertise in modern GPU architectures and low-level GPU... ...programming. This role involves addressing performance bottlenecks and influencing GPU...Suggested$207k - $301k
Staff Software Engineer, GPU Performance Advanced Experience owning outcomes... ...solve challenging ML model performance... ...solutions at Google fleet‑wide scale. Run performance... ...technical leadership role leading project teams and... ...with compiler optimization, code generation,...FleetTemporary workWorldwide$166k - $244k
Senior Software Engineer, GPU Performance Apply X Note: By... ...Experience with compiler optimization, code generation,... ...at massive scale, and extend well... ...performance for our ML models, adapting... ...future of world-leading hyperscale... ...of Google’s GPU fleet by working with various...FleetFull timeWorldwide$125k - $200k
...accurate insights at any scale, cost-effectively.... ..., automotive and fleet telematics... ...sellers, presales engineers, customers, and community... ...interoperability, GPU/NVIDIA acceleration... ...using attributes, and optimizing data storage/... ...Data Driven: We lead with instinct and follow...Fleet- ...greenest municipal vehicle fleet in the country. Leading the City’s efforts to reduce... ...best practices. The Senior Engineer will work within the DEM’s Building Optimization Team (BOT), under the guidance... ...and centrally at DEM. Performance management - Monitor, report...FleetFull timeApprenticeshipLocal area
- ...greenest municipal vehicle fleet in the country. - Leading the City's efforts to reduce... ...practices. The Senior Engineer will work within the DEM’s Building Optimization Team (BOT), under the guidance... ...centrally at DEM. 3. Performance management | Monitor, report...FleetFull timeApprenticeshipLocal area
$152k - $228k
...Nebius Nebius is leading a new era in... ...in-house AI/ML teams. Our employees... ...leaders and engineers in the field.... ...building a high-performance AI inference platform... ...workloads at scale. In AI... ...latency constraints, GPU economics, and... ...and required optimization depth ~ Align...Temporary workImmediate startRemote workFlexible hours- ...greenest municipal vehicle fleet in the country. - Leading the City's efforts to... ..., technical expertise, staff resources, strategic... ...analytics. The Associate Engineer, Building Optimization will work within DEM’s... ...optimization and (3) performing project inspections....FleetPermanent employmentFull timeFor contractors
- Obsidian is seeking an MLOps Engineer to join their AI lab's cutting-edge GenAI team in New York. This full... ...candidate should have 2+ years of experience in ML infrastructure, with skills in custom GPU kernel optimization. This position offers a chance to be at the forefront...Full time
$178.97k - $268.46k
...establishing a culture of engineering performance, scalability, and financial optimization through the strategic adoption... ...building foundational AI/ML models. Responsibilities Lead the identification, prioritization... ...with Aerospike and large‑scale distributed data platforms....Work experience placement$135k - $165k
...based planning and optimization software deployed... ...our RL and platform engineers to translate... ...simulation, or applied ML. Lean / Six... ...operation is really performing, the answer comes... ...job is to keep the fleet moving — the consequences... ...logistics at the scale of a military...FleetLive inVisa sponsorship$83k - $110k
...innovators to build and scale AI with... .... Trusted by leading AI labs, startups... ...infrastructure performance with deep... ...You'll Do: The Fleet Reliability Operations... ...of committed engineers working to... ...flexibility and optimism anticipating shifting... ...administering GPU-related...FleetPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$125k - $155k
...Partnering with Machine Learning Engineers, Data Scientists, and... ...for deploying, operating, scaling, monitoring, and governing ML workloads so they run... ...processing. ~ Own GPU and CPU infrastructure selection, scaling, and optimization, including instance benchmarking...$175k - $300k
...Fluidstack Production Engineering Team Examples of key exciting problems... ...device and link. At 10 GW scale, you cannot operate what you cannot... ...match reality: integrate fleet state as a machine-readable source... ..., so every new site and GPU generation lands cleanly from...FleetLocal area$165k - $242k
...Systems Kernel Engineer Livingston, NJ / New... ...innovators to build and scale AI with confidence. Trusted by leading AI labs, startups,... ...infrastructure performance with deep technical... ...storage, virtualization, GPU/DPU enablement).... ...with HPC and Fleet teams to ensure kernel...FleetPermanent employmentTemporary workCasual workWork at officeFlexible hours- A growing e-commerce jewelry brand is seeking a Senior Performance Marketing Manager to optimize and scale their paid media strategy. This role involves hands-on campaign management across platforms like Meta and Google, alongside analytics to track performance. Ideal candidates...Remote work
$300 per month
...for hours at a time, performing end-to-end work for some... ...advanced applied ML at production scale. Our investors include... ...Prashant Mital, Applied AI Lead, OpenAI Location: NYC... ...looking for a Growth Engineer to own our go-to-... ...: Stand up and optimize paid channels (search...Work at office$123k - $165k
...Site Reliability Engineer II Req ID: 10... ...Our engineering fleet is a horizontal set... ...to come. Reach, Scale & Impact: More than... ...drives improvements in performance, resiliency, and... ..., and performance optimization. This role... ...Understanding foundational AI/ML concepts,...FleetFull time- ...company is looking for exceptional generalist engineers who thrive with autonomy. This fully... ...impact projects across the vLLM stack, from optimizing CUDA kernels to designing distributed... ...strong track record in systems programming or ML infrastructure. Competitive compensation...Remote job
- Goldman Sachs Group, Inc. is seeking a Machine Learning Engineer, Vice President in New York. The role involves developing and deploying... ...models in a dynamic environment and working with large-scale data. Candidates should have substantial experience in machine...
$131.25k - $153.75k
...Senior Value Engineer - Banking New York, US, New York... ...Client Onboarding to optimizing Capital Markets... ...solutions using the world's leading Process Intelligence (PI... ...combination with top AI and ML technology partners. By... ...Banking value chain, scaling knowledge across the...Full timeWork at officeLocal areaImmediate startRemote workWorldwideFlexible hoursShift work$131k - $154k
...Description As a Senior Value Engineer specializing in CPG,... ...Store Delivery (DSD) optimization and dynamic logistics... ...solutions using the world’s leading Process Intelligence (... ...with top AI and ML technology partners such... ...tangible ROI from AI at scale by shifting from rule‑based...Shift work$75k - $125k
...investment. Backed by leading investors... ...America, Formic is scaling rapidly and building... ...new era of high-performance, Made in America... ...About the team: The Fleet Operations Team... ...of automation engineering and real-world factory... ...for: Fearless Optimism: You make bold bets...FleetFull timeTemporary workLocal areaRemote workHome officeFlexible hoursShift workNight shift- ...patient calls while staff drowns in administrative... ...an ex-Amazon Alexa engineer who led AI/ML teams at Salesforce,... ...teams to deploy and optimize AI agents in live healthcare... ...to ensure seamless performance. Drive customer... ...sensitive patient data. Scale personalization :...Work at officeFlexible hours
$200k
...Overview Manager / Lead Tech Recruiter – AI & ML | U.S. Market From London | Ex-France... ...hiring a Machine Learning Engineer with deep expertise in... ...prompt conditioning, etc.) Optimize inference pipelines for low... ...Experience deploying ML models at scale (Docker, Kubernetes, cloud...Full timeVisa sponsorship- ...Fleetline writes optimization algorithms for large trucking companies; after a recent spike in contracted... ...the team and looking for founding engineers. A bit about us Booked out for the next 5 months by enterprise trucking fleets. Lean, welcoming, and dedicated founding team...Fleet
$315k
...committed researchers, engineers, policy experts,... ...innovations in GPU performance and systems engineering... ...at unprecedented scale, developing cutting-edge optimizations that directly enable... ...improvements in production ML systems and will be... ..., we expect all staff to be in one of our...Work at officeVisa sponsorshipFlexible hours$120k - $140k
...in the nuclear and energy space creating a never before seen fleet-scale approach to building nuclear reactors. Through its design-once... ...Company is seeking a highly motivated and detail-oriented Licensing Engineer to join our Regulatory team in Columbia, South Carolina. This...FleetWork at officeLocal area$175k - $200k
...Forward Deployed Engineer Location: New York Who We Are Founded in New York and backed... ...alerts, remediate CVEs, automate fleet-wide upgrades, and close infrastructure tickets... ..., and shared success. Help build and scale the forward deployment and customer...Fleet
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff GPU Performance Engineer: Lead Fleet-Scale ML Optimizations. Be the first to apply!
- assistant chief engineer New York, NY
- technology administrator New York, NY
- project engineer assistant project manager New York, NY
- staff security engineer New York, NY
- engineering aide New York, NY
- senior staff systems engineer New York, NY
- staff design engineer New York, NY
- research assistant engineering New York, NY
- staff data engineer New York, NY
- assistant engineering manager New York, NY


