Senior GPU-Scale Distributed Systems Engineer
Institute of Foundation Models
Institute of Foundation Models in Sunnyvale, CA seeks a deeply technical engineer to co-design and optimize the communication stack for large-scale distributed training, including hybrid parallelism and Mixture-of-Experts workloads. This role emphasizes performance engineering, distributed debugging, and cross-layer optimization. You will tackle expert-parallel and hybrid-parallel communication patterns, DNS hierarchical collectives for MoE workloads, and resilient orchestration across #J-18808-Ljbffr Institute of Foundation Models
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior GPU-Scale Distributed Systems Engineer in Sunnyvale, CA vacancy
$200k - $400k
...Models (IFM) designs and operates ultra-scale GPU supercomputing systems to train next-generation foundation... ...driving communication performance, distributed reliability, and cross-layer... ...are looking for a deeply technical engineer to co-design and optimize the communication...SeniorVisa sponsorshipInstitute of Foundation Models
Sunnyvale, CA3 days ago$152k - $241.5k
...hiring experienced software engineers with Kubernetes experience to help scale up its AI Infrastructure... ...and working with GPU resource scheduling. We... ...responsible for production systems that enable large scalable... ...automating large-scale distributed systems independent of cloud...SeniorFull timeNvidia
Santa Clara, CA2 days ago- LinkedIn is seeking a Staff AI Software Engineer to own production ML systems scaling to billions of members. You will design, train, and deploy models powering... ...and classifications, driving experiments and GPU fleet management at scale. The role is a lead IC with cross...Senior
$248k - $391k
...computing. An era in which our GPU acts as the brains of... ...team in Santa Clara to lead engineers building rack-scale infrastructure software that... ..., lifecycle orchestration, system health, and recovery capabilities... ...background in Linux, distributed systems, application programming...SeniorFull timeNvidia
Santa Clara, CA3 days ago- Apple Inc. is seeking senior software engineers to join the Observability team within the Apple Services Engineering (ASE). You will design and build fault-tolerant, high-performance distributed systems that scale globally and remain highly available to support Apple’s...SeniorWorldwide
- NVIDIA is seeking an exceptional Senior System Software Engineer to join our GPU System Software team in Santa Clara. You will oversee the lifecycle of GPU feature development, from concept to production, focusing on display features and energy efficiency for consumer products...Senior
$184k - $287.5k
...next era of computing. An era in which our GPU acts as the brains of computers, robots,... ...Collaborate with Hardware, Software, and System Architecture teams to define end-to-end... ...higher degree in Computer Science or Computer Engineering or equivalent experience8+ years of...SeniorFull timeNvidia
Santa Clara, CA13 hours ago- Cerebras Systems builds the world's largest AI chip, 56 times... ...over 10 times faster than GPU-based hyperscale cloud... ...to deploy 750 megawatts of scale, transforming key workloads... ...inference.Cerebras is seeking a Distributed Systems Security Engineer to help build out the next...
Cerebras Systems
Sunnyvale, CA1 day ago - Senior / Staff Backend Engineer - Distributed Systems & Network Automation About Netris Netris is the leading network automation... ..., enabling operators to launch GPU clouds in weeks, provision tenants... ...distributed systems for high‑scale infrastructure environments Improve...SeniorRemote workFlexible hours
$160k - $253k
...accelerated computing is the engine of artificial intelligence.... ...ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer... ...in showcasing NVIDIA's GPU architecture, server-level... ...NVIDIA’s GPU and rack-scale systems. This role bridges architecture...SeniorFull timeNvidia
Santa Clara, CA13 hours ago$119.8k - $234.7k
...Hardware, and Infrastructure Engineering (SCHIE) is the team behind... ...mission. Microsoft's Hardware Systems organization is developing... ...networking technologies, large-scale distributed infrastructure, and cloud-... ...Qualifications:Experience with GPU, FPGA, TPU, or custom AI...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per weekMicrosoft
Mountain View, CA1 day ago- Google's software engineers develop the next-generation technologies that change how billions of users connect, explore... ...who bring fresh ideas across information retrieval, distributed computing, large-scale system design, networking and data storage, security, AI, NLP...Senior
- Google LLC in Sunnyvale, CA is seeking a Senior Software Engineer, Infrastructure, Spanner to design and optimize distributed storage systems at scale. You will work on core Spanner features, collaborating with product teams to deliver high-availability solutions for global...Senior
$262k - $364k
...impact projects.Influence and coach a distributed team of engineers.Facilitate alignment and clarity... ...deploy, maintain, and enhance large-scale software solutions.Minimum qualifications... ...experience working with embedded operating systems.5 years of experience with design and...SeniorWorldwideGoogle
Sunnyvale, CA1 day ago$168k - $258.75k
...scientists, researchers and engineers can advance their... ...We are looking for a Senior Hardware System Validation Engineer... ...of all Data Center Scale infrastructure components... ....Validation of distributed Storage systems (e.g.... ...crowd:Experience with GPU server architecture and...SeniorFull timeNvidia
Santa Clara, CA13 hours ago- General Motors is seeking a Senior Engineer for Embodied AI Scaling Foundations to measure and visualize AV model performance at scale. You will design and iterate evaluation tools across the stack, collaborating with modeling and data teams to connect signals to data,...Senior
$168k - $264.5k
...of architecture, silicon, systems, and manufacturing where first... ...-principles thinking and engineering judgement at the highest... ...into product outcomes at scale. Our team gets every GPU, SoC, and CPU silicon program... .... We are hiring a Senior System Level Testability Engineer...SeniorFull timeNvidia
Santa Clara, CA2 days ago$168k - $264.5k
...you passionate about DGX systems connecting multiple... ...for hardworking systems engineers who will craft FPGA prototypes... ...are now looking for a Senior Systems Prototyping and... ..., USB, CHI, and CPU-GPU coherency.Hands-on... ...methodologies for large-scale emulation environments,...SeniorFull timeNvidia
Santa Clara, CA1 day ago$184k - $287.5k
...next era of computing. An era in which our GPU acts as the brains of computers, robots, and... ...the world.We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned...SeniorFull timeRemote workNvidia
Santa Clara, CA13 hours ago- Google LLC in Mountain View, CA seeks software engineers to develop next-generation technologies that impact billions... ...work on projects spanning information retrieval, distributed computing, and large-scale systems, with opportunities to switch teams as our fast-paced...Senior
$300 per month
...urgency, who believe in the scale of our ambition and thrive... ...Role: We are seeking a Senior Hardware Systems Engineer to strengthen Crusoe’s Hardware... ...across Crusoe Cloud’s GPU- and CPU-based... ...Hands-on experience with distributed training and/or inference...SeniorFull timeTemporary workCrusoe
Sunnyvale, CA20 days ago$184k - $287.5k
...boundaries of innovation and engineering? At NVIDIA, we lead... ...and high‑performance systems.As a Senior Hardware Systems... ...foundation for large‑scale AI. We are committed... ...links, backplanes, power distribution, and cluster‑level... ...such as LPU, GPU, TPU, or custom accelerators...SeniorFull timeNvidia
Santa Clara, CA13 hours ago$224k - $356.5k
...GPUs, CPUs, networking, systems, and software to solve... .... We are looking for a Senior System Software Engineer to join NVIDIA’s GPU Performance and Power Management... ...voltage and frequency scaling (DVFS) and power-... ...with geographically distributed architecture, ASIC, firmware...SeniorFull timeRemote workNvidia
Santa Clara, CA13 hours ago- ..., gaming and embedded systems. Grounded in a culture... ...work across kernels, distributed training, and framework... ...passionate about software engineering and the craft of... ...steps.Optimize multi‑GPU/multi‑node training and... ...RL‑based training at scale.Strong PyTorch experience...Senior
AMD
San Jose, CA2 days ago $184k - $287.5k
...together GPUs, CPUs, networking, systems, and software to solve... ...for a System Software Engineer to join NVIDIA’s GPU Performance and Power Management... ...voltage and frequency scaling (DVFS) and power-... ....Partner effectively with distributed teams across architecture,...SeniorFull timeNvidia
Santa Clara, CA13 hours ago- ...Position Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge... ...ensuring line-rate throughput for distributed AI training. Build and manage automated... ...of operating, debugging, and scaling bare-metal systems in large-scale...SeniorRemote jobFull timeLocal area
- Nokia in Sunnyvale, CA is seeking a Senior Software Engineer to drive Go-based distributed systems and edge compute platforms. You will design scalable microservices, leverage Kubernetes internals for deployment and resource management, and mentor teammates in a fast-paced...Senior
- ..., CA is seeking a seasoned software engineer to design workflow definitions, dependency... ...validate end-to-end scenarios. A background in distributed systems or ML infrastructure is preferred. NVIDIA offers equity, benefits, and a path to impact at scale. #J-18808-Ljbffr NVIDIASenior
$272k - $431.25k
...looking for a Principal Software Engineer to join our CSP Engagements... ...focal point for rack-scale system SW/FW, working with CSP engineering... ...a whole — fabric management, GPU/NVSwitch error handling and recovery... ...firmware, or large-scale distributed systems engineering. BS or MS...Full timeRemote workShift workNvidia
Santa Clara, CA2 days ago$136k - $218.5k
...An era in which our GPU acts as the brains of... ...NVIDIA is seeking a Senior ASIC Compose... ...Infrastructure and Tools Engineer to advance the systems that qualify, integrate... ...that keep large-scale ASIC development moving... ...scalability across distributed compute environments...SeniorFull timeNvidia
Santa Clara, CA13 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU-Scale Distributed Systems Engineer. Be the first to apply!
Related searches
- adas systems engineer Sunnyvale, CA
- system performance engineer Sunnyvale, CA
- senior linux systems engineer Sunnyvale, CA
- software system engineer Sunnyvale, CA
- ground systems engineer Sunnyvale, CA
- advanced systems engineer Sunnyvale, CA
- computer system validation engineer Sunnyvale, CA
- operations support system engineer Sunnyvale, CA
- sr systems engineer Sunnyvale, CA
- healthcare systems engineer Sunnyvale, CA