Senior GPU-Scale Distributed Systems Engineer
Institute of Foundation Models
Institute of Foundation Models in Sunnyvale, CA seeks a deeply technical engineer to co-design and optimize the communication stack for large-scale distributed training, including hybrid parallelism and Mixture-of-Experts workloads. This role emphasizes performance engineering, distributed debugging, and cross-layer optimization. You will tackle expert-parallel and hybrid-parallel communication patterns, DNS hierarchical collectives for MoE workloads, and resilient orchestration across
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior GPU-Scale Distributed Systems Engineer in Sunnyvale, CA vacancy
$200k - $400k
...Models (IFM) designs and operates ultra-scale GPU supercomputing systems to train next-generation foundation... ...driving communication performance, distributed reliability, and cross-layer... ...are looking for a deeply technical engineer to co-design and optimize the communication...SeniorVisa sponsorshipInstitute of Foundation Models
Sunnyvale, CA4 days ago$152k - $241.5k
...hiring experienced software engineers with kubernetes experience to help scale up its AI Infrastructure... ...and working with GPU resource scheduling. We... ...responsible for production systems that enable large scalable... ...automating large-scale distributed systems independent of cloud...SeniorFull timeNvidia
Santa Clara, CA4 days ago- ...Position Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge... ...ensuring line-rate throughput for distributed AI training. Build and manage automated... ...of operating, debugging, and scaling bare-metal systems in large-scale...SeniorFull timeLocal area
Bitdeer
San Jose, CA21 days ago $248k - $391k
...computing. An era in which our GPU acts as the brains of... ...team in Santa Clara to lead engineers building rack-scale infrastructure software that... ..., lifecycle orchestration, system health, and recovery capabilities... ...background in Linux, distributed systems, application programming...SeniorFull timeNvidia
Santa Clara, CA4 days ago$184k - $287.5k
...next era of computing. An era in which our GPU acts as the brains of computers, robots,... ...Collaborate with Hardware, Software, and System Architecture teams to define end-to-end... ...higher degree in Computer Science or Computer Engineering or equivalent experience8+ years of...SeniorFull timeNvidia
Santa Clara, CA1 day ago$160k - $253k
...accelerated computing is the engine of artificial intelligence.... ...ecosystem to power AI at scale. We are looking for a Senior Technical Marketing Engineer... ...in showcasing NVIDIA's GPU architecture, server-level... ...NVIDIA’s GPU and rack-scale systems. This role bridges architecture...SeniorFull timeNvidia
Santa Clara, CA1 day ago- Cerebras Systems builds the world's largest AI chip, 56 times... ...over 10 times faster than GPU-based hyperscale cloud... ...to deploy 750 megawatts of scale, transforming key workloads... ...inference.Cerebras is seeking a Distributed Systems Security Engineer to help build out the next...
Cerebras Systems
Sunnyvale, CA2 days ago $119.8k - $234.7k
...Hardware, and Infrastructure Engineering (SCHIE) is the team behind... ...mission. Microsoft's Hardware Systems organization is developing... ...networking technologies, large-scale distributed infrastructure, and cloud-... ...Qualifications:Experience with GPU, FPGA, TPU, or custom AI...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per weekMicrosoft
Mountain View, CA2 days ago$262k - $364k
...impact projects.Influence and coach a distributed team of engineers.Facilitate alignment and clarity... ...deploy, maintain, and enhance large-scale software solutions.Minimum qualifications... ...experience working with embedded operating systems.5 years of experience with design and...SeniorWorldwideGoogle
Sunnyvale, CA2 days ago$168k - $258.75k
...scientists, researchers and engineers can advance their... ...We are looking for a Senior Hardware System Validation Engineer... ...of all Data Center Scale infrastructure components... ....Validation of distributed Storage systems (e.g.... ...crowd:Experience with GPU server architecture and...SeniorFull timeNvidia
Santa Clara, CA1 day ago$168k - $264.5k
...you passionate about DGX systems connecting multiple... ...for hardworking systems engineers who will craft FPGA prototypes... ...are now looking for a Senior Systems Prototyping and... ..., USB, CHI, and CPU-GPU coherency.Hands-on... ...methodologies for large-scale emulation environments,...SeniorFull timeNvidia
Santa Clara, CA2 days ago$168k - $264.5k
...of architecture, silicon, systems, and manufacturing where first... ...-principles thinking and engineering judgement at the highest... ...into product outcomes at scale. Our team gets every GPU, SoC, and CPU silicon program... .... We are hiring a Senior System Level Testability Engineer...SeniorFull timeNvidia
Santa Clara, CA3 days ago$184k - $287.5k
...next era of computing. An era in which our GPU acts as the brains of computers, robots, and... ...the world.We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned...SeniorFull timeRemote workNvidia
Santa Clara, CA1 day ago$184k - $287.5k
...boundaries of innovation and engineering? At NVIDIA, we lead... ...and high‑performance systems.As a Senior Hardware Systems... ...foundation for large‑scale AI. We are committed... ...links, backplanes, power distribution, and cluster‑level... ...such as LPU, GPU, TPU, or custom accelerators...SeniorFull timeNvidia
Santa Clara, CA1 day ago$224k - $356.5k
...GPUs, CPUs, networking, systems, and software to solve... .... We are looking for a Senior System Software Engineer to join NVIDIA’s GPU Performance and Power Management... ...voltage and frequency scaling (DVFS) and power-... ...with geographically distributed architecture, ASIC, firmware...SeniorFull timeRemote workNvidia
Santa Clara, CA1 day ago- ..., gaming and embedded systems. Grounded in a culture... ...work across kernels, distributed training, and framework... ...passionate about software engineering and the craft of... ...steps.Optimize multi‑GPU/multi‑node training and... ...RL‑based training at scale.Strong PyTorch experience...Senior
AMD
San Jose, CA3 days ago $184k - $287.5k
...together GPUs, CPUs, networking, systems, and software to solve... ...for a System Software Engineer to join NVIDIA’s GPU Performance and Power Management... ...voltage and frequency scaling (DVFS) and power-... ....Partner effectively with distributed teams across architecture,...SeniorFull timeNvidia
Santa Clara, CA1 day ago$272k - $431.25k
...looking for a Principal Software Engineer to join our CSP Engagements... ...focal point for rack-scale system SW/FW, working with CSP engineering... ...a whole — fabric management, GPU/NVSwitch error handling and recovery... ...firmware, or large-scale distributed systems engineering. BS or MS...Full timeRemote workShift workNvidia
Santa Clara, CA3 days ago$136k - $218.5k
...An era in which our GPU acts as the brains of... ...NVIDIA is seeking a Senior ASIC Compose... ...Infrastructure and Tools Engineer to advance the systems that qualify, integrate... ...that keep large-scale ASIC development moving... ...scalability across distributed compute environments...SeniorFull timeNvidia
Santa Clara, CA1 day ago$272k - $431.25k
...computing. An era in which our GPU acts as the brains of... ...NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide... ...environments.Mentor senior engineers and technical leads... ...architecture, system software, distributed systems, infrastructure...Full timeRemote workShift workNvidia
Santa Clara, CA1 day ago$180.2k - $297.2k
...custom market segments) consumed by millions of people around the world. Come build with us!Role and ResponsibilitiesAs a Staff GPU System Engineer, you will lead pre-silicon workload enablement, design and build verification infrastructure and automation framework for...SeniorHourly payFull timeRelocationSamsung Semiconductor
San Jose, CA22 hours ago$135k - $145k
...How You Will Impact SkyloWe are seeking a highly skilled System Test Engineer to design and execute quality assurance strategies for Skylo... ...validation engineering or acceptance testing for large-scale, distributed, or telecommunications systems.Strong understanding of 3...SeniorWork at officeLocal areaRemote workWorldwide3 days per weekSkylo
Mountain View, CA1 day ago- ...INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote... ...Hitachi Energy as an Energy Systems Integration Engineer and help... ...how energy is managed, distributed, and optimized. This is your... ..., and maintain large-scale Linux-based EMMS environmentsAutomate...SeniorFull time
Hitachi
Santa Clara, CA1 day ago $332k
...computing. An era in which our GPU acts as the brains of... .... Director of Board and System Level Reliability, you will set the engineering standard for how NVIDIA'... ..., lead globally distributed teams and labs, and influence... ...chain decisions at scale. This is a role for a deeply...SeniorFull timeWork at officeNvidia
Santa Clara, CA1 day ago$184k - $287.5k
...computing. An era in which our GPU serves as the intelligence... ...be doing:Develop use cases and system requirements for L3 and L4 autonomous... ...with Data Analytics, Test Engineering, and System Integration & Test... ...-on experience with large-scale datasets, data science, and analytics...SeniorFull timeNvidia
Santa Clara, CA1 day ago$168k - $270.25k
...Experience (NVEX) Solutions Engineering team is looking for an... ...support of NVIDIA’s GPU accelerated platforms... ...datacenters of rack-scale platforms, solve... ...analyzing performance of distributed GPU-accelerated workloads... ...-GPU platformsStrong system software (firmware, BIOS...SeniorFull timeWeekend workNvidia
Santa Clara, CA1 day ago$119.8k - $234.7k
...Intelligence (AI) Infrastructure Engineering Systems team at Microsoft... ...AI services at scale. You will help create... ...solutions.Role Summary As a Senior or Principal Software... ...improve large-scale distributed systems, drive... ...such as model inference, GPU computing, model serving...SeniorOngoing contractLocal area3 days per weekMicrosoft
Mountain View, CA3 days ago$184k - $287.5k
...of CUDA and Deep Learning Systems. As the complexity and scale of artificial... ...architectures, massive-scale distributed computing, and low-level... ...computing systems from a single GPU to supercomputer clusters... ...Computer Science, Computer Engineering, Electrical Engineering,...SeniorFull timeNvidia
Santa Clara, CA3 days ago$131k - $175k
...prestigious awards, such as Best Engineering Team, Best Company for... ...You’ll Work With As a Senior Rack Solution Engineer... ..., to deliver rack-scale solutions for the world... ..., into high-density GPU environments, ensuring... ...rack layouts and cabling systems, including fiber/copper...SeniorRemote workFlexible hoursArista Networks
Santa Clara, CA3 days ago- ...high quality agentic search systems, addressing tail latency, throughput... ...fragmented systems, mentor senior engineers, and align technical and... ...and operating large-scale, low-latency search, recommendation... ..., and operations.Strong distributed-systems expertise across performance...SeniorWork at officeLocal area
Atlassian
Mountain View, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU-Scale Distributed Systems Engineer. Be the first to apply!
Related searches
- adas systems engineer Sunnyvale, CA
- system performance engineer Sunnyvale, CA
- senior linux systems engineer Sunnyvale, CA
- software system engineer Sunnyvale, CA
- ground systems engineer Sunnyvale, CA
- advanced systems engineer Sunnyvale, CA
- computer system validation engineer Sunnyvale, CA
- operations support system engineer Sunnyvale, CA
- sr systems engineer Sunnyvale, CA
- healthcare systems engineer Sunnyvale, CA