Staff AI Inference Systems Engineer
CoreWeave
CoreWeave is seeking a Staff Software Engineer (IC5) on the Inference team in Sunnyvale, CA to lead architecture and performance across services. You will optimize latency, throughput, and GPU utilization while guiding cross-team design and reliability at scale. You’ll work with distributed systems, Kubernetes infrastructure, and inference workloads, driving memory optimization and batching strategies. A strong background in Go, Python, or C++ is expected. #J-18808-Ljbffr CoreWeave
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture... ...-leading training and inference speeds; over 10 times... ....About the RoleAs a Staff GPU Inference SDET, you will... ...team. Working closely with engineering leads and cross-...Suggested
- ...healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation... ...advance your career. THE ROLE: We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind AI-for-...Suggested
$224k - $356.5k
...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep... ...the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification...Suggested- CoreWeave is seeking a Staff Software Engineer (IC5) on the Inference team to lead architecture, performance, and reliability across services. You will drive cross-team design initiatives and optimize latency, throughput, and GPU utilization in a Kubernetes-based infrastructure...Suggested
$162k - $243k
...Technologies, Inc. Job Area: Engineering Group, Engineering Group... ...ecosystem for large-scale LLM inference on Qualcomm platforms. In this... ...of open-source LLM serving systems, distributed systems, cloud-native infrastructure, and AI accelerator software. You will...SuggestedWork experience placementWork from home$150.98k - $218.62k
...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into... ...Possible. Learn more at and on LinkedIn and X.Staff System Architecture and Design EngineerData... ...)San Jose, CAAbout the RoleAs a System Engineer, you will own the system development of...Permanent employmentFull timeWork at officeShift workDay shift$186.9k - $275k
...Across enterprise, cloud and AI, and carrier architectures, our... ...on paper, they buy validated systems.Day to day, the team runs AI... ...is breadth of ownership: engineers here aren't limited to validating... ...spans both training and inference stacks. • Strong Python and Linux...Permanent employmentInternshipWork from home$224k - $356.5k
...tapping into the unlimited potential of AI to define the next era of computing... ...in the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of agentic... ...challenges across agent runtimes, inference, evaluation, and large-scale execution...Full timeRemote work$148k - $270k
...mission to revolutionize AI infrastructure by... ...the complexities of AI systems, we’re empowering everyone... ...models. State-of-the-art inference is a fast moving target... ...Altos, CA. More senior staff can work out of our... ...hard way why defensive engineering is worth the extra investment...Work experience placementWork at officeLocal areaRemote workVisa sponsorshipFlexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras... ...industry-leading training and inference speeds; over 10 times faster than GPU... ...a Distributed Systems Security Engineer to help build out the next generation...
$106k - $205k
Title: Staff System Engineers Engineer, AI/MLAbout GlobalFoundries:GlobalFoundries is a leading full-service semiconductor foundry providing a unique... ...AI/ML acceleration on edge devices — NPUs, dedicated inference accelerators, DSP-based pipelines — and understand the HW...Full timeWork at officeLocal area- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras... ...industry-leading training and inference speeds; over 10 times faster than GPU... ...visible role working directly with Engineering, Product, Infrastructure, SRE,...Remote work
$180k - $200k
...supported by a talented team of over 100 engineers spread across four global R&D... ...Radio solutions, and we're looking for a Staff DSP Algorithm Systems Design Engineer to own end-to-end system... ...conformance testing Familiarity with AI-assisted test data analysis and ML-...Full timeWork at office$207k - $300k
...impact projects.Collaborate closely with hardware, software, and system engineering teams to drive pre-silicon Firmware (FW)/Software (SW) co-... ...currently need-to-know products shaping our future solutions.The AI and Infrastructure team is redefining what’s possible. We...Worldwide$150.4k - $277.6k
...California, United States Machine Learning and AI The incredible potential of... ...motivated and skilled Machine Learning Systems Engineer to help us ship cutting-edge computer vision... ...across Apple devices. Optimize on-device inference latency, memory footprint, and...Relocation- ...is building the Modular platform to simplify AI model deployment and developer experience. The role focuses on unifying inference features into robust, distributed... ...Altos office, or remote options for senior staff. Competitive compensation and strong benefits...Remote jobWork at office
$272k - $431.25k
...We are seeking software engineers to work on next-generation high-speed interconnect technologies... ..., algorithms, a solid foundation of systems software with emphasis on OS fundamentals... ...interpersonal skills. ~ Capability to use AI prompt tools. Your base salary will...- ...mission, we're investing deeply in Generative AI — pioneering advanced modeling and rapid... ...re seeking a Principal Machine Learning Systems Engineer (P60) to lead technical directions of... ...with large-scale model training, inference pipelines, or search/retrieval systems.ð...Work at officeLocal area
- ...technologies—like the da Vinci surgical system and Ion—have transformed how... ...worldwide.We’re a team of engineers, clinicians, and innovators... ...to explore and build embodied AI applications at the... ...foundational models to real-time onboard inference—while serving as a core...Local areaWorldwideFlexible hours
$175k - $275k
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture... ...-leading training and inference speeds; over 10 times... ...-speed inference.Senior Staff AI Accelerator... ....MS or PhD in Electrical Engineering, Computer Engineering, Computer...$177.54k - $295.9k
...Responsibilities The Solution Engineer is a core contributor within... ...hands-on knowledge of test systems and networking protocols, along... ...including the emerging demands of AI/ML data center networking. The... ...GPU cluster training and inference workloads. Tailoring solutions...Work experience placementFree visaShift work$210k - $240k
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows... ...industry-leading training and inference speeds; over 10 times faster than... ...seeking an exceptional Senior Staff Electrical Engineer to drive our system hardware development...- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras... ...industry-leading training and inference speeds; over 10 times faster than GPU... ...a Distributed Systems Security Engineer to help build out the next generation...
$185k - $215k
...Job Description In this role, you will operate as a Staff AI Systems Engineer, setting technical direction across multiple teams, influencing... ...detection, statistical pattern recognition, and causal inference) to automatically isolate failure modes across perception,...Work experience placementLocal areaWorldwide$207k - $300k
...Staff Software Engineer, Server System Software, Platforms Infrastructure Share Staff Software Engineer, Server System Software, Platforms Infrastructure... ...many partner teams within and outside of PIE. The AI and Infrastructure team is redefining what's possible. We...Worldwide- ...data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and... ...decisions, lead performance optimizations, and own the inference engine to scale research and production workloads....
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture... ...-leading training and inference speeds; over 10 times... ...are looking for a Staff Business Systems Analyst... ...leaders, BIS Architecture, Engineering, Data, Production Support...
- Staff Technologist-AI ArchitectInfrastructure Solutions Group (ISG) builds the... ...how work gets done. Engineers define intent, author precise... ...energized by solving complex systems challenges, excited to work... ...bridging Kubernetes, low-latency inference runtimes, enterprise data...
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras... ...industry-leading training and inference speeds; over 10 times faster than GPU... ...RoleWe are looking for a hands-on engineer to deploy, automate, troubleshoot,...
$272k - $336k
...Senior Staff Regulatory and Compliance Systems Engineer Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo...Odd jobFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff AI Inference Systems Engineer. Be the first to apply!
- staff security engineer Sunnyvale, CA
- staff engineer Sunnyvale, CA
- assistant electrical engineer Sunnyvale, CA
- senior staff systems engineer Sunnyvale, CA
- engineering aide Sunnyvale, CA
- senior staff engineer Sunnyvale, CA
- staff data engineer Sunnyvale, CA
- technology administrator Sunnyvale, CA
- software engineer staff Sunnyvale, CA
- assistant engineer Sunnyvale, CA




