Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff AI Inference Systems Engineer

CoreWeave

CoreWeave is seeking a Staff Software Engineer (IC5) on the Inference team in Sunnyvale, CA to lead architecture and performance across services. You will optimize latency, throughput, and GPU utilization while guiding cross-team design and reliability at scale. You’ll work with distributed systems, Kubernetes infrastructure, and inference workloads, driving memory optimization and batching strategies. A strong background in Go, Python, or C++ is expected. #J-18808-Ljbffr CoreWeave

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff AI Inference Systems Engineer in Sunnyvale, CA vacancy
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture...  ...-leading training and inference speeds; over 10 times...  ....About the RoleAs a Staff GPU Inference SDET, you will...  ...team. Working closely with engineering leads and cross-... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation...  ...advance your career. THE ROLE: We are hiring ML Systems Research Engineers to build the reinforcement learning, inference, and evaluation infrastructure behind AI-for-... 
    Suggested

    AMD

    Santa Clara, CA
    3 days ago
  • $224k - $356.5k

     ...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep...  ...the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image classification... 
    Suggested

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • CoreWeave is seeking a Staff Software Engineer (IC5) on the Inference team to lead architecture, performance, and reliability across services. You will drive cross-team design initiatives and optimize latency, throughput, and GPU utilization in a Kubernetes-based infrastructure... 
    Suggested

    CoreWeave Europe

    Sunnyvale, CA
    20 hours ago
  • $162k - $243k

     ...Technologies, Inc. Job Area: Engineering Group, Engineering Group...  ...ecosystem for large-scale LLM inference on Qualcomm platforms. In this...  ...of open-source LLM serving systems, distributed systems, cloud-native infrastructure, and AI accelerator software. You will... 
    Suggested
    Work experience placement
    Work from home

    QUALCOMM, Inc.

    Santa Clara, CA
    1 day ago
  • $150.98k - $218.62k

     ...Intelligent Edge. ADI combines analog, digital, AI, and software technologies into...  ...Possible. Learn more at and on LinkedIn and X.Staff System Architecture and Design EngineerData...  ...)San Jose, CAAbout the RoleAs a System Engineer, you will own the system development of... 
    Permanent employment
    Full time
    Work at office
    Shift work
    Day shift

    Analog Devices

    San Jose, CA
    1 day ago
  • $186.9k - $275k

     ...Across enterprise, cloud and AI, and carrier architectures, our...  ...on paper, they buy validated systems.Day to day, the team runs AI...  ...is breadth of ownership: engineers here aren't limited to validating...  ...spans both training and inference stacks. • Strong Python and Linux... 
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...tapping into the unlimited potential of AI to define the next era of computing...  ...in the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of agentic...  ...challenges across agent runtimes, inference, evaluation, and large-scale execution... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $148k - $270k

     ...mission to revolutionize AI infrastructure by...  ...the complexities of AI systems, we’re empowering everyone...  ...models. State-of-the-art inference is a fast moving target...  ...Altos, CA. More senior staff can work out of our...  ...hard way why defensive engineering is worth the extra investment... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Flexible hours

    Modular Inc

    Los Altos, CA
    3 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras...  ...industry-leading training and inference speeds; over 10 times faster than GPU...  ...a Distributed Systems Security Engineer to help build out the next generation... 

    Cerebras Systems

    Sunnyvale, CA
    6 days ago
  • $106k - $205k

    Title: Staff System Engineers Engineer, AI/MLAbout GlobalFoundries:GlobalFoundries is a leading full-service semiconductor foundry providing a unique...  ...AI/ML acceleration on edge devices — NPUs, dedicated inference accelerators, DSP-based pipelines — and understand the HW... 
    Full time
    Work at office
    Local area

    Globalfoundries

    Santa Clara, CA
    6 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras...  ...industry-leading training and inference speeds; over 10 times faster than GPU...  ...visible role working directly with Engineering, Product, Infrastructure, SRE,... 
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $180k - $200k

     ...supported by a talented team of over 100 engineers spread across four global R&D...  ...Radio solutions, and we're looking for a Staff DSP Algorithm Systems Design Engineer to own end-to-end system...  ...conformance testing Familiarity with AI-assisted test data analysis and ML-... 
    Full time
    Work at office

    GreenWave Radios™

    San Jose, CA
    1 day ago
  • $207k - $300k

     ...impact projects.Collaborate closely with hardware, software, and system engineering teams to drive pre-silicon Firmware (FW)/Software (SW) co-...  ...currently need-to-know products shaping our future solutions.The AI and Infrastructure team is redefining what’s possible. We... 
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $150.4k - $277.6k

     ...California, United States Machine Learning and AI The incredible potential of...  ...motivated and skilled Machine Learning Systems Engineer to help us ship cutting-edge computer vision...  ...across Apple devices. Optimize on-device inference latency, memory footprint, and... 
    Relocation

    Apple Inc.

    Sunnyvale, CA
    1 day ago
  •  ...is building the Modular platform to simplify AI model deployment and developer experience. The role focuses on unifying inference features into robust, distributed...  ...Altos office, or remote options for senior staff. Competitive compensation and strong benefits... 
    Remote job
    Work at office

    Modular Inc

    Los Altos, CA
    3 days ago
  • $272k - $431.25k

     ...We are seeking software engineers to work on next-generation high-speed interconnect technologies...  ..., algorithms, a solid foundation of systems software with emphasis on OS fundamentals...  ...interpersonal skills. ~ Capability to use AI prompt tools. Your base salary will... 

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  •  ...mission, we're investing deeply in Generative AI — pioneering advanced modeling and rapid...  ...re seeking a Principal Machine Learning Systems Engineer (P60) to lead technical directions of...  ...with large-scale model training, inference pipelines, or search/retrieval systems.ð... 
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    3 days ago
  •  ...technologies—like the da Vinci surgical system and Ion—have transformed how...  ...worldwide.We’re a team of engineers, clinicians, and innovators...  ...to explore and build embodied AI applications at the...  ...foundational models to real-time onboard inference—while serving as a core... 
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    3 days ago
  • $175k - $275k

    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture...  ...-leading training and inference speeds; over 10 times...  ...-speed inference.Senior Staff AI Accelerator...  ....MS or PhD in Electrical Engineering, Computer Engineering, Computer... 

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $177.54k - $295.9k

     ...Responsibilities The Solution Engineer is a core contributor within...  ...hands-on knowledge of test systems and networking protocols, along...  ...including the emerging demands of AI/ML data center networking. The...  ...GPU cluster training and inference workloads. Tailoring solutions... 
    Work experience placement
    Free visa
    Shift work

    Keysight Technologies

    Santa Clara, CA
    1 day ago
  • $210k - $240k

    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows...  ...industry-leading training and inference speeds; over 10 times faster than...  ...seeking an exceptional Senior Staff Electrical Engineer to drive our system hardware development... 

    Cerebras

    Sunnyvale, CA
    2 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras...  ...industry-leading training and inference speeds; over 10 times faster than GPU...  ...a Distributed Systems Security Engineer to help build out the next generation... 

    Cerebras

    Sunnyvale, CA
    1 day ago
  • $185k - $215k

     ...Job Description In this role, you will operate as a Staff AI Systems Engineer, setting technical direction across multiple teams, influencing...  ...detection, statistical pattern recognition, and causal inference) to automatically isolate failure modes across perception,... 
    Work experience placement
    Local area
    Worldwide

    Bosch Group

    Sunnyvale, CA
    4 days ago
  • $207k - $300k

     ...Staff Software Engineer, Server System Software, Platforms Infrastructure Share Staff Software Engineer, Server System Software, Platforms Infrastructure...  ...many partner teams within and outside of PIE. The AI and Infrastructure team is redefining what's possible. We... 
    Worldwide

    Google Inc.

    Sunnyvale, CA
    1 day ago
  •  ...data centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and...  ...decisions, lead performance optimizations, and own the inference engine to scale research and production workloads.... 

    Sanas

    Palo Alto, CA
    1 day ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture...  ...-leading training and inference speeds; over 10 times...  ...are looking for a Staff Business Systems Analyst...  ...leaders, BIS Architecture, Engineering, Data, Production Support... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • Staff Technologist-AI ArchitectInfrastructure Solutions Group (ISG) builds the...  ...how work gets done. Engineers define intent, author precise...  ...energized by solving complex systems challenges, excited to work...  ...bridging Kubernetes, low-latency inference runtimes, enterprise data... 

    Dell Technologies

    Santa Clara, CA
    4 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras...  ...industry-leading training and inference speeds; over 10 times faster than GPU...  ...RoleWe are looking for a hands-on engineer to deploy, automate, troubleshoot,... 

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $272k - $336k

     ...Senior Staff Regulatory and Compliance Systems Engineer Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo... 
    Odd job
    Full time
    Remote work

    Waymo

    Mountain View, CA
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff AI Inference Systems Engineer. Be the first to apply!