Senior ML Inference API Engineer
Cerebras
Cerebras Systems is hiring a Software Engineer to build and evolve the ML API layer for a new generation of disaggregated AI inference systems. You will work across inference APIs, model integration, request routing, and Cerebras runtime components to deliver a consistent experience across models and accelerator backends. You will collaborate with model enablement, compiler, runtime, cloud infrastructure, product, and customer teams to turn evolving ML capabilities into durable, #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior ML Inference API Engineer in Sunnyvale, CA vacancy
$162k - $243k
...Technologies, Inc. Job Area: Engineering Group, Engineering Group... ...ecosystem for large-scale LLM inference on Qualcomm platforms. In this... .../Kubernetes infrastructure ML compiler or runtime systems... ...d, KServe, Kubernetes Gateway API, Kubernetes operators, or cloud...SeniorWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA4 days ago- ...NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer for GPU code generation in TensorRT to advance high-performance AI inference on NVIDIA GPUs. You will design and implement advanced GPU code generation techniques and compiler optimizations for diverse...SeniorRemote work
NVIDIA
Santa Clara, CA2 days ago - ...Amazon is seeking a Senior Software Development Engineer to own the design and implementation of the inference data plane for large models on custom hardware. You will build high... ...hardware targets. You will integrate backends into ML serving frameworks, contribute to CI/CD, and...Senior
Amazon
Cupertino, CA4 days ago - ...industry-leading training and inference speeds; over 10 times faster... ...inference.About The TeamThe ML API Quality team is responsible for... ..., ML systems, and product engineering teams to ensure that rapid iteration... ...business.About The RoleAs a Senior Software Engineer in Test for...SeniorWork at officeRemote workShift work3 days per week
Cerebras Systems
Sunnyvale, CA7 days ago - ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-... .... About The Role We’re hiring a Senior Frontend Engineer to own and scale critical parts of the... ...core systems — design and implement APIs, services, and UI that power the Developer...SeniorShift work
Cerebras
Sunnyvale, CA4 days ago - Cerebras Systems is seeking a Software Engineer to productionize and optimize the GPU serving stack, spanning custom inference APIs, the vLLM runtime, ROCm, and rack-scale AMD GPU infrastructure. You will write production code, establish deployment and health-checking...Senior
- ...low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads. This role is in the...Senior
$184.7k - $324.8k
...Senior Software Engineer, Middleware - Special Projects Cupertino, California... ...middleware and distributed inference platforms to large‑scale data... ...closely with hardware, robotics, ML, design, and platform teams... ...Strong understanding of API and framework design for maintainability...SeniorRelocationApple Inc.
Cupertino, CA4 days ago$272k - $431.25k
NVIDIA is the engine of modern AI, and robotics is where AI meets the... ...engineering, and ensuring our APIs and tools meet real workflows.... ..., training, and on-robot inference on Jetson and edge platforms.Deliver... ...computing and modern ML infrastructure, and how to architect...SeniorFull timeNvidia
Santa Clara, CA8 days ago$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...SeniorFull timeNvidia
Santa Clara, CA5 days ago- ...Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated AI inference workloads. You will profile, diagnose, and...Senior
AMD
Santa Clara, CA8 days ago - ...NVIDIA Corporation is seeking talented engineers to join the TensorRT team to advance high-performance AI inference on NVIDIA GPUs. This Senior Software Engineer role focuses on developing GPU inference software, compiler optimizations, and performance improvements for...Senior
NVIDIA
Santa Clara, CA11 hours ago $193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational AI. This is a full-stack inference role: you will work across the entire path a modeltakes from research to production — shaping model architecture so it is servable,...SeniorInternshipLocal areaFlexible hoursAmazon
Sunnyvale, CA4 days ago- ...deployment and developer experience. The role focuses on unifying inference features into robust, distributed abstractions and building... ...CA; onboarding in our Los Altos office, or remote options for senior staff. Competitive compensation and strong benefits accompany this...SeniorWork at officeRemote work
Modular Services
Los Altos, CA4 days ago $182k - $242k
...What You'll Do: IT Engineering at CoreWeave designs, builds... ...CoreWeave is hiring a Senior AI Platform Engineer to... ...not a traditional AI/ML engineering role, and... ...teams that run it. Inference endpoints, agent hosts,... ...administering LLM‑based products: API integration, prompt and...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShowcify, Inc.
Sunnyvale, CA1 day ago- ...Apple seeks a Distinguished Engineer in Cupertino to set the technical direction for our foundation model inference engine. This senior individual‑contributor role partners with ML researchers to define the vision and drive delivery across multiple teams, enabling training...Senior
Apple
Cupertino, CA3 days ago $184k - $287.5k
We are seeking a Senior Developer Relations Manager to... ...for distributed AI inference. In this senior individual... ...feedback into concrete engineering and product requirements... ...4+ years in AI/ML infrastructure, model serving... ...through to a shipped fix, API improvement, or simpler...SeniorFull timeWork at officeNvidia
Santa Clara, CA5 days ago- Normal Computing in Mountain View is seeking a senior systems engineer to own the runtime that loads, schedules, and executes programs on our... ...allocation, and host-device transfer, while keeping runtime overhead low for LLM inference and #J-18808-Ljbffr Normal Computing Corp.Senior
- Amazon.com Services LLC is seeking a Senior Inference Engineer to own real‑time multimodal inference across the full stack—from research to production. You’ll shape architectures for servable models, build low‑latency runtime, and design offline training/reinforcement systems...Senior
- Apple Inc. in Cupertino seeks a Senior Software Engineer for watchOS Widgets, Live Activities, and Controls. You will design and ship user-facing features and elegant APIs that delight developers and users alike, collaborating with colleagues across Apple to ensure a cohesive...Senior
- ...NVIDIA Corporation is seeking an experienced ASIC Verification Engineer in Santa Clara, CA. You will verify the design and implementation of an inference accelerator, building block and SoC level testbenches, and collaborating across teams to ensure correctness with modern...Senior
NVIDIA
Santa Clara, CA14 hours ago $124.5k - $272k
...One platform, its Zero Trust Engine, and the powerful NewEdge network... ....Positions are available at Senior Staff and above. Candidates are... ...Scientist, you own the inference and optimization layer that makes... ...experience, with 4+ years hands-on in ML/AI (model development, fine-...SeniorNetskope
Santa Clara, CA4 days ago- ...we build. Forward Deployed Engineering is our answer to how AI is changing... ...outcomes. As a Senior Forward Deployed Engineer (AI)... ...least one of the following: AI/ML Engineering Data Engineering... ...architecture, data platforms, APIs, and front-end technologies....SeniorRemote work
Jobrapido
Santa Clara, CA2 days ago - ...Data, and Product to determine where new ML capabilities can meaningfully change... ...index serving, query processing, and ML inference. Turn advances in information retrieval... ...teams, simplify fragmented systems, mentor senior engineers, and align technical and product leaders...SeniorWork at officeLocal area
Atlassian
Mountain View, CA6 days ago - ...Inworld is a research lab and inference provider focused on realtime AI... ...the inference behind modular APIs designed for high-volume, realtime... ...to major inference engines, or deep-dive technical write-... ...experience building backend or ML systems. Who Thrives Here...SeniorFull timeWork at officeRelocation package
AItoolnavio
Mountain View, CA1 day ago - ...Apple Inc. is seeking a Senior Machine Learning Engineer to shape the Siri platform's next generation of agent... .... You will collaborate with ML researchers and product engineers to... ...into deployable systems, build training/inference pipelines, and integrate agent #J-188...Senior
Apple
Cupertino, CA5 days ago $119.8k - $234.7k
...Intelligence (AI) Infrastructure Engineering Systems team at Microsoft... ...solutions.Role Summary As a Senior or Principal Software Engineer... ...AI workloads, including model inference.Drive complex, ambiguous... ...environments.Familiarity with AI/ML infrastructure concepts, such...SeniorOngoing contractLocal area3 days per weekMicrosoft
Mountain View, CA5 days ago- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...Function of PositionThe Senior Software Quality Engineer serves... ...Device (SiMD), Digital Health, AI/ML-enabled products, and cloud-... ...designs, cloud-connected systems, APIs, embedded systems, and...SeniorLocal areaWorldwideFlexible hoursShift work
Intuitive Surgical
Sunnyvale, CA4 days ago $170.7k - $300.2k
...looking for a skilled Software Integration Engineer to take new algorithms from prototype to... ...responsibilities will include designing and maintaining APIs, benchmarking and improving performance,... ...background is a plus Experience with ML algorithms and performance optimization is...SeniorRelocationApple
Sunnyvale, CA3 days ago- ...Qualcomm Technologies, Inc. seeks experienced software engineers to advance large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed software, cloud-native infrastructure, and accelerator software...Senior
Qualcomm
Santa Clara, CA11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Inference API Engineer. Be the first to apply!
Related searches
- senior ml engineer Sunnyvale, CA
- machine learning ai engineer Sunnyvale, CA
- machine learning software engineer Sunnyvale, CA
- ai ml engineer Sunnyvale, CA
- machine learning engineer Sunnyvale, CA
- computer vision machine learning engineer Sunnyvale, CA
- senior living Sunnyvale, CA
- senior app developer Sunnyvale, CA
- senior manufacturing engineer Sunnyvale, CA
- senior application support engineer Sunnyvale, CA