Senior Inference Systems Engineer - ML & GPU Ops
$165k - $242kCoreWeave
CoreWeave in Bellevue, WA is seeking an experienced engineer to lead design reviews and optimize distributed systems. The role requires 5-8 years in cloud services, strong skills in Python or Go, and hands-on experience with Kubernetes. Key responsibilities include defining SLIs/SLOs and mentoring junior engineers. The compensation includes a base salary range of $165,000 to $242,000, along with a discretionary bonus and comprehensive benefits including health insurance and flexible PTO. #J-18808-Ljbffr CoreWeave
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Senior Inference Systems Engineer - ML & GPU Ops in Bellevue, WA vacancy
- ...on performance, model bring-up, and validation across multi-node inference in edge clusters. You will own model validation, develop and... ...hardware-specific inference issues. A PhD/CS background and 12+ years of GPU software experience are highly valued. #J-18808-Ljbffr NVIDIASeniorLocal area
- CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel authoring and optimization for LLM inference. You will write and tune CUDA kernels, optimize tensor... ...with CUDA, C++, Python, and GPU architectures is required; familiarity...Senior
$226k - $307k
...generation of autonomous system intelligence.As a... ...Optimization Engineer, you will orchestrate... ...for more efficient inference by sharing various... ...you will optimize ML models, write custom... ...system resources (CPU/GPU/interconnect) to... ...optimizing custom ML OPs and TensorRT...SeniorFull timeTemporary workRelocation package- The Pacific Northwest National Laboratory in Seattle seeks a Senior Software Engineer to contribute to advanced AI capabilities. In this role, you will design and implement scalable systems while collaborating with talented professionals across various disciplines. Your...Senior
$164k - $313.3k
...Opportunity Photoshop ART is seeking a Senior Machine Learning (ML) Systems & Efficiency Engineer to join our R&D team focused on... ...‑ready improvements in inference performance, latency, and cost efficiency... ...model design decisions, improve GPU utilization, and build scalable,...SeniorLocal area- ...generation of autonomous system intelligence.... ...Optimization & Deployment Engineer, you will focus on... ...will optimize the ML models, write... ...highly concurrent inference code to ensure real... ...optimize custom ML OPs and TensorRT Plugins... ...efficiency optimization for GPU clusters....SeniorTemporary workRelocation package
Zoox
Seattle, WAa month ago $182k - $242k
...cloud for high-performance GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference. Our stack is engineered for speed, scale, and... ...We're looking for a Senior Engineer for CoreWeave's... ...or performance-critical systems. ~ Hands-on CUDA experience...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Bellevue, WA17 days ago$165k - $242k
...strategies. Mentor IC1/IC2 engineers; review cross-team... ...cost-per-token analytics, GPU resource isolation).... ...experience building distributed systems or cloud services.... .... Optimize end-to-end ML system performance by... ...Practical knowledge of inference internals: batching,...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ...performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...SeniorFull time$151.2k - $204.6k
We are looking for a System Development Engineer to design, build, and own the executive decision intelligence platform that serves senior leaders (VPs, Directors) across Amazon's global data... ...leadership users- Experience integrating ML model outputs into production systems...SeniorFlexible hours- NVIDIA is seeking a seasoned engineer to advance LLM inference on edge AI hardware. You’ll evaluate frameworks, map model architectures to GPU, and optimize across multi-node deployments, focusing on performance and stability. You’ll own validation workflows, develop actionable...Senior
$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software... ...the team: CI, build systems, training infrastructure,... ...assisted toolingExperience with ML accelerators with a basic... ...internals (custom ops, autograd, export) or equivalent...SeniorFull time- Google is seeking a Product Manager for the TPU Inference team to guide AI/ML infrastructure products from concept to launch, bridging technical... ...and business needs. You will work cross‑functionally with engineers, designers, and cloud teams to deliver scalable TPU...Senior
$130.4k - $195.6k
...Unity content into other game engines and 3D environments — in-process... ...the network.We’re building systems that allow real-time 3D experiences... ...experience integrating AI/ML into production software, including... ...agents, multimodal models, inference pipelines, embeddings, vector...SeniorFull timeWork at officeRemote workWorldwide$224k - $356.5k
...computing. An era in which our GPU acts as the brains of... ...innovations in leading open-source LLM inference frameworks — identify... ...in Computer Science, Computer Engineering, Electrical Engineering, or equivalent... ...with depth in GPU computing, ML systems, or high-performance...SeniorFull timeLocal area$204.8k - $296.6k
Adobe Inc. is seeking a Senior Machine Learning Systems & Efficiency Engineer in Seattle. This critical role will focus on optimizing ML systems for efficiency and cost-effectiveness. The... ...include designing high-throughput inference systems, conducting performance analysis...Senior$184k - $287.5k
...customers in building AI/ML and HPC software... ...scale LLM training and inference.Conducting regular technical... ...issues for both AI and systems performance.What we need... ...in Electrical/Computer Engineering, Computer Science,... ...Hands-on experience with GPU systems in general including...SeniorFull time$100k - $150k
...vertically integrated AI cloud engineered for AI. We own and... ...energy, data centres, GPU superclusters,... ...Role (Job Purpose) Senior Infrastructure Support... ...stacks on AI training and inference clusters. Confident with... ...failures. ~ Linux systems engineering at scale....SeniorFull timeRemote workFlexible hours$119.8k - $234.7k
...Hardware, and Infrastructure Engineering (SCHIE) is the team... ...that mission. The Platform Systems Engineering (PSE) team is seeking a Senior AI Network Systems... ...large-scale AI training and inference clusters. Collaborate... ...technologies. Experience with AI/ML workload communication...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per week$205.9k - $407.5k
...transparently! We are looking to bring on a Senior Principal ML GPU Architect to lead the ML GPU... ...will partner with the Director of ML Engineering who is responsible for our platform engineering... ...function changes in training and inference speed/scale for all our ML workloads....Senior- Siemens is seeking a Software Engineer to lead architecture for AI-native, high-scale systems that blend cloud, ML, and hardware interaction. You will set the technical direction, design robust, scalable foundations, and guide rapid research and product iteration. You...Senior
$182k - $242k
...Learn more at What You'll Do: The Systems Engineering team owns the Linux kernel and host... ...software stack underneath one of the largest GPU fleets in the world. When something... ...upstream the fix. About the role: As a Senior Software Engineer on the Systems...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Bellevue, WA12 days ago$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...and implementing advanced AI and ML solutions to drive innovation and enhance... ...designing and optimising algorithms, models, and systems to enable intelligent decision-making and...SeniorFull timeH1b- Apple Inc. in the San Francisco Bay Area is looking for a Staff/Sr. Machine Learning Engineer to optimize inference for large foundation models and deliver production-grade solutions that serve millions of users in real time. You will collaborate closely with research...Senior
- Designworks Talent is seeking an Inference Engineer to build and operate production-grade model-serving and inference systems in a hybrid Bellevue, WA setting. You’ll work across distributed systems, GPU optimization, and production AI infrastructure to deliver high-throughput...Senior
- ...of how work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake ML Platform team's mission... ...turns scarce, expensive GPU capacity into a simple,... ...handle the hard distributed-systems parts, including... ...multi-node training and inference, fault tolerance, and throughput...Senior
- General Motors seeks a Senior Performance Engineer to join the AV Capacity and Performance Engineering team within the AV Infrastructure org, to optimize GPU-powered ML systems and support autonomous vehicle initiatives. You will analyze production workloads, drive performance...Senior
$161k - $239k
...architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and... ...infrastructure, distributed systems. Preferred qualifications: Master's degree... ...platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's...SeniorFull time- ByteDance in Seattle is seeking a Senior Research Engineer/Scientist for Storage for LLM to design and... ...-performance KV cache layer for LLM inference across GPUs and nodes. This role focuses... ...and explore open‑source KV stores or GPU‑aware caching techniques. #J-18808-Ljbffr...Senior
$174k - $252k
...architecture. Experience with modern GPU architectures (NVIDIA, AMD, or... ..., etc.) and performance engineering techniques. Experience with... ...code generation, and runtime systems for GPU architectures (OpenXLA... ...ensuring top performance for our ML models, adapting to ML...SeniorFull timeTemporary workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Systems Engineer - ML & GPU Ops. Be the first to apply!
Related searches
- distributed systems engineer Bellevue, WA
- operations support system engineer Bellevue, WA
- system performance engineer Bellevue, WA
- mission system engineer Bellevue, WA
- system engineer remote Bellevue, WA
- application system engineer Bellevue, WA
- senior staff systems engineer Bellevue, WA
- senior windows systems engineer Bellevue, WA
- healthcare systems engineer Bellevue, WA
- sr systems engineer Bellevue, WA