Senior Inference Systems Engineer - ML & GPU Ops
$165k - $242kCoreWeave
CoreWeave in Bellevue, WA is seeking an experienced engineer to lead design reviews and optimize distributed systems. The role requires 5-8 years in cloud services, strong skills in Python or Go, and hands-on experience with Kubernetes. Key responsibilities include defining SLIs/SLOs and mentoring junior engineers. The compensation includes a base salary range of $165,000 to $242,000, along with a discretionary bonus and comprehensive benefits including health insurance and flexible PTO. #J-18808-Ljbffr CoreWeave
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Inference Systems Engineer - ML & GPU Ops in Bellevue, WA vacancy
- ...in Seattle, WA seeks outstanding AI systems engineers to advance the inference software stack for AI workloads. You... ...develop libraries, code generators, and GPU kernel technologies for NVIDIA... ...skills are essential, with 6+ years in ML/DL systems. #J-18808-Ljbffr NVIDIASenior
- CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel authoring and optimization for LLM inference. You will write and tune CUDA kernels, optimize tensor... ...with CUDA, C++, Python, and GPU architectures is required; familiarity...Senior
$254k - $350k
...generation of autonomous system intelligence.As a... ...Optimization Engineer, you will orchestrate... ...for more efficient inference by sharing various... ...you will optimize ML models, write custom... ...system resources (CPU/GPU/interconnect) to... ...optimizing custom ML OPs and TensorRT...SeniorFull timeTemporary workRelocation package- The Pacific Northwest National Laboratory in Seattle seeks a Senior Software Engineer to contribute to advanced AI capabilities. In this role, you will design and implement scalable systems while collaborating with talented professionals across various disciplines. Your...Senior
- ...technology products.As a Senior Lead Software Engineer at JPMorgan Chase... ...optimized for AI/ML workloads.Partner... ...on experience in system design,... ...ML training, and inference.Experience with Infrastructure... ...of NVIDIA GPU infrastructure... ...Experience in ML Ops and related...SeniorFor contractors
$165k - $242k
...strategies. Mentor IC1/IC2 engineers; review cross-team... ...cost-per-token analytics, GPU resource isolation).... ...experience building distributed systems or cloud services.... .... Optimize end-to-end ML system performance by... ...Practical knowledge of inference internals: batching,...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work- NVIDIA is seeking outstanding AI systems engineers to advance inference software, building libraries, code generators, and GPU kernel technologies for our hardware architecture. You will design abstractions for LLM serving engines and just-in-time compilers to accelerate...Senior
$182k - $242k
...cloud for high-performance GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference. Our stack is engineered for speed, scale, and... ...product. We're looking for a Senior Engineer for CoreWeave's... ...or performance-critical systems. Hands-on CUDA...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- Xaira Therapeutics is seeking a Senior Software Engineer to join our Platform team to design, build, and... ...enable thousands of GPUs for training and inference of biology foundation models in Seattle. This role covers MLOps for GPU clusters and backend API work, with...Senior
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ...performance projection tooling, and agentic optimization systems that improve GPU kernels at the assembly layer. Our team...SeniorFull time$224k - $356.5k
...computing. An era in which our GPU acts as the brains of... ...innovations in leading open-source LLM inference frameworks — identify... ...in Computer Science, Computer Engineering, Electrical Engineering, or equivalent... ...with depth in GPU computing, ML systems, or high-performance...SeniorFull timeLocal area$151.2k - $204.6k
We are looking for a System Development Engineer to design, build, and own the executive decision intelligence platform that serves senior leaders (VPs, Directors) across Amazon's global data... ...leadership users- Experience integrating ML model outputs into production systems...SeniorFlexible hours$130.4k - $195.6k
...Unity content into other game engines and 3D environments — in-process... ...the network.We’re building systems that allow real-time 3D experiences... ...experience integrating AI/ML into production software, including... ...agents, multimodal models, inference pipelines, embeddings, vector...SeniorFull timeWork at officeRemote workWorldwide$184k - $287.5k
...customers in building AI/ML and HPC software... ...scale LLM training and inference.Conducting regular technical... ...issues for both AI and systems performance.What we need... ...in Electrical/Computer Engineering, Computer Science,... ...Hands-on experience with GPU systems in general including...SeniorFull time$205.9k - $407.5k
...transparently! We are looking to bring on a Senior Principal ML GPU Architect to lead the ML GPU... ...will partner with the Director of ML Engineering who is responsible for our platform engineering... ...function changes in training and inference speed/scale for all our ML workloads....Senior$161k - $239k
...architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and... ...infrastructure, distributed systems. Preferred qualifications: Master's degree... ...platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's...SeniorFull time$153k - $204k
...025. Learn more at What You'll Do The Systems Engineering team owns the host software stack that... ...hardware before it reaches one of the largest GPU fleets in the world, and we're... ...further down the stack. About The Role As a Senior Software Engineer on the Systems...SeniorPermanent employmentFull timeTemporary workCasual workLive inWork at officeFlexible hoursCoreWeave
Bellevue, WA19 hours ago- Haus Analytics in Seattle is seeking a senior ML engineer to drive high-impact projects on the cMMM space, blending ML, causal inference, and scalable production code. You will collaborate with applied scientists, data engineers, and cross-functional teams to deliver trustworthy...SeniorFlexible hours
- ...of how work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake ML Platform team's mission... ...turns scarce, expensive GPU capacity into a simple,... ...handle the hard distributed-systems parts, including... ...multi-node training and inference, fault tolerance, and throughput...Senior
$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...and implementing advanced AI and ML solutions to drive innovation and enhance... ...designing and optimising algorithms, models, and systems to enable intelligent decision-making and...SeniorFull timeH1b$168k - $270.25k
...NVIDIA Experience (NVEX) Solutions Engineering team is looking for an... ...customer support of NVIDIA’s GPU accelerated platforms including... ...hardware platform issues and AI/ML workloads in huge datacenters... ...with multi-GPU platformsStrong system software (firmware, BIOS, kernel...SeniorFull timeWeekend work- NVIDIA AI is seeking an engineer to implement quantized and sparse recipes in inference engines and to manage model export pipelines for correct serialization. You... ...requires strong Python and C++ skills, experience with ML accelerators, and familiarity with PyTorch...Senior
- Apple Inc. seeks a Sr. Machine Learning Engineer for Foundation Models Inference in Cloud OS & Inference to advance private, scalable AI inference across... ...optimizing inference, hardware/software codesign, and system architectures at planetary scale. You will own high-...Senior
$142.8k - $274.8k
...Hardware, and Infrastructure Engineering (SCHIE) powers the... ...AI-native silicon and system-level solutions that enable... ...AI training and inference at hyperscale.The Platform... ...years of experience in GPU based SU/SO development... ...technologies.Experience with AI/ML workload communication...Ongoing contractLocal area3 days per week- ByteDance in Seattle is seeking a Senior Research Engineer/Scientist for Storage for LLM to design and... ...-performance KV cache layer for LLM inference across GPUs and nodes. This role focuses... ...and explore open‑source KV stores or GPU‑aware caching techniques. #J-18808-Ljbffr...Senior
- Implement quantized and sparse recipes within inference engines and manage model export pipelines to ensure correct serialization. Develop benchmarking... ...strong software engineering fundamentals and experience with ML accelerators. Candidates should have experience with PyTorch...Senior
- ...GPU Systems Engineer - RemoteBright Vision Technologies is a technology consulting and software development... ...from GPU platforms for AI training, inference, scientific computing, and high-... ...for linear algebra, attention, and other ML primitives.Optimize multi-GPU and multi...H1bLocal areaImmediate startRemote workVisa sponsorship
Bright Vision Technologies
Sammamish, WA5 days ago - Blink Health is seeking a Senior Design Systems Engineer II to shape and scale the visual and interaction foundations of Blink’s digital ecosystem. You’ll partner with Product Design, Software Engineering, and cross-functional teams to evolve a shared frontend design system...Senior
$132k - $264k
...highly scalable systems. We interact... ...the Marketplace engineering organization, product... ...with the Senior Manager and Director... ...delivery of ML products.Drive... ...practices, ML Ops practices, resource... ...ML, causal inference, causal ML, statistical... ...with GPU/CUDA for computational...Full timeTemporary workPart timeFlexible hours$237k - $285k
...MA / San Diego, CASoftware - Software Systems /Full-time /HybridZoox is building... ...meet the required specifications. As a GPU performance software engineer within the Software Performance team,... ...like TensorRT & XLA.Hands-on work with ML model optimization (post-training...SeniorFull timeTemporary workRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Systems Engineer - ML & GPU Ops. Be the first to apply!
Related searches
- senior staff systems engineer Bellevue, WA
- application system engineer Bellevue, WA
- system engineer contract Bellevue, WA
- operations support system engineer Bellevue, WA
- sr systems engineer Bellevue, WA
- system performance engineer Bellevue, WA
- software system engineer Bellevue, WA
- mission system engineer Bellevue, WA
- systems engineer Bellevue, WA
- senior linux systems engineer Bellevue, WA