Senior AI Inference Optimization Engineer
DigitalOcean
DigitalOcean is seeking a Senior Engineer 2 to lead architectural decisions for inference performance and to optimize GPU kernel and inference engine performance. You will solve memory bandwidth bottlenecks and guide the technical roadmap for a high-performance inference fleet. You will collaborate with product teams and TPMs to turn theoretical hardware limits into shippable features while mentoring engineers and driving open-source collaboration in the GPU AI space. #J-18808-Ljbffr DigitalOcean
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Optimization Engineer in Seattle, WA vacancy
$236k - $330k
.... To usher in this new era, we seek AI-native thinkers across every function... ...advance the state of the art in LLM inference systems and optimization.Our mission is to build the next... ...manual tuning. We embrace AI-native engineering, using AI not only as the workload we...SeniorSnowflake
Bellevue, WA2 days ago$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling... .... The third is agentic kernel optimization: applying AI-driven analysis to diagnose performance gaps, explore...SeniorFull timeNvidia
Seattle, WA2 days ago$254k - $350k
...intelligence.As a Machine Learning and System Optimization Engineer, you will orchestrate and allocate... ...that allow for more efficient inference by sharing various parts of the perception... ...Proficiency in low-level programming for AI accelerators, specifically developing and...SeniorFull timeTemporary workRelocation packageZoox
Seattle, WA3 days ago- Snowflake is seeking AI-native thinkers for the AI Research team to advance LLM inference systems and optimization. You will work on high-performance, adaptive inference across distributed serving, GPU kernels, and system co-design, collaborating with researchers and product...Senior
- AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into products our customers rely on every day. You'll sit on a fast-paced... .... You’ll design and ship customer-facing APIs, scale inference infrastructure for 1M+ users, and collaborate with researchers...Senior
$254k - $350k
...to drive our ML Performance Optimization initiatives and make our ML models... ...a team of strong software engineers and act as a force multiplier... ...cutting-edge ML Training OR Inference performance optimization techniques... ...use artificial intelligence (AI) tools to support parts of...SeniorFull timeRemote workZoox
Seattle, WA5 days ago- ...intelligent, efficient, and AI-driven. Our team is dedicated... ..., and continual learning, to optimize AI customer service responses... ...quantization, and efficient inference techniques to ensure the AI customer... ...computer science, computer engineering, statistics, applied...SeniorWork experience placement
TikTok
Seattle, WA2 days ago $182k - $242k
...is The Essential Cloud for AI™. Built for pioneers by... ...rendering, and real-time inference. Our stack is engineered for speed, scale, and cost... ...product. We're looking for a Senior Engineer for CoreWeave's... ...on kernel authoring and optimization. You will write, profile,...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Bellevue, WA1 day ago- NVIDIA is seeking a Senior AI Compiler Engineer to build an MLIR-based AI compiler powering the inference engine, with a focus on performance, fast builds, low memory usage... ...dialects, and drive kernel generation and optimizations for neural networks while contributing to...Senior
$168k - $264.5k
...into the unlimited potential of AI to define the next era of... ...best-in-class ASIC Verification Engineers to verify the design and... ...implementation of the world’s leading inference accelerator. This position... ...your tasksImplement and optimize automated verification flows...SeniorFull timeNvidia
Seattle, WA5 days ago- Arm Limited is seeking a Software Engineer for the AI Inference Runtime team, driving architecture and roadmaps for distributed inference workloads... ...hardware platforms. You will lead profiling, kernel optimization, and efficiency improvements, collaborating with cloud,...Senior
- ...notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate... ...secure, scalable cloud platforms optimized for AI/ML workloads. Partner with AI... ...transformer architecture, ML training, and inference. Experience with Infrastructure...SeniorFor contractors
JPMorgan Chase & Co.
Seattle, WA1 day ago $150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software and Services... ...Compute, the backbone of Siri AI and Apple Intelligence. You'll... ...and cache locality optimizations within PCC’s privacy architecture...SeniorRemote workWorldwideRelocationApple Inc.
Seattle, WA1 day ago- Anthropic is seeking product-minded backend engineers to design, build, and own backend... ...You will navigate provider differences, optimize cost, and ensure reliability at massive... ...platforms. You will collaborate across inference, product API, systems, and security teams...Senior
$182.4k - $247k
A leading data and AI company located in Bellevue is seeking an experienced Software Engineer to build innovative data storage and processing systems. Candidates should have over 8 years of experience in Java, Scala, or C++, strong knowledge in algorithms and distributed...Senior- Snowflake is building the next generation of AI-native inference systems. We seek experienced researchers and systems developers to advance LLM inference, optimization, and platform-wide performance across GPUs, CPUs, and distributed runtimes. You will collaborate with...Senior
- ...5 community where each individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI lifecycle by bridging the gap between high-performance model development and optimized deployment environments. This position focuses on optimizing Large...Full timeLocal areaImmediate start
F5 Networks
Seattle, WA6 days ago $339k
...the most consequential engineering problems in the... ...how the whole onboard AI workload is scheduled,... ...teams, and you will be a senior technical voice for onboard... ...platform. Lead inference performance at scale.... ...knowledge of ML inference optimization (TensorRT, XLA, Triton...SeniorFull timeTemporary workRelocation package- OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and partner-side software for long‑lived optimization workflows, generating kernels...
$241.68k
...Senior Site Reliability Engineer (Seed Model - Infrastructures - SRE) Location: Seattle... ...systems and heterogeneous inference systems for large-scale generative AI workloads (LLM, text-to-image... ...understanding); drive deep performance optimization and resolve core issues such...SeniorTemporary workFlexible hoursByteDance (old)
Seattle, WA13 hours ago$500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers and enterprise... ...Have significant software engineering experience, with a strong background... ...re interested in this work We think AI systems like the ones we’re building...SeniorWork at officeHome officeRelocation packageFlexible hours$216.2k - $324.8k
...Senior Machine Learning iOS Platform Engineer — Responsible AI and Safety San Francisco Bay Area, California, United States... ...Apple Silicon to server-side inference on Private Cloud Compute (PCC)... ...experiences. Performance Optimization: Ensure our features set the benchmark...SeniorRelocationApple Inc.
Seattle, WA1 day ago$262.7k - $355.4k
As a Principal Software Engineer on our AI Inference Runtime team, you will set technical direction for critical components of distributed Inference... ..., distributed workload execution, kernel development and optimization, and performance benchmarking and analysis. Your work...Work at officeLocal areaARM
Seattle, WA3 days ago$160k - $250k
...infrastructure platform that gives developers and enterprises access to open source and proprietary AI models. For leading open source LLMs, Deploy operates an optimized model inference engine that keeps costs and latency low while maintaining high throughout. Deploy also offers a...SeniorFull time$168.1k - $227.4k
...scale machine learning. This senior software engineering role is part of the Machine Learning Inference Applications team and focuses... ...excellence in inference framework optimization and engineering best... ..., AWS Neuron, TPUs, or other AI accelerator hardware- Experience...SeniorWork experience placementInternshipLocal areaFlexible hoursAmazon
Seattle, WA6 days ago$168.1k - $227.4k
...actually need? AWS Insights and Optimizations is the team that answers that... ...more expensive to get wrong. AI and machine learning... ...scarce and costly, training and inference usage is bursty and hard to forecast... ...one account at a time. An engineer deciding whether to accept a...SeniorInternshipFlexible hoursDay shiftAmazon
Seattle, WA2 days ago- CoreWeave is The Essential Cloud for AI. We are looking for an Applied AI Engineer to help us understand, measure,... ...real-world performance of our inference platform. In the near term you will... ...bottlenecks, and drive targeted optimizations for platform-wide and customer-specific...
- NVIDIA is seeking a Sr. Inference Engineer to push GPU kernel optimization for LLM inference. The role focuses on silicon-measured kernel benchmarking, model-level performance projection, and agentic optimization systems that improve kernels at the assembly level. You...Senior
$133.5k - $194k
...landing page deploymentMaintain strong engineering standards while supporting marketing speedEstablish... ...-Enabled Marketing InnovationIntegrate AI agents and LLM APIs to power:Dynamic... ...experiencesSEO & GEO optimization workflowsScalable localizationAutomate content...SeniorHiya
Seattle, WA1 day ago- ...us!About the RoleWe’re looking for a Senior Design Systems Engineer II to shape and scale the visual and... ...front-end tooling.Expert use of modern AI-assisted tools (e.g., Cursor, GitHub... ...accessibility standards and UI performance optimization.Collaboration & CraftsmanshipStrong...Senior
Blink Health
Seattle, WA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Optimization Engineer. Be the first to apply!
Related searches
- machine learning ai engineer Seattle, WA
- ai developer Seattle, WA
- ai engineer remote Seattle, WA
- ai ml engineer Seattle, WA
- ai prompt engineer Seattle, WA
- senior ai engineer Seattle, WA
- ai engineer Seattle, WA
- senior living Seattle, WA
- senior associate vice president Seattle, WA
- senior app developer Seattle, WA