Kernel Engineer for AI Inference Performance
Acceler8 Talent
Acceler8 Talent is seeking a Member of Technical Staff for Kernels & GPU Performance in San Francisco, on-site. The role focuses on building and optimizing low-level execution primitives to translate accelerator capability into production AI performance, spanning multiple accelerator architectures. You will work near hardware across kernel implementation, memory access, profiling, and validation, partnering with compiler, ML systems, runtime, and distributed-systems engineers to improve latency, #J-18808-Ljbffr Acceler8 Talent
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Kernel Engineer for AI Inference Performance in San Francisco, CA vacancy
- ...own and advance our serverless inference benchmarks. You will cover... ...directly with neoclouds to measure performance. You will analyze throughput,... ...shaping the roadmap with engineers and the pillar lead. This... ...front-row exposure to frontier AI and equity compensation. #J-...Performance
- World Labs in San Francisco is hiring a Performance Engineer to accelerate training and serving of large world models. You will identify bottlenecks across kernels, serving paths, and GPUs, then implement concrete improvements that raise throughput and lower latency. You...Performance
- Anthropic is seeking a Performance Engineer for its Inference Engine to optimize LLM processing across accelerator and cloud platforms. You will work on... ...thinking, observability, and collaboration in a fast-moving AI safety-focused environment. #J-18808-Ljbffr...Performance
- ...Crusoe Energy Systems is seeking a seasoned Compute SRE to own virtualization performance and kernel-level optimization for our AI-first compute platform. You will deploy, tune, and scale bare-metal and virtualized infrastructure supporting AI and HPC workloads. You...Performance
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning, enabling reliable, scalable inference across production...Performance
- Sail builds the world’s most efficient software for inference and agent hosting. In this role, you’ll own token processing down to the lowest layers of the stack, optimize kernel performance, develop new request scheduling and parallelism strategies, and help us use a...Performance
- ...products that bring powerful AI into people's everyday lives.... ...combines world-class researchers, engineers, designers, and operators who... ...behind them. We connect kernel development with the broader... ...resolve correctness, concurrency, performance, power, and reliability...Performance
- ...Member of Technical Staff - Kernels & GPU Performance Location: San Francisco... ...Company A fast-growing AI infrastructure company is building... ...-performance, efficient AI inference across heterogeneous... ...runtime, and distributed-systems engineers. What You’ll Do Build...PerformanceFull time
Acceler8 Talent
San Francisco, CA4 days ago - ...'ll write and optimize the GPU kernels and supporting systems software that makes our training and inference workloads fast. This is deep, low-level work (performance counters, memory bandwidth, warp... ...use. We hire kernel engineers because the gap between "this works...PerformanceShift work
MakerMaker.AI
San Francisco, CA14 hours ago - ...investors. Researchers and engineers at Hedra work closely across... ...Role We’re looking for an Inference Optimization Engineer to work... ...algorithms, runtimes, kernels, and distributed execution.... ...gone unusually deep on model performance, GPU systems, or efficient inference...PerformanceWork at office
US Health Partners, LLC
San Francisco, CA3 days ago $200k - $300k
...3D world — unlocking AI's full potential through... ...research to systems engineering to product design — creating... ...We are looking for a Performance Engineer to make World... ...the bottlenecks — in kernels, in the serving path,... ...Will Do: Optimize inference and serving end to end...PerformanceWORLD LABS
San Francisco, CA2 days ago- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference... ...Rust experience, proficiency in network protocols, and a track record of optimizing performance #J-18808-Ljbffr CloudFlarePerformance
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and... ...with the team on model serving, inference performance, and API design while shipping robust, production...Performance
- Baseten is hiring a Software Engineer focused on testing within the Platform team. You will own the end-to... ...strategy, building unit, integration, load, and performance testing frameworks for a mission-critical AI inference platform. You will design end-to-end test...Performance
- ...seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime... ...software, focusing on reliable long-running workflows, reproducible performance results, and secure handling of model and hardware data. This...Performance
- ...role You'll own the cost and performance of our inference stack. Your work will... ...You'll work closely with the engineers operating the serving fleet... ...quantization, decoding, and kernel-level optimization. Success... ...every box. About Us Most AI is frozen in place - it doesn...PerformanceFlexible hours
- ...interpretable, and steerable AI systems. We want AI to be... ...of committed researchers, engineers, policy experts, and business... ...beneficial AI systems. Performance Engineer, Inference Engine About the Role Anthropics... ...between the accelerator kernels and the routing layer. It manages...Performance
- ...and unicorn founders and senior engineers with deep expertise in 3D, generative... ...for a Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is a highly... ...using torch.compile, custom CUDA kernels, and specialized inference frameworks...PerformanceRelocationVisa sponsorshipRelocation package
- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... ...deep low-level optimizations (GPU kernels, quantization, speculative... ...required if you have:1+ years of system performance optimization experienceLow-level inference...PerformanceWork at officeLocal area
Atlassian
San Francisco, CA3 days ago - ...About Us We are the first AI inference neocloud, using ASIC compute... ..., IR lowering, op coverage, kernel selection — when a model won... ...porting/bringup, or high-performance kernels. ~ You’ve taken a... ...driven tooling that did real engineering work, not demos. #J-18808-...PerformanceLive in
General Compute
San Francisco, CA2 days ago - ...Systems Administrator / DevOps Engineer, you will maintain and build... ...our model training and our inference cloud. You’ll split your time... ...training throughput, and the performance and reliability of our inference... ...) Prior work supporting ML/AI infrastructure, including GPU...PerformanceWork at officeRemote workRelocation package
Zyphra
San Francisco, CA1 day ago $381k
...unique demands of advanced AI workloads. The team is... ...for AI.About the RoleAs an Engineer on our hardware... ...for programmability and performance. You will work with our kernel, compiler and machine learning... ...towards efficient training and inference on our models. If you are...PerformanceWork at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA2 days ago$300k - $350k
...Machines is to build AI that extends human will... ...hiring a Site Reliability Engineer (SRE) to keep our post... ...Own the reliability, performance, and uptime of large-... ...networking, hardware, kernel, or scheduler issues... ...generation, and mixed training/inference workloads...PerformancePermanent employmentVisa sponsorshipWork visaRelocation packageShift workThinking Machines Lab Inc.
San Francisco, CA2 days ago$170k - $245k
...tech stacks to accelerate the progress of AI applications out into the real world.With... ...date.About the roleAs a Distributed LLM Inference Engineer, you will help systems and optimizations that push the boundaries of performance for inference at large scale. This is an...PerformanceWork at officeAnyscale
San Francisco, CA4 days ago- ...Forward Deployed Engineer (Inference) Location: San Francisco, CA Employment Type: Full-time... ...About the Company A well-funded AI infrastructure company is building systems... ...scale. About the Role Inference performance depends on far more than selecting a model...PerformanceFull time
Acceler8 Talent
San Francisco, CA4 days ago - ...neocloud for alternative chips. Inference is fragmenting: purpose-built... ...frontier labs, fast-growing AI application companies, and... ...the backlog. As a founding engineer, you'll help decide what we... ...deep enough to reason about performance at the hardware level, not just...Performance
General Compute
San Francisco, CA2 days ago - Google DeepMind is hiring a Software Engineer in Mountain View, CA to advance... ...accelerators software/hardware co-design for AI inference workloads. You will join a team of... ...software algorithms, optimizing kernels, and benchmarking performance while aligning with the broader...Performance
- ...Sciforium is an AI infrastructure company developing... ...-on support from AMD engineers the team is scaling... ...GPU clusters — from kernel tuning and GPU drivers... ...configured, well-managed, high-performance infrastructure. Key... ...Kubernetes for inference workloads — NVIDIA GPU...PerformanceFlexible hours
Sciforium
San Francisco, CA2 days ago $213.5k - $335.5k
...see significant improvement in performance and a decrease in spam and... ..."normalized" problem and the AI-native curiosity to create a... ...Slack channel with a founding engineer, whiteboarding an architecture... ...GenAI application patterns — inference at the edge, RAG, vector databases...PerformanceTemporary workWork experience placementLocal areaFlexible hoursCloudflare, Inc.
San Francisco, CA3 days ago- ...see significant improvement in performance and a decrease in spam and... ...a normalized problem and the AI-native curiosity to create a... ...the Department Cloudflares engineering teams build and maintain the... ...efficiency depends on advanced Linux kernel and hardware capabilities and...PerformanceFull timeLocal area
Cloudflare
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Kernel Engineer for AI Inference Performance. Be the first to apply!
Related searches
- senior performance engineer San Francisco, CA
- performance improvement specialist San Francisco, CA
- performance specialist San Francisco, CA
- high performance computing engineer San Francisco, CA
- performance food group San Francisco, CA
- performance engineer San Francisco, CA
- performance testing San Francisco, CA
- sports performance coach San Francisco, CA
- system performance engineer San Francisco, CA
- performance improvement consultant San Francisco, CA