Senior AI Inference Engineer - GPU, Rust & CUDA
$220kPerplexity
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience in software engineering with a focus on ML inference, familiarity with deep learning frameworks, and a strong understanding of GPU architectures. Compensation ranges from $220K to $485K. #J-18808-Ljbffr Perplexity
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer - GPU, Rust & CUDA in San Francisco, CA vacancy
$220k - $320k
inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques...Senior$220k
We build and run the inference engine behind every Perplexity query and deploy dozens of model... ...and cost budgets. Our stack is Rust, Python, CUDA, and CuTe DSL - and we need another engineer... ...management to support in API Gateway. GPU kernels migration to CuTe DSL. Port...Suggested$220k - $320k
A tech startup specializing in AI inference seeks a skilled professional to optimize their inference stack. Candidates should have over 2 years of experience in ML systems, fluency in Python, and hands-on experience with LLM frameworks. The role offers competitive compensation...SeniorLocal area$325k
About the Team Our Inference team brings OpenAI's most capable... ...our state-of-the-art AI models, allowing them... ...the Role We're hiring engineers to scale and optimize... ...infrastructure across emerging GPU platforms. You'll work... ...GPU kernels using HIP, CUDA, or Triton, and care...Suggested- Accellor, Inc, based in San Francisco, is seeking an AI Engineer to design and evaluate AI/ML models. Candidates should have strong Python... ...PyTorch, along with hands-on experience in training models on CUDA-enabled GPUs. The ideal candidate will be comfortable in development...Suggested
$160k - $225k
Cacheflow is seeking a Senior Software Engineer for AI Runtime at Databricks, located in San Francisco. You will be instrumental in building and scaling systems for large-scale GPU training, ensuring high throughput and resilience in training across expansive fleets of...Senior$320k
...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...'s mandate is to make inference deployment boring and... ...into production across GPU, TPU, and Trainium fleets... ...with Python and/or Rust in production systems...SeniorVisa sponsorshipShift work- A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate...Senior
- Pragmatike is seeking a CUDA Kernel Engineer for a remote position to develop and optimize NVIDIA CUDA kernels for high-performance AI systems. The ideal candidate will have a deep understanding of GPU architecture, performance optimization strategies, and hands-on experience...SeniorRemote workRelocation package
$300k
...startup building an AI and cloud platform,... ...model training, or inference. Our client... ...operates high-performance GPU clusters powering... ...operate inference engines such as vLLM, SGLang... ...in Python, Go, Rust, or a comparable language... ...software stacks (CUDA, Triton, NCCL) and...SeniorPermanent employmentWorldwide- ...leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect... ...demand grows. This role involves optimizing APIs, managing GPU workloads, and collaborating with cross-functional teams....Senior
- Mercor is looking for a CUDA Engineering Expert to optimize GPU kernels for performance and efficiency. This remote role requires expertise in CUDA and... ...and Git. Join a team that connects talent with leading AI research labs and contribute to cutting-edge GPU technology...Remote jobFlexible hours
- Linuxcareers is seeking an Infrastructure/Cluster Engineer to design and operate large-scale clusters that enable AI inference at scale. The role focuses on managing diverse... ...systems for cluster health. Experience with GPU infrastructure is a plus. #J-18808-Ljbffr Linuxcareers
- Fathom is seeking a Model Performance Engineer in San Francisco to optimize the speed, cost, and reliability of its model inference stack while building fine-tuning infrastructure.... ...impact millions of meetings, ensuring efficient GPU utilization, and debugging production...
$405k
...role Anthropic's Inference organization... ...efficiency that frontier AI demands. We... ...for a Staff Engineer to be a technical... ...on. This is a senior IC role with broad... ...performance‑sensitive Rust and Python... ...management - across GPU, TPU, and... ...accelerator ecosystem (CUDA/GPU, TPU, or...Work at officeVisa sponsorshipFlexible hours$190k - $270k
AI Chopping Block, Inc. is seeking an AI Infrastructure Engineer in San Francisco. This role requires maintaining user-facing services and production systems, specializing in systems while ensuring their reliability and scalability. Candidates should have 5+ years of experience...Senior- ...an applied science company building GPU-resident distributed data systems... ...Graph Neural Networks, and causal inference to deliver real-time analytics that... ...impossible. The Role We're hiring a Senior Software Engineer onto our Applied AI team to build and extend the...SeniorWork at office
Alembic Limited
San Francisco, CA4 days ago - ...looking for a Model Performance Engineer in San Francisco, California to optimize model inference speed, cost, and reliability. You... ...that accelerates the AI team’s processes. The role covers... ...frameworks and ensuring efficient GPU use. Ideal candidates should have...
- An innovative AI company is seeking a Software Engineer to develop infrastructure that supports AI training and inference workflows. This role requires strong object-oriented programming... ...scalable model serving, optimize multi-GPU infrastructure, and enhance system reliability...
- ...Our client is a well-funded AI startup building production-... ...customers. They are looking for a Senior AI/ML Engineer to own model training... ...pipelines, evaluation systems, and inference serving at scale. Full-time,... ...with distributed training, GPU optimization, or inference...SeniorFull time
Clera
San Francisco, CA2 days ago $160k - $250k
...About the Team Together AI is building the Inference Platform that brings the... ...data centers and model engine pods. Develop auto-scaling... ...in one or more of: Rust, Go, Python, or TypeScript... ...plus. ~ Familiarity with GPU software stacks (CUDA, Triton, NCCL) and HPC technologies...SeniorFull timeLocal area- A leading data and AI company in San Francisco is seeking a Senior Engineer to enhance their Model Serving platform. This role requires expertise in building large-scale distributed systems and collaboration across teams to optimize performance and reliability. Ideal candidates...Senior
- ...Francisco, is seeking a highly skilled kernel engineer to write and optimize GPU kernels that enhance performance for training and inference. This role involves deep, low-level work... ...will have a strong background in CUDA or similar, with proven experience in kernel...Senior
- ...Manufacturing Co is seeking a Software Engineer for their Supercomputing... ...You will design solutions for AI workloads on massive computing... ...working closely with training and inference teams. The ideal candidate has experience with production GPU deployments, strong software...Senior
- ...Senior Lead Software Engineer Be an integral part of an agile team that's constantly... ...platforms optimized for AI/ML workloads. Partner with... ..., ML training, and inference. Experience with Infrastructure... ...understanding of NVIDIA GPU infrastructure software (e....SeniorFor contractors
Chase
San Francisco, CA2 days ago $320k
...interpretable, and steerable AI systems. We want AI to be safe... ...group of committed researchers, engineers, policy experts, and business... ...systems. About the role Our Inference team is responsible for building... ...) Proficiency in Python or Rust Representative projects Designing...SeniorWorldwideVisa sponsorship- A tech company specializing in AI infrastructure is seeking a skilled professional to build... ...infrastructure for AI model training and inference. You will lead architectural decisions and work with core systems that power their GPU optimization platform. Candidates should...
- ...GPU Kernel Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting... ...routing Write and optimize code using CUDA, PTX assembly, and architecture-specific...Flexible hours
BaseTen
San Francisco, CA1 day ago $196k - $245k
...playing games. the company is looking for a Senior Software Engineer to build high-performance, cross-... ...desktop, browser, and mobile platforms (Rust, C++, and Typescript) Optimize... ...PSNR, VMAF, etc.) Proficiency with CPU, GPU, and memory profiling—you can identify...SeniorFull timeWork at officeWorldwideRelocationRelocation package1 day per week- ...Founding Ai Engineer ZeroEntropy is building the next-generation retrieval... ..., and can drop down to C++/CUDA when performance demands it.... ...takes to scale training and inference pipelines in the real world.... ..., with bonus points for C++, Rust, CUDA, or other performance-...
Zeroentropy (yc W25)
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer - GPU, Rust & CUDA. Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior game producer San Francisco, CA
- senior electronic design engineer San Francisco, CA