Senior Inference Performance Engineer — GPU & CUDA
$220k - $320kInference
A tech startup specializing in AI inference seeks a skilled professional to optimize their inference stack. Candidates should have over 2 years of experience in ML systems, fluency in Python, and hands-on experience with LLM frameworks. The role offers competitive compensation of $220,000 to $320,000 plus equity and benefits, focusing on accelerating AI inference. Join an innovative team in downtown San Francisco, hybrid options available for local candidates. #J-18808-Ljbffr Inference
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Performance Engineer — GPU & CUDA in San Francisco, CA vacancy
$220k - $320k
inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques...SeniorPerformance- ...worldwide.We’re a team of engineers, clinicians, and... ...work helps care teams perform with greater... ...Function of PositionAs a Senior Systems GPU Engineer - AI & Robotics... ...to real-time onboard inference—while serving as a core... ...in GPU Compute API - CUDA, OpenCL• Proficiency...SeniorPerformanceLocal areaWorldwideFlexible hours
$167.2k - $209k
...DigitalOcean is seeking a Senior Engineer 2 to play a key technical role in our AI Inference Optimization team.... ...the industry-leading performance for our inference services... ...inference engine and GPU kernel layers,... ...their software stacks (CUDA, ROCm, TensorRT, OpenAI...SeniorPerformanceLocal areaRemote workWorldwideFlexible hours- ...Auto is hiring an experienced GPU-focused engineer to advance autonomous... ...will optimize end-to-end GPU performance, including sensor processing... ...LiDAR) and neural network inference, and collaborate with software... .... The role emphasizes CUDA-based development, profiling...PerformanceRelocation
- MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this... ...build and operate production inference systems, optimizing for performance and reliability. The ideal candidate... ...and have strong knowledge in GPU-accelerated inference....SeniorPerformance
- LeoForce is seeking a Global Inference Library Engineer to design and optimize a high‑performance inference library for modern AI models. You will work across diverse... ...emphasizes deep knowledge of AI infrastructure, GPU programming, and low-level kernels, with exposure...SeniorPerformance
- ...San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern...SeniorPerformance
- ...AI acceleration company in San Francisco is seeking a GPU Kernel Engineer to optimize performance for machine learning models. You will be responsible for... ...computation efficiency. Ideal candidates have 1-5 years of CUDA development experience and a strong understanding of...Performance
$250k
...building a next-generation GPU platform designed for AI... ..., experimentation, and inference at scale. The company is... ...company is looking for a Senior / Staff Site Reliability Engineer to support and scale large... ...reliability, scalability, and performance of HPC and cloud...SeniorPerformanceFull timeRemote workSan Francisco, CAmore than 2 months ago- Mirai Labs in San Francisco seeks engineers to join a senior team building the full on-device stack... ...You will primarily work on uzu, our inference engine, and focus on supporting new... ...work, and experience in writing high-performance GPU kernels or Rust systems programming....PerformanceLocal area
$190k - $235k
...Francisco, CaliforniaSoftware Engineering /Full time Exempt /... ...you. ABOUT THE ROLEAs a senior Robot Perception... ...learningOptimize model inference for GPU deployment, leveraging CUDA, TensorRT, and related acceleration... ...)C/C++ experience for performance-critical...SeniorPerformanceFull time- SF Tensor in San Francisco is hiring a Member of Technical Staff for GPU Kernel Engineering to push the limits of what the hardware can do before any search begins. You will hand-write and optimize kernels to achieve unprecedented throughput, profile at the microarchitectural...SeniorPerformanceRelocation package
- Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and usability around the clock for HP compute clusters across providers. You will collaborate...SeniorPerformance
- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...SeniorPerformance
- SF Tensor is building the ultimate GPU compiler and model factory. We hire researchers and engineers who want to drive end-to-end GPU compilation, MLIR dialect development... ...from relocation assistance and a path to-scale impact on AI compute performance. #J-18808-Ljbffr SF TensorSeniorPerformanceRelocation package
- Inferact Inc. is building a world-class GPU compute platform powering vLLM. We seek a hands-on cluster administration engineer to own the high-performance infrastructure that keeps our engineers productive. You will monitor GPU servers, manage scheduling with SLURM/Kubernetes...SeniorPerformanceRemote work
- ...of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving execution performance across various components. Ideal candidates should have strong software engineering skills and experience with ML inference systems...SeniorPerformance
- San Francisco Tensor Company is seeking a Member of Technical Staff for GPU Compiler Engineering to build the machine that searches and to optimize the entire pipeline from StableHLO ingestion to backend code generation. You will work on MLIR dialects, LLVM backend, and...Senior
- ...seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime... ...software, focusing on reliable long-running workflows, reproducible performance results, and secure handling of model and hardware data. This...SeniorPerformance
- An innovative company is seeking a talented software engineer to join their dynamic Inference team. This role involves designing and implementing infrastructure... ...for large-scale multimodal models, focusing on high-performance delivery of audio and image inputs. You'll collaborate...Performance
$315k
A leading AI research company in San Francisco is seeking a mid-senior GPU Performance Engineer. In this role, you'll architect systems that enhance GPU performance for groundbreaking AI models. Responsibilities include developing optimizations, collaborating with teams...Performance- ...experienced AI Infrastructure Engineer to design, deploy, and manage large-scale GPU clusters for AI training and inference workloads. You will... ...GPU utilization, tune NCCL, CUDA, UCX, and Slurm, and work... ...and software layers to push performance and scalability. This role...SeniorPerformance
- ...company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure)... ...role involves optimizing APIs, managing GPU workloads, and collaborating with... ...with TypeScript/Node, strong skills in performance tuning and distributed systems. This position...SeniorPerformance
- Sciforium is seeking a GPU Kernel Engineer to push performance on modern accelerators. You will design and optimize... ...used for large-scale training and inference. Ideal candidates have 5+ years in... ...strong C++/Python skills, and deep CUDA/ROCm expertise. Collaboration with...Performance
$100k - $120k
...foundation models. As training and inference workloads grow, we need kernel‑level... ...Responsibilities Lead a team of kernel and system engineers focused on performance-critical code Design, implement, and... ...kernels for CPU (AVX/ARM NEON), GPU (CUDA/ROCm), and hardware accelerators...Performance- ...build and operate the inference systems that serve... .... This is an engineering role, not a research... ...Own the performance characteristics of... ...WE'RE LOOKING FOR Senior ML systems engineer... ...Experience with GPU‑accelerated inference... ...following languages: C++, CUDA, ROCm or Triton...Performance
$175k - $250k
Global Inference Library Engineer Experience: Senior Level Salary: $175,000 - $250,000 per year Job Details... ...build and maintain a high-performance inference library designed to... ...Hands-on experience with CUDA, ROCm, Triton, or similar GPU/accelerator programming technologies...Performance$180k - $280k
...Since mid-2024, we've been engineering the foundation for what... ...role We're looking for a GPU kernel engineer with deep, low-level CUDA expertise to make our training and inference faster and more efficient... ...optimize, and maintain high-performance GPU kernels (e.g., in...PerformanceWork at officeVisa sponsorshipShift work- ...collaborate with software engineers, AI researchers, and... ...to develop high-performance solutions that meet the... ...Responsibilities Optimize end-to-end GPU performance for real-... ...) and neural network inference. Develop and optimize... ...technologies such as CUDA. Collaborate with...Performance
$175k - $250k
...artificial intelligence, high-performance computing, and specialized... ...We're looking for an engineer to help build and maintain a high-performance inference library designed to support... ...Hands-on experience with CUDA, ROCm, Triton, or similar GPU/accelerator programming technologies...PerformanceLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Performance Engineer — GPU & CUDA. Be the first to apply!
Related searches
- senior technical analyst San Francisco, CA
- senior associate attorney San Francisco, CA
- senior developer San Francisco, CA
- sr industrial security specialist San Francisco, CA
- senior aws cloud engineer San Francisco, CA
- senior manager business development San Francisco, CA
- remote senior salesforce administrator San Francisco, CA
- senior control systems engineer San Francisco, CA
- senior clinical trials manager San Francisco, CA
- senior marketing operations manager San Francisco, CA