GPU Performance Engineer: Scale AI Inference
$315kAnthropic
A leading AI research company in San Francisco is seeking a mid-senior GPU Performance Engineer. In this role, you'll architect systems that enhance GPU performance for groundbreaking AI models. Responsibilities include developing optimizations, collaborating with teams, and troubleshooting performance issues. The position offers a competitive salary range of $315,000—$560,000, equity opportunities, and a supportive work environment that values communication and collaboration. #J-18808-Ljbffr Anthropic
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GPU Performance Engineer: Scale AI Inference in San Francisco, CA vacancy
- Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and... ...the bleeding edge of AI performance. This role is based on-site...Performance
- ...seeking a talented software engineer to join their dynamic Inference team. This role involves designing... ...infrastructure for large-scale multimodal models, focusing on high-performance delivery of audio and image... ...to push the boundaries of AI technology, ensuring reliable...Performance
- Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates have...PerformanceFull time
- Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open...Performance
- Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding...Performance
- Gravity Engineering Services Pvt Ltd. is searching for an engineer to design, build, and operate a GPU supercomputing environment. You'll automate large GPU clusters and write... ...cluster management, contributing to high-performance computing. The ideal candidate should...Performance
- ...About Us Vast.ai’s cloud powers AI projects and businesses... ...excellence. We seek engineers with strong intrinsic drive... ...programming experience to help scale AI inference. You’ll leverage your knowledge of high-performance systems to optimize GPU performance at the bleeding...PerformanceFull timeWork at office
Vast
San Francisco, CA1 day ago $167.2k - $209k
...DigitalOcean is expanding its AI Infrastructure layer... ...seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In... ...and delivering high-scale, resilient data... ...industry-leading performance and reliability. This... ...Interconnects: Understanding of GPU‑level optimisation...PerformanceLocal areaRemote workWorldwideFlexible hours- ...powers mission-critical inference for the world's most dynamic AI companies, like... ...build the platform engineers turn to to ship AI... ...multi-modal workloads scale, the network is the... ...to lead our GPU Networking efforts,... ...validate networking performance on bleeding-edge clusters...PerformanceFlexible hours
- ...leading investment firm in San Francisco is looking for an experienced professional in GPU Optimization and Inference Acceleration. The role involves enhancing product performance through CUDA programming and developing essential tooling. Ideal candidates will have a...PerformanceFull time
$220k - $320k
inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques...Performance- Mirai Labs in San Francisco seeks engineers to join a senior team building the full on-device... .... You will primarily work on uzu, our inference engine, and focus on supporting new... ...models work, and experience in writing high-performance GPU kernels or Rust systems programming. We...PerformanceLocal area
$325k
A leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal candidate... ...collaboration with researchers and focus on performance optimization. Compensation ranges from $325K to $4...Performance- ...Our mission is to scale intelligence to serve... ...who are building AI systems to power... ...by building high-performance, scalable and reliable... ...Site Reliability Engineer to join the Model... ...Kubernetes, and GPU workloads on those... ...and throughput of inference. Strong understanding...PerformanceFull timeWork experience placementWork at officeRemote workFlexible hours
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while...Performance
$225k
...Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco.... ...distributed systems, optimizing performance, and ensuring high reliability for RL... ...fundamentals and experience with large-scale systems. Compensation includes a...Performance- ...talented Senior ML Systems Engineer to build and maintain production inference systems in San Francisco... ...for large-scale models, along with strong analytical skills in performance profiling and optimization... ...and has experience with GPU-accelerated inference. Enjoy...Performance
- A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying... ...GPU systems for high-throughput inference and model performance optimization. The ideal...Performance
- ...generation of enterprise AI infrastructure. As a Staff AI Infrastructure Engineer, you will design, build, and... ...that enable large‑scale training, serving, evaluation... ...distributed systems, Kubernetes, GPU infrastructure, high‑performance inference, and enterprise AI...Performance
- Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply... ...systems, networking and runtime performance. Shape both the platform and the engineering... ...s faster, more efficient and built to scale. You’ll be: Building and optimising...Performance
- ...NEAR AI was started by Illia Polosukhin, co... ...source AI at a global scale. We are specifically... ...an expert in high‑performance LLM serving systems and inference optimization. In this... ...major inference engines such as SGLang, vLLM... ...of state‑of‑the‑art GPU architectures, and effectively...Performance
NEAR.AI
San Francisco, CA2 days ago - Lightning AI is seeking a Lead Research Engineer in San Francisco to optimize infrastructure for training and inference workloads. This role involves working on performance improvements across ML systems and collaborating... ...experience with large-scale workloads. The position...PerformanceFlexible hours
$250k
...opportunities? Join a rapidly scaling AI cloud infrastructure... ...a next-generation GPU platform designed for... ...experimentation, and inference at scale. The company... ...Site Reliability Engineer to support and scale large... ...reliability, scalability, and performance of HPC and cloud...PerformancePermanent employmentRemote work$350k
Mirendil is looking for engineers to build infrastructure for frontier reasoning models at... ...Francisco location. This role focuses on large-scale reinforcement learning (RL) model... ...reliable training infrastructure, implement performance optimizations, and develop evaluation...Performance$220k - $320k
A tech startup specializing in AI inference seeks a skilled professional to optimize their inference stack. Candidates should have over 2 years of experience in ML systems, fluency in Python, and hands-on experience with LLM frameworks. The role offers competitive compensation...PerformanceLocal area- ...build and operate the inference systems that serve our... ...workloads. This is an engineering role, not a research... ...high throughput Own the performance characteristics of... ...production-grade, large-scale serving infrastructure... ...change Experience with GPU-accelerated inference...Performance
$300k
GPU Optimisation Engineer — Real-Time Inference Want to push GPU performance to its limits — not in theory, but in production systems handling... ...team is building low-latency AI systems where milliseconds... ...runtime layers, profiling large-scale speech and multimodal models...PerformanceRelocationVisa sponsorshipFree visa$130k - $180k
Job Title Forward Deployed Engineer Salary $130k-$180k + Equity Company Synth AI Labs Inc. (Infer) is a YC-backed startup that has raised ~$6M from Stellaris Venture... ...prompt improvements that ensure high‑fidelity performance across thousands of calls. The ideal...Performance- Machine Learning Engineer, Inference Want to solve realtime inference... ...a fast-growing voice AI company building the... ...used at massive scale across customer support... ...inference, scheduler design, GPU utilisation,... ...already operates beyond the performance of most publicly available...PerformanceRemote jobFlexible hours
- ...Role At Together.ai, we are building state... ...and scalable inference for large language... ...the boundaries of performance, scalability, and... ...and Optimization Engineer to design, develop... ...language models at scale. This role will focus... ...throughput inference, GPU/accelerator...Performance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Performance Engineer: Scale AI Inference. Be the first to apply!
Related searches
- application performance engineer San Francisco, CA
- acting performance San Francisco, CA
- performance coach San Francisco, CA
- performance test architect San Francisco, CA
- lead performance test engineer San Francisco, CA
- performance test engineer San Francisco, CA
- performance engineer San Francisco, CA
- performance improvement consultant San Francisco, CA
- senior performance engineer San Francisco, CA
- senior performance tester San Francisco, CA