LLM Inference Optimization Engineer - Frontier Performance
GMI Cloud, Inc
GMI Cloud, Inc is hiring world-class Machine Learning Engineers to advance LLM inference optimization leveraging GPUs and cutting-edge techniques. You will drive research, validation, and productionization of optimization strategies across NV platforms, with a focus on speed, efficiency, and scalability. You will collaborate with platform and infrastructure teams, contribute to open-source projects, and help define recipes and benchmarks for industry-leading inference performance. #J-18808-Ljbffr GMI Cloud, Inc
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Inference Optimization Engineer - Frontier Performance in San Francisco, CA vacancy
$170k - $245k
...NEA, and Addition with $250+ million raised to date.About the roleAs a Distributed LLM Inference Engineer, you will help systems and optimizations that push the boundaries of performance for inference at large scale. This is an incredibly critical role to Anyscale as it...PerformanceWork at officeAnyscale
San Francisco, CA4 days ago- ...and systems that push the frontier of visual intelligence, along... ...investors. Researchers and engineers at Hedra work closely... ...Role We’re looking for an Inference Optimization Engineer to work alongside... ...gone unusually deep on model performance, GPU systems, or efficient...PerformanceWork at office
US Health Partners, LLC
San Francisco, CA3 days ago - ...and advance our serverless inference benchmarks. You will cover endpoints... ...with neoclouds to measure performance. You will analyze throughput... ...shaping the roadmap with engineers and the pillar lead. This... ...offers front-row exposure to frontier AI and equity compensation....Performance
- ...Forward Deployed Engineer (Inference) Location: San Francisco, CA Employment... ...systems that automatically optimize inference workloads across... ...About the Role Inference performance depends on far more than... ...deployment. Understanding of LLM inference fundamentals,...PerformanceFull time
Acceler8 Talent
San Francisco, CA4 days ago - ...alternative chips. Inference is fragmenting: purpose... .... Our customers are frontier labs, fast-growing AI... ...backlog. As a founding engineer, you'll help decide what... ...experience with LLM inference serving — request... ...to reason about performance at the hardware level,...Performance
General Compute
San Francisco, CA2 days ago $180k - $225k
...transformation through frontier AI systems that solve... ...remains one of the hardest engineering challenges.As a... ...datasets, regression suites, LLM-as-a-Judge, and human... ...models, or model optimization.Familiarity with multimodal... ..., interview performance, and relevant education...PerformanceFull timeScale AI
San Francisco, CA3 days ago- Anthropic is seeking a Performance Engineer for its Inference Engine to optimize LLM processing across accelerator and cloud platforms. You will work on throughput, latency, and cost, ensuring robust, scalable performance from host to device and across chips. Experience...Performance
- ...role You'll own the cost and performance of our inference stack. Your work will... ...'ll work closely with the engineers operating the serving fleet... ...decoding, and kernel-level optimization. Success means improving throughput... ..., SGLang, and TensorRT-LLM, going below the framework...PerformanceFlexible hours
- ...of committed researchers, engineers, policy experts, and business... ...beneficial AI systems. Performance Engineer, Inference Engine About the Role Anthropics... ...will work on building and optimizing this system at Anthropics... ...A working mental model of LLM inference: how prefill and...Performance
- ...unicorn founders and senior engineers with deep expertise in... ...Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is... ...inference frameworks, optimizing inference performance,... ...You'll Do Drive our frontier position on real-time model...PerformanceRelocationVisa sponsorshipRelocation package
- ...act in real time. The Inference team builds the systems... ...scale. As a Software Engineer on Inference, you’ll... ...capacity and quota, and optimizing for latency,... ...you’ll do Partner with frontier labs and providers. At... ...quota that keep inference performant and available across large...PerformanceFull timeFlexible hours
$300k
...GPU Optimisation Engineer — Real-Time Inference Want to push GPU performance to its limits — not in theory, but in production systems handling real-time speech and... ...with attention kernels, decoding paths, or LLM‑style runtimes Comfort profiling with low‑level...PerformanceRelocationVisa sponsorshipFree visatechire ai
San Francisco, CA2 days ago$200k - $300k
...from AI research to systems engineering to product design —... ...Overview We are looking for a Performance Engineer to make World Labs... ...low‑level tensor and kernel optimization to fleet‑wide serving efficiency... ...You Will Do: Optimize inference and serving end to end —...PerformanceWORLD LABS
San Francisco, CA2 days ago- ...Francisco building state-of-the-art visual models and the infrastructure to deploy them at scale. We seek an Inference Optimization Engineer to push model performance at inference time, working at the boundary between research and systems. You’ll collaborate with...Performance
- World Labs in San Francisco is hiring a Performance Engineer to accelerate training and serving of large world models. You will identify bottlenecks across kernels, serving paths, and GPUs, then implement concrete improvements that raise throughput and lower latency. You...Performance
- ...Administrator / DevOps Engineer, you will maintain and... ...model training and our inference cloud. You’ll split your... ...training throughput, and the performance and reliability of our... ...and workload optimization Experience deploying and operating LLM serving stacks (e.g., vLLM...PerformanceWork at officeRemote workRelocation package
Linuxconfig
San Francisco, CA1 day ago - ...are the first AI inference neocloud, using ASIC... ...time. When a frontier model drops, the... ...Correctness first, optimization second: get it right... ...— a frontier LLM, an MoE, a multimodal... ...bringup, or high-performance kernels. ~ You’... ...that did real engineering work, not demos....PerformanceLive in
General Compute
San Francisco, CA2 days ago - ...combines world-class researchers, engineers, designers, and operators... ...focused on on-device inference, you will design, develop, and... ...model fitting, scheduling, and performance and power management. You'll... ...integration, and memory optimization to meet memory, compute, and...Performance
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning, enabling reliable, scalable inference across production...Performance
$161.3k - $241.9k
...operate. By combining frontier agentic AI, an... ..., every model inference, and every production... ...for a Production Engineer to help build and... ...reliability, and performance. Improve... ...rightsizing, workload optimization, and utilization... ...AI/ML or LLM infrastructure at...PerformanceHarvey
San Francisco, CA2 days ago$250k - $350k
...into production that performs when it matters... ...focused on pushing the frontier of what agentic... ...model and systems optimization, and applied... ...Learning Research Engineer, you will operate... ...training/fine-tuning, inference, memory and retrieval... ...training methods, LLM alignment, or...PerformanceFull timeScale AI
San Francisco, CA6 days ago- ...San Francisco is seeking a Cloud Inference Engineer to scale and optimize Claude across AWS, GCP, and Azure.... ...will own validation, deployment, and performance of inference servers and load... ...with cross-functional teams to push frontier models into production. #J-18808-...Performance
$150,000 - $200,000 per week
...PurposeThe Forward Deployed Engineer works directly with... ...design, deploy, and optimize GenAI data solutions,... ...accuracy, reliability, and performance requirements for GenAI... ...data, including LLM training, annotation,... ...quality AI solutions for frontier models.You’ll work on...PerformancePermanent employmentFull timeWork at office2 days per weekAppen
San Francisco, CA5 days ago- ...Staff - Kernels & GPU Performance Location: San Francisco... ..., efficient AI inference across heterogeneous hardware... ...challenges spanning frontier models, production... ...Staff, you will build and optimize the low-level... ...and distributed-systems engineers. What You’ll Do...PerformanceFull time
Acceler8 Talent
San Francisco, CA4 days ago - ...Technical Staff - Compiler Engineer Location: San... ...for fast, efficient AI inference across heterogeneous... ...on problems spanning frontier models, production infrastructure... ...are represented, optimized, and executed across... ..., memory systems, and performance characteristics....PerformanceFull time
Acceler8 Talent
San Francisco, CA4 days ago $190.9k - $334.1k
...DescriptionIt all started when engineer Fred Luddy wrote code... ...robustness, performance, safety, and real-world... ...decisions with context no frontier model has on its own.Trust... ...or retrieval.Exposure to LLM fine-tuning or inference optimization in production.Why join usIntelligence...PerformanceWork experience placementWork at officeImmediate startRemote workFlexible hoursServiceNow
San Francisco, CA1 day ago- ...support from AMD engineers the team is scaling... ...stack powering frontier AI models and real... ...-managed, high-performance infrastructure.... ...enabled Kubernetes for inference workloads —... ...Maintain curated, optimized PyTorch and JAX environments... ...Server, TensorRT-LLM) for latency and...PerformanceFlexible hours
Sciforium
San Francisco, CA2 days ago $160k - $240k
...GTM Engineer As a GTM Engineer at Applied Compute... ...selection, training, inference, and integration Qualifications... ...reliable software and LLM automations or leading... ..., skills, interview performance, market data, and work... ...team pushes the frontier of post-training and...PerformanceFull timeWork at officeVisa sponsorshipRelocation packageFlexible hoursApplied Compute
San Francisco, CA5 days ago- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference... ...deep Rust experience, proficiency in network protocols, and a track record of optimizing performance #J-18808-Ljbffr CloudFlarePerformance
- ...Netic is the AI revenue engine for essential services... ...Harvard in bringing frontier AI to the physical economy... ...with strong performance. Run rapid experiments... ...Hands-on experience with LLM, TTS and speech APIs,... ..., resolve issues, and optimize systems for speed and...PerformanceImmediate startSleeping nights
Netic
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Inference Optimization Engineer - Frontier Performance. Be the first to apply!
Related searches
- senior performance engineer San Francisco, CA
- performance improvement specialist San Francisco, CA
- performance specialist San Francisco, CA
- high performance computing engineer San Francisco, CA
- performance food group San Francisco, CA
- performance engineer San Francisco, CA
- performance testing San Francisco, CA
- sports performance coach San Francisco, CA
- system performance engineer San Francisco, CA
- performance improvement consultant San Francisco, CA