Staff ML Performance Engineer — High-Throughput Inference
$180k - $250kfal
A tech company in San Francisco is looking for a Staff Software Engineer to enhance model performance for generative media models. The ideal candidate will design advanced model serving architectures, develop performance tools, and collaborate with the Applied ML team. Offering a competitive salary of $180,000 - $250,000 with equity and comprehensive health benefits, this position provides substantial growth opportunities. #J-18808-Ljbffr fal
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff ML Performance Engineer — High-Throughput Inference in San Francisco, CA vacancy
- ...to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern inference frameworks and a solid...Performance
- ...critic. You have a high bar for quality... ...networking , storage , performance , and scale . You'... ...with modern inference systems like TGI ,... ...infrastructure for high throughput and low latency at... ...current with ML infrastructure developments... ...requires a large engineering effort dedicated...PerformanceWork at office
- ...technology company in San Francisco is seeking a Founding Engineer specializing in ML Inference. This highly technical role requires expertise in the ML... ...infrastructure stack and aims to optimize generative media performance. The ideal candidate will drive innovations in real...PerformanceRelocation package
- Jaide Health is seeking an engineer for their Model... ...focuses on building reliable ML systems while enhancing core performance metrics across model execution... ...5 years of experience in high-performance coding, plus... ...and insights into the LLM inference ecosystem. A commitment...PerformanceRemote job
- ...new Machine Learning Engineer opportunities posted... ...optimize end-to-end ML pipelines... ...observability, and performance across all AI systems... ...environments to ensure high performance and low... ...tuning training and inference end-to-end for high throughput. Design data control...PerformanceFlexible hours
AI Chopping Block, Inc.
San Francisco, CA3 days ago $200k - $280k
...in the U.S. offers a role in research engineering. The position involves translating RL... ...production-grade systems with a focus on inference performance. Candidates need a strong foundation in ML systems, and experience with RL and high-performance computing is advantageous....Performance- Gravity Engineering Services Pvt Ltd. is seeking a Senior ML Engineer to optimize the model serving layer for voice workloads. This role involves working hands-on with inference engines to enhance model performance for speech applications. The ideal candidate will have...Performance
- ...intelligence. About the role As a ML Engineer, you’ll build and operate... ...push the boundaries of performance, interpretability, and... ...might work on Optimize inference and training throughput for novel model architectures Build and maintain high-performance distributed training...PerformanceFull timeInternship
- ...Francisco is seeking a talented individual to optimize model inference for their advanced visual AI product. The ideal candidate will... ...requires a strong background in PyTorch and a passion for pushing performance limits. Join a dynamic team focused on creating innovative AI...Performance
- A cutting-edge visual AI platform is seeking a talented individual to optimize model inference and enhance the core engine's performance. The ideal candidate is passionate about AI technology and has a strong background in production-level PyTorch. Responsibilities include...Performance
$200k - $350k
Inception in San Francisco is seeking engineers and scientists to design and optimize the compute foundations for AI models. The role includes developing high-performance ML kernels for significant operations and ensuring efficient low-precision arithmetic. A strong background...Performance- ...researchers and model engineers to translate ideas... ...is a hands‑on, high‑leverage role at... ...the intersection of ML, software... ...Will Own training/inference infrastructure: Design... ...friction. Optimize performance: Profile and improve... ...utilization, throughput, and distributed synchronization...PerformanceFull time
- An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-speech.... ...advanced serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience required,...Performance
- ...Overview We are seeking an Applied ML Engineer to productionize and scale machine learning... ..., and Platform teams to optimize inference performance, build evaluation pipelines, and... ...inference pipelines for low latency and high throughput Deploy and scale models using AWS‑...Performance
- ...researchers. We are seeking a Staff / Principal ML Ops Engineer to lead the design,... ...AI systems. This is a high-impact, architecture-defining... ...systems (monitor drift, performance, throughput, reliability, cost).... ...and accelerate training/inference pipelines. Establish ML...PerformanceLocal areaImmediate startRemote workRelocation package
- ...looking for a Member of Technical Staff focused on ML systems and inference in San Francisco. You will design... ...ensuring fast, predictable, and scalable performance. Key responsibilities include... ...strong foundations in software engineering, experience with ML inference systems...Performance
- ...looking for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and... ...scalable systems. You will be solving performance challenges in modern AI models... ...will possess strong software engineering fundamentals, experience with model...Performance
- ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves... ...allocation and improving execution performance across various components.... ...should have strong software engineering skills and experience with ML inference systems, particularly...Performance
- MakerMaker is seeking a talented Senior ML Systems Engineer to build and maintain production inference systems in San Francisco. This role requires at least 3... ...models, along with strong analytical skills in performance profiling and optimization. Your responsibilities...Performance
$135.2k - $306.4k
...Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on... ...autonomous workflows, scalable inference infrastructure, and... ...optimized for low latency, high throughput, GPU efficiency, reliability... ...including reliability, performance, security posture, cost...PerformanceTemporary workFlexible hoursOracle
San Francisco, CA5 days ago- ...seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice... ...will have over 5 years of ML engineering experience, strong Python... ...and the opportunity to be part of a high-impact team in a fast-growing product...
- ...Francisco is seeking an experienced Infrastructure Engineer to ensure 99.99% uptime while working with custom inference stacks and managing GPU loads. The ideal... ...role offers the opportunity to work on exciting projects with a highly skilled team. #J-18808-Ljbffr Morph
$300k - $400k
About the Role Principal AI/ML Engineer - AdTech Drive the... ...implementation of scalable, high‑performance, resilient ML solutions for... ...and training to real‑time inference—for bidding, targeting, and... ...experience designing high‑throughput, low‑latency distributed systems...Performance- DoorDash USA in San Francisco is searching for a senior engineer to lead the design and architecture of its Generative AI infrastructure. You will oversee the model serving stack, ensuring performance and reliability while mentoring your team. You should have a strong...PerformanceFlexible hours
$183k - $310k
...or need to be improved, engineers rely on data to... ...Role We're looking for a ML Platform Engineer with... ...reliability, scalability, and performance of the ML platform itself, from inference serving and pipeline... ...multimodal robotics data, high‑throughput retrieval and embedding...PerformanceRemote work- ...is building the best inference infrastructure for voice... ...looking for a Senior ML Engineer to drive the model serving... ...— pushing latency and throughput to the frontier. You'... ...hire on a small, high-impact team. Voice inference... ...Optimize inference performance for voice models (STT,...Performance
- ...Machine Learning Engineer to develop and deploy... ...problems where performance, reliability, and... ...Benchmark and profile inference performance,... ...improve latency, throughput, and power efficiency... ...production-grade ML systems Expertise... ...platforms Startup or high-growth engineering...PerformanceFlexible hours
- ...Our work focuses on three pillars: high‑performance, asynchronous, zero‑copy tensor and... ...is measured by raising both training throughput (how fast models train) and researcher... ...). About the Role As a Training: ML Framework Engineer, you will work on improving the training...PerformanceWork at officeRelocation package
- ...Learn more at About the Role As an ML / DevOps Engineer, you will play a pivotal role in... ...and networking required to process high‑throughput video data reliably and securely across... ...systems foundation by managing high‑performance Linux environments. You will architect...PerformanceWork at office
- ...reality. Role Overview We are seeking a ML/RL Engineer to join our Algo team and drive the... ...the optimization of our large‑scale, high‑throughput training environments to enable rapid... ...experience, with opportunities for performance bonuses and equity. Benefits: Comprehensive...PerformanceShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff ML Performance Engineer — High-Throughput Inference. Be the first to apply!
Related searches
- assistant chief engineer San Francisco, CA
- technology administrator San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant electrical engineer San Francisco, CA
- staff design engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- staff data engineer San Francisco, CA