Model APIs Engineer - High-Performance Inference
$200k - $275kBaseten
A cutting-edge AI technology firm in San Francisco is seeking a talented individual to join their Model Performance team. This role focuses on developing Model APIs that enhance inference capabilities for AI applications. Ideal candidates will have over 3 years of experience in distributed systems and large-scale APIs, alongside strong debugging and profiling skills. The company offers a competitive salary range of $200K - $275K, excellent benefits including comprehensive health coverage, generous PTO, and opportunities for growth within the AI sector. #J-18808-Ljbffr Baseten
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Model APIs Engineer - High-Performance Inference in San Francisco, CA vacancy
$325k
...leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal... ...involves collaboration with researchers and focus on performance optimization. Compensation ranges from $325K to $4...Performance- ...technologists, and engineers working together... ...medicine—and the inference systems that power... ...lead and grow our Model Inference team. The... ...architecting low-latency, high-throughput... ...You’ll lead a high-performing team of AI inference... ...’s products and APIs Own the technical...Performance
$200k - $275k
...mission-critical inference for the world's most... ...cutting-edge models into production. We... ...build the platform engineers turn to to ship AI... ...Baseten’s Model Performance (MP) team is responsible... ...ll focus on Model API's — the... ...’ll join a small, high‑impact team operating...PerformanceFlexible hours- Baseten in San Francisco is seeking a GPU Kernel Engineer to enhance AI acceleration by designing high-performance GPU kernels. This role involves optimizing ML operations, utilizing CUDA and various performance profiling tools. Candidates should have a strong understanding...Performance
$130k - $180k
...Title Forward Deployed Engineer Salary $130k-$180k + Equity... ...Synth AI Labs Inc. (Infer) is a YC-backed startup... ...agents. This is a high‑autonomy role where you... ...that ensure high‑fidelity performance across thousands of calls... ...‑engineering legacy APIs or undocumented systems...Performance- Machine Learning Engineer, Inference Want to solve realtime inference... ...focused on wrapping APIs or building... ...state-of-the-art speech models actually behave correctly... ...operates beyond the performance of most publicly... ...schedulers would be highly valuable. The environment...PerformanceRemote jobFlexible hours
- Jaide Health is seeking an engineer for their Model Efficiency team in San Francisco... ...while enhancing core performance metrics across model execution... ...5 years of experience in high-performance coding, plus strong... ...and insights into the LLM inference ecosystem. A commitment to...PerformanceRemote job
- ...Our mission is to build highly scalable and efficient infrastructure... ...an expert in high‑performance LLM serving systems and inference optimization. In this... ...boundaries of how large language models are served. What You’ll... ...major inference engines such as SGLang, vLLM, or...Performance
NEAR.AI
San Francisco, CA2 days ago $325k
About the Team Our Inference team brings OpenAI's most... ...our start-of-the-art AI models, allowing them to do... ...to before. We focus on performant and efficient model... ...We are looking for an engineer who wants to take the... ...optimize them for use in a high-volume, low-latency,...Performance- ...innovative company is seeking a talented software engineer to join their dynamic Inference team. This role involves designing and implementing infrastructure for large-scale multimodal models, focusing on high-performance delivery of audio and image inputs. You'll...Performance
- ...date. About the role As a Distributed LLM Inference Engineer, you will help with systems and optimizations that push the boundaries of performance for inference at large scale. This is an... ...for Batch and Online inference at high scale which will be used by open-source...PerformanceWork at office
Anyscale
San Francisco, CA4 days ago - Gravity Engineering Services Pvt Ltd. is looking for an Inference Frameworks and Optimization Engineer to enhance the performance of AI infrastructure. This role involves... ...support multimodal models, optimizing frameworks for low-latency and high-throughput performance....Performance
$230k - $385k
OpenAI is seeking a highly motivated developer productivity engineer to enhance workflows and collaboration within engineering teams. This role is focused on building developer tools, improving CI/CD processes, and ensuring an efficient testing environment. The ideal candidate...Performance$225k
Magic is hiring a Kernel Engineer in San Francisco to design and maintain high-performance kernels that optimize throughput and latency during AI training and inference. The ideal candidate has low-level programming expertise, particularly for AI accelerators like NVIDIA...Performance- Liquid AI seeks exceptional engineers to optimize on-device AI workloads, shipping production code for edge devices and contributing... ...like llama.cpp. You will work with ML researchers to push model performance within constrained hardware resources. Ideal candidates have...Performance
- ...experienced professional in GPU Optimization and Inference Acceleration. The role involves enhancing product performance through CUDA programming and developing... ...background in GPU optimization, deep learning, and high-performance coding in C/C++. This is a full-time...PerformanceFull time
- ...Francisco is seeking an expert in high-performance LLM serving systems and inference optimization. In this role, you will... ...boundaries of how large language models are served. You will architect and... ...-on experience with inference engines such as SGLang, vLLM or TensorRT,...Performance
- Mirai Labs in San Francisco seeks engineers to join a senior team building... ...will primarily work on uzu, our inference engine, and focus on supporting... ...how computers and modern language models work, and experience in writing high-performance GPU kernels or Rust systems...PerformanceLocal area
- ...ROLE You build and operate the inference systems that serve our models in production. The work spans... ...running real workloads. This is an engineering role, not a research role. You... ...serving large models at high throughput Own the performance characteristics of those systems...Performance
- ...enable efficient and scalable inference for large language models (LLMs). Our mission is to... ...pushing the boundaries of performance, scalability, and cost-... ...Frameworks and Optimization Engineer to design, develop, and... ...will focus on low-latency, high-throughput inference, GPU/...Performance
- ...and deploying frontier models for developers and... ...energized by building high-performance, scalable and reliable... ...for a Site Reliability Engineer to join the Model Serving... ...through easy to use API endpoints. In this role... ...latency and throughput of inference. Strong understanding...PerformanceFull timeWork experience placementWork at officeRemote workFlexible hours
- ...and unicorn founders and senior engineers with deep expertise in 3D, generative... ...for a Founding Engineer, ML Inference with deep expertise in high-performance ML engineering. This is a highly... ...performance from generative media models. You'll work across the model-serving...PerformanceRelocationVisa sponsorshipRelocation package
$190k - $250k
...generation multimodal AI models and a proprietary, high‑efficiency serving platform... ...‑on support from AMD engineers the team is scaling rapidly... ...Distributed Training and Inference Engineer to build, optimize... ..., and optimizing performance at every layer of the ML...PerformanceFlexible hours$167.2k - $209k
...applications. We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this role,... ..., developing, and delivering high-scale, resilient data plane... ...customers can deploy and scale their models with industry-leading performance and reliability. This is a...PerformanceLocal areaRemote workWorldwideFlexible hours- Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background... ...parallel frameworks, and a strong track record in high-performance systems. This role is full-time and on-...PerformanceFull time
- ...proprietary visual intelligence engine with full spatial reasoning,... ...’ll Do As a Vision Language Model Engineer, you will design,... ...production systems. Optimize model performance for accuracy, latency, and... ...opportunities from a highly diverse and talented peer group...PerformanceFlexible hours
- .... Working across the entire model stack, we integrate cutting-... ...strive to seamlessly blend high-level AI capabilities with the... ...We’re looking for a GPU Inference Engineer to contribute to improvements... ...initiatives to optimize inference performance and scalability. You’ll also...PerformanceWork at officeRelocation package
- Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while...Performance
- Gravity Engineering Services Pvt Ltd. is seeking a Staff Engineer to design and... ...scalable systems for Databricks Model Serving. You will optimize performance and lead technical initiatives across... ...background in model serving and inference systems. This role offers...Performance
$225k
Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and ensuring high reliability for RL and post-training workflows. The ideal candidate...Performance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model APIs Engineer - High-Performance Inference. Be the first to apply!
Related searches
- application performance engineer San Francisco, CA
- acting performance San Francisco, CA
- performance coach San Francisco, CA
- performance test architect San Francisco, CA
- lead performance test engineer San Francisco, CA
- performance test engineer San Francisco, CA
- performance engineer San Francisco, CA
- performance improvement consultant San Francisco, CA
- senior performance engineer San Francisco, CA
- senior performance tester San Francisco, CA