Staff Engineer, Model Serving - Low-Latency AI Inference
Gravity Engineering Services Pvt Ltd.
Gravity Engineering Services Pvt Ltd. is seeking a Staff Engineer to design and build scalable systems for Databricks Model Serving. You will optimize performance and lead technical initiatives across CPU and GPU workloads. Ideal candidates have 10+ years of experience with distributed systems and a strong background in model serving and inference systems. This role offers opportunities for mentorship and collaboration with cross-functional teams. #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Model Serving - Low-Latency AI Inference in San Francisco, CA vacancy
- ...focused company in San Francisco seeks candidates with expertise in AI simulation development. The role emphasizes optimizing training efficiency, enhancing GPU performance, and ensuring low-latency inference. Applicants should be proficient in methodologies for gradient...Suggested
$190.9k - $232.8k
A leading data and AI company is seeking a Staff Software Engineer for GenAI inference to lead the architecture and optimization of the inference engine. The role requires expertise in CUDA, GPU programming, and distributed systems design. Ideal candidates will have a strong...Suggested- Baseten in San Francisco seeks an engineer to own the Model API surface for fast, reliable inference. You will optimize runtime... ...implement scalable, developer‑friendly serving experiences across multi‑GPU... ...contributing to a platform used by leading AI deployments. #J-18808-Ljbffr...Suggested
- ...'s best data and AI infrastructure platform... .... Foundation Model Serving is the API... ...frontier AI model inference for open source models... ...’re looking for engineers who have owned... ...at scale. As a Staff Engineer, you’ll... ...high-throughput, low-latency inference on GPU...Suggested
- About the Role As a Staff Engineer at Databricks, you will play a critical... ...infrastructure of Model Serving. You will design and build... ...that enable high-throughput, low-latency inference across CPU and GPU workloads... ...influence Databricks’ broader AI platform strategy. What We...Suggested
- Gravity Engineering Services Pvt Ltd. is seeking a Staff Engineer to design and implement core systems and APIs for Foundation Model Serving. The role is crucial for enabling high-throughput, low-latency inference on GPU workloads. Ideal candidates will have over 10 years...
$220k
We build and run the inference engine behind every Perplexity query and deploy dozens of model architectures at scale with tight latency and cost budgets. Our stack... ...tomorrow. Rust-native serving runtime. Develop our... ...model/tensor parallelism. Low-precision inference:...$150k - $300k
Prime Intellect is looking for a skilled ML Systems Engineer to build and optimize LLM serving infrastructure and inference systems. This hybrid role involves contributing... ...platforms, and a desire to work on cutting-edge AI infrastructure. They offer a cash compensation...Relocation package- ...San Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure. The ideal candidate will have solid...Visa sponsorship
- A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal...
- ...in healthcare. Our AI-powered platform was... ...technologists, and engineers working together to... ...of medicine—and the inference systems that power them... ...to lead and grow our Model Inference team. The... ...how our models are served: from architecting low-latency, high-throughput infrastructure...
$192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams...- Build the AI infrastructure layer of the physical world... ...Plus, our systems already serve Fortune 500 companies, schools... ...a founding core engineering team to build and train models that understand these systems... ...reliability, accuracy, and latency really matter. Unmatched...
- Sequen AI is leading the charge for building frontier ranking models for search and recommendations.... ...frontier AI models serve production traffic... ...for a Core Systems Engineer with a deep mastery... ...and compute complex inference logic with ultra-low latency. You will replace high...
$181.1k - $318.4k
Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge Platforms San Francisco... ...exciting Apple products serving millions of queries... ...every day with incredible low latencies, drawing every ounce... ...Research team to optimize inference for cutting edge model...Relocation$200k - $275k
...powers mission-critical inference for the world's most dynamic AI companies, like... ...bring cutting-edge models into production. We... ...build the platform engineers turn to to ship AI... ...distributed systems, model serving, and developer... ...record of owning low‑latency, reliable backend...Flexible hours$325k
About the Team Our Inference team brings OpenAI's most capable research... ...access our start-of-the-art AI models, allowing them to do things... ...Role We are looking for an engineer who wants to take the world'... ...for use in a high-volume, low-latency, and high-availability...$166k - $225k
...the world's best data and AI infrastructure platform so... ...their business. Databricks’ Model Serving product provides enterprises... .... It offers real-time, low-latency inference, governance, monitoring, and... ...cost efficiency. As a Senior Engineer, you’ll play a critical...Local areaWorldwide- Jaide Health is seeking an engineer for their Model Efficiency team in San Francisco. The role focuses on building reliable ML systems while... ...strong skills in C++ or Python and insights into the LLM inference ecosystem. A commitment to diversity and inclusive work culture...Remote job
$298k - $368k
...a diverse set of sensors, enabling engineers like you to (1) develop methods for... ...scale real-world data, to (2) develop models and model training at scale, to (3)... ...foundation models). Proven expertise in low-latency on-device inference techniques and a deep understanding...Full timeRemote work- ...for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and... ...challenges in modern AI models and collaborating with various... ...possess strong software engineering fundamentals, experience with model serving, and proficiency in...
- About Liquid AI Spun out of MIT CSAIL, we build general... ...hardware, ensuring low latency, minimal memory usage, privacy... ...Opportunity Our Edge Inference team compiles Liquid Foundation Models into optimized machine... ...proficiency Embedded software engineering experience or work on...
$215k - $265k
...been at the forefront of AI and high-performance... ...experienced Senior Staff Engineer specializing in AI Data... ...with next-generation AI inference pipelines. This role... ...Platform to enable ultra-low-latency, high-throughput data... ...systems, LLM serving architectures, and KV...Local area- Mixpeek in San Francisco seeks an inference researcher to advance end-to-end LLM serving, from kernels to autoscaling.... ...research lead and customer-facing engineers. You will work with external... ...impacting cost per token and tail latency. In-person work in our SF office...Work at office
$200k - $400k
A leading AI technology company located in San Francisco is seeking an infrastructure engineer to build distributed systems for their AI inference engine. The role involves designing systems that ensure minimal latency and maximum reliability. Candidates should have a...Visa sponsorship$220k - $320k
...Help us make inference blazingly fast. If you... ...specialized language models for companies that... ...frontier-quality AI at a fraction of... ...ten‑person team of engineers who work in‑person... ...with the goal of serving models faster and... ...inference performance: latency, throughput, cost...Work at officeSolana Foundation
San Francisco, CA4 days ago- ...seeking a Member of Technical Staff focused on ML Systems & Inference in San Francisco, California. This... ...systems that improve latency and efficiency for production AI workloads. The ideal candidate has strong software engineering roots and experience in inference...
- ...scale intelligence to serve humanity. We’re... ...deploying frontier models for developers and... ...enterprises who are building AI systems to power... ...of researchers, engineers, designers, and... ...systems can do — but inference is still the bottleneck... ...locations. As a Staff Research Engineer,...Full timeWork at officeRemote workFlexible hours
- A leading AI research company in San Francisco is seeking a Staff Research Engineer to enhance the efficiency of large language models. In this role, you will develop and implement advanced techniques... ...with model architecture and inference optimization. Join a diverse team...Remote work
$200k - $220k
...ARE Zeta Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that leverages... ...Zeta Global is seeking a highly skilled Staff Software Engineer to serve as a technical leader within our MIP/... ...technical direction for high‑volume, low‑latency programmatic AdTech (DSP) systems and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Model Serving - Low-Latency AI Inference. Be the first to apply!
Related searches
- assistant chief engineer San Francisco, CA
- technology administrator San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant electrical engineer San Francisco, CA
- staff design engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- staff data engineer San Francisco, CA