Staff Engineer, AI Inference & Distributed Systems
Sail Research
Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing on deep observability of our systems. The ideal candidate has a strong background in distributed systems and is eager to engage in complex challenges. Enjoy a vibrant work environment with excellent meals and a collaborative team atmosphere. #J-18808-Ljbffr Sail Research
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, AI Inference & Distributed Systems in San Francisco, CA vacancy
- ...in San Francisco is seeking a Member of Technical Staff to design and build distributed systems for AI workloads. The role involves developing scheduling... ...APIs. Ideal candidates should have strong software engineering skills and experience with distributed systems. This...Suggested
- ...Talent is seeking a Member of Technical Staff focused on ML Systems & Inference in San Francisco, California. This role includes... ...latency and efficiency for production AI workloads. The ideal candidate has strong software engineering roots and experience in inference systems...Suggested
$150k - $350k
...Inc. is seeking a Member of Technical Staff to focus on distributed systems in San Francisco, California. This... ...and building the core platform for AI workloads, developing resource management... ...should have strong software engineering fundamentals and experience with distributed...Suggested- Harrison Clarke is working with a high-growth startup in San Francisco seeking a Staff Distributed Systems Engineer. This hands-on role involves designing and building core systems for a cutting-edge AI code generation product. The ideal candidate will have excellent coding...Suggested
- Tubi is looking for a Staff Software Engineer in San Francisco to define architectural direction and mentor engineers. The... ...experience in backend development and designing distributed systems. With a strong emphasis on AI integration, this hybrid position involves contributing...Suggested
$200k - $400k
A leading AI technology company located in San Francisco is seeking an infrastructure engineer to build distributed systems for their AI inference engine. The role involves designing systems that ensure minimal latency and maximum reliability. Candidates should have a...Visa sponsorship- Gravity Engineering Services Pvt Ltd. is seeking a Staff Engineer to design and build scalable systems for Databricks Model Serving. You will optimize... ...years of experience with distributed systems and a strong... ...background in model serving and inference systems. This role offers...
$150k - $250k
Asari AI in San Francisco is looking for a skilled individual to build the supercomputing infrastructure that runs AI agents,... ...performance workloads. Your role will involve designing cloud compute, distributed systems, and sandboxed tooling to ensure efficiency and scalability....$200k - $280k
A research-driven AI company in the U.S. offers a role in research engineering. The position involves translating RL algorithms into production-grade systems with a focus on inference performance. Candidates need a strong foundation in ML systems, and experience with RL...$225k
Dormont Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and ensuring high reliability for RL and post-training workflows. The ideal candidate...$190.9k - $232.8k
A leading data and AI company is seeking a Staff Software Engineer for GenAI inference to lead the architecture and optimization of the inference engine. The... ...requires expertise in CUDA, GPU programming, and distributed systems design. Ideal candidates will have a strong...- Sequen AI is leading the charge for building frontier... ...advances in AI into systems that are reliable,... ...looking for a Core Systems Engineer with a deep mastery of... ...and compute complex inference logic with ultra-low... .... Debug complex distributed system deadlocks, race...
$350k
Mirendil in San Francisco is searching for an engineer to develop and optimize inference systems for cutting-edge AI models. You will handle the complete inference stack, enhancing performance and reliability. The role involves partnering with teams to deploy new architectures...$150k - $300k
Prime Intellect is looking for a skilled ML Systems Engineer to build and optimize LLM serving infrastructure and inference systems. This hybrid role involves contributing... ...platforms, and a desire to work on cutting-edge AI infrastructure. They offer a cash compensation...Relocation package- B Capital is seeking a skilled engineer for GPU infrastructure in San Francisco. This... ...designing and operating high-performance systems for model inference, synthetic data generation, and... ...a passion for working in cutting-edge AI. Benefits include top-tier compensation...
$220k
We build and run the inference engine behind every Perplexity query and deploy dozens of model... ...CUTLASS, or similar). Any other deep systems programming experience is a plus. You... ...You've built and operated production distributed systems under real load - ideally performance...$200k - $400k
Clera, a well-funded AI and robotics startup in San Francisco, seeks a Senior Engineer to tackle challenging problems in AI. You’ll design custom database systems, implement LLM token management, and develop Unix OS distributions. Ideal candidates have strong skills in...Visa sponsorship$190k - $230k
...intelligence. As the only vertically integrated AI infrastructure company built from the... ...This Role We’re seeking a Senior Staff Systems Engineer to play a key role in executing Crusoe... ...Experience designing scalable, distributed systems in cloud environments (AWS, GCP...Temporary work$280k
...experienced Infrastructure Engineers to join our team and support... ...maintenance of our cutting-edge AI systems. By joining our... ...tech lead Are obsessed with distributed systems at scale, infrastructure... ...policy: Currently, we expect all staff to be in one of our offices...Work at officeHome officeVisa sponsorshipRelocation package- About Liquid AI Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from... .... The Opportunity Our Edge Inference team compiles Liquid Foundation... ...proficiency Embedded software engineering experience or work on resource‑...
- About Liquid AI Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from... ...team is building the distributed systems that power our next-generation... ...priorities and delivers: Our best engineers align with team priorities...
- ...for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and optimizing scalable systems. You will be solving... ...performance challenges in modern AI models and collaborating... ...possess strong software engineering fundamentals, experience...
$350k
Anthropic is seeking a Research Engineer in San Francisco, CA to identify and resolve... ...model capabilities and implementing distributed training systems. The position offers an annual salary... ...location-based policy requiring staff presence in the office at least 25% of...Work at office$200k - $275k
...World. TRM Labs provides AI-powered intelligence... ...more secure. The AI Engineering Team is chartered with... ...Models (LLMs) and agentic systems. Our mission is to... ...market. As a Senior or Staff ML Systems Engineer -... ..., TRM operates as a distributed-first company with hubs...Remote workWorldwide$140.6k - $173.1k
...Team/Role We are seeking a seasoned Staff Software Engineer in the North America Mobility organization... ...team that focuses on building AI Platform to support the feature development... ...at the vanguard of generative AI, distributed systems, and fintech, you will empower WEX to...Remote workFlexible hours$225k - $300k
Staff / Senior Engineer San Francisco, CA · On-site (5 days) · Full... ...-based, seed-stage AI startup helping enterprises... ...person defining the system, not a senior IC... ...models, agent frameworks, inference optimization, tool... ...depth (Kubernetes, distributed systems, cloud) a plus...Full timeLive inImmediate start- ...is seeking an experienced data-minded software engineer or data scientist to advance evaluation in the Planner... ...Manager and focuses on building robust AI evaluation frameworks and production-ready agent-based systems for autonomous driving software. You will design...
- WEX, Inc. is seeking a Staff Engineer to lead design and development efforts across multiple systems while championing integrated engineering practices. The ideal candidate... ...delivery principles, and implementing advanced AI workflows that address complex business challenges...
$200k - $400k
Inferact is looking for a Developer Relations Engineer in San Francisco, California, to help developers utilize vLLM for AI inference. This unique role involves teaching technical concepts, creating educational content, and engaging with the AI infrastructure community....Remote work$350k
Mirendil, based in San Francisco, is searching for an engineer to work at the intersection of research and systems on their pretraining stack. The role involves implementing model architectures and scaling distributed training jobs across thousands of GPUs. We offer a...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, AI Inference & Distributed Systems. Be the first to apply!
Related searches
- assistant chief engineer San Francisco, CA
- technology administrator San Francisco, CA
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff systems engineer San Francisco, CA
- assistant electrical engineer San Francisco, CA
- staff design engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- staff data engineer San Francisco, CA