Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference Systems Engineer

Acceler8 Talent

Acceler8 Talent is seeking a Senior Software Engineer to design and optimize AI inference systems for production workloads. You’ll work across runtime behavior, scheduling, memory management and system performance to deliver faster, more scalable AI inference. You’ll collaborate with engineers across distributed systems, networking and compiler optimization to push the boundaries of performance and efficiency in real-world AI infrastructure. #J-18808-Ljbffr Acceler8 Talent

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Systems Engineer in San Francisco, CA vacancy
  • A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving...  ...candidates should have strong software engineering skills and experience with ML inference... 
    Senior

    Gimlet Labs

    San Francisco, CA
    1 day ago
  • Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today, but simply adding more hardware isn't the answer. We're partnering with a well-funded Series A startup, founded by entrepreneurs with a proven track record of building successful... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Sequen AI is leading the charge for building frontier ranking models...  ...recent advances in AI into systems that are reliable, useful, and...  ...looking for a Core Systems Engineer with a deep mastery of Rust to...  ...scale data and compute complex inference logic with ultra-low latency.... 
    Senior

    Sequen

    San Francisco, CA
    2 days ago
  • Capital One in San Francisco seeks a senior AI systems engineer to design, train, and deploy production-ready AI components, including foundation models, inference, and governance. You will collaborate with engineers, researchers, PMs, and SREs to push scalable AI across... 
    Senior

    Capital One

    San Francisco, CA
    1 day ago
  • Vast.ai is seeking a systems engineer to scale AI inference and optimize GPU performance at our San Francisco or Los Angeles offices. You will leverage your HPC background to push the bleeding edge of AI, working with CUDA/C++ and a modern tech stack. Ideal candidates... 
    Suggested
    Full time

    Vast.ai

    San Francisco, CA
    1 day ago
  • Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related frameworks to push the bleeding edge of AI performance. This... 

    Vast.ai Inc.

    San Francisco, CA
    1 day ago
  • Sequen is seeking a Core Systems Engineer to optimize and build a reliable model serving infrastructure using Rust. This role focuses on ensuring...  ...offers a unique opportunity to engage with cutting-edge AI technologies in a dynamic environment. #J-18808-Ljbffr Sequen
    Senior

    Sequen

    San Francisco, CA
    7 days ago
  • River AI, located in San Francisco, is seeking exceptional systems engineers to build high-performance infrastructures that train state-of-the-art AI models. This role focuses on creating scalable, efficient systems to facilitate research efforts. The ideal candidate will... 
    Senior

    River AI

    San Francisco, CA
    1 day ago
  • $200k - $300k

    A leading AI company based in San Francisco is seeking a Senior Neuro-Symbolic Systems Engineer to enhance AI systems interacting with the physical world. Candidates will design and implement complex representations, work with cross-functional teams, and bridge symbolic... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    2 days ago
  • LangChain is looking for a Systems/Database Engineer based in San Francisco to design and optimize a storage layer for AI observability. You will write performant Rust code, optimize database services, and ensure efficient cloud storage integration. The ideal candidate... 
    Senior

    LangChain

    San Francisco, CA
    1 day ago
  • Hayden AI Technologies, Inc. is looking for a Staff Systems Engineer to lead design, integration, and deployment of complex systems in San Francisco. You will be responsible for architecture and system-level design, collaborating with teams to drive project execution. The... 
    Senior
    Work at office

    Hayden AI Technologies, Inc.

    San Francisco, CA
    14 hours ago
  • An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-speech. You will work...  ...serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience... 
    Senior

    Together AI

    San Francisco, CA
    1 day ago
  • $220k

    Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience... 
    Senior

    Perplexity

    San Francisco, CA
    2 days ago
  • A leading cloud infrastructure company is seeking a Senior Engineer 2 to join their AI Inference Optimization team. The role involves leading the technical strategy for performance architecture and addressing complex performance issues ensuring industry-leading service... 
    Senior
    Remote job

    DigitalOcean

    San Francisco, CA
    3 days ago
  • An innovative AI company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice applications. The ideal candidate will have over 5 years of ML engineering experience, strong Python... 
    Senior

    Together AI

    San Francisco, CA
    1 day ago
  • A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale...  ...infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate... 
    Senior

    Reflection AI

    San Francisco, CA
    3 days ago
  • Lightning AI in San Francisco or Seattle is seeking a Senior Application Security Engineer to secure our AI/ML platforms and inference services. You will work with platform, ML, and infrastructure teams to identify risks and implement secure architectures. The role emphasizes... 
    Senior

    Lightning-Ai

    San Francisco, CA
    1 day ago
  • A leading AI platform company in San Francisco is seeking a talented individual to optimize model inference for their advanced visual AI product. The ideal candidate will engage in building efficient AI models and tackling complex challenges. The role requires a strong... 
    Senior

    Comfy

    San Francisco, CA
    4 days ago
  •  ...the foundations - we run entire software systems inside a deterministic simulation and break...  ...recreate what went wrong. The rise of AI-generated code has made this work more urgent...  ...system. What We're Looking For We want engineers who think carefully about performance and... 
    Senior
    Work at office

    Antithesis

    San Francisco, CA
    3 days ago
  • A cutting-edge visual AI platform is seeking a talented individual to optimize model inference and enhance the core engine's performance. The ideal candidate is passionate about AI technology and has a strong background in production-level PyTorch. Responsibilities include... 
    Senior

    ComfyUI

    San Francisco, CA
    1 day ago
  • $172k - $209k

    Crusoe Energy Systems is looking for a Hardware Production / Sustaining Engineer to enhance their Hardware Systems Engineering team. You will oversee the complete hardware lifecycle while ensuring high reliability of AI-first compute systems. This role demands an individual... 
    Senior

    Crusoe Energy Systems

    San Francisco, CA
    1 day ago
  • $167.2k - $209k

    A leading cloud service provider is seeking a Senior Engineer 2 for their AI Inference Data Plane team. This remote role focuses on designing and developing...  ...candidate will have strong expertise in distributed systems, AI/ML technologies, and excellent programming skills... 
    Senior
    Remote job

    DigitalOcean

    San Francisco, CA
    2 days ago
  • A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation...  ...models. You will design distributed training systems and optimize GPU utilization while... 
    Senior

    Baseten

    San Francisco, CA
    3 days ago
  • A leading AI research firm located in San Francisco is seeking a Senior ML Systems Engineer to build and maintain the training framework for large-scale language models. The role involves designing distributed training solutions and improving training throughput across... 
    Senior
    Flexible hours

    Cohere

    San Francisco, CA
    1 day ago
  •  ...San Francisco, CA, is looking for a Distributed Training and Inference Engineer to optimize the software stack for AI training. The role involves ensuring efficient and scalable distributed training systems and integrating with various machine learning infrastructure components... 
    Senior
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  • TRM Labs, an AI-powered intelligence company, seeks a Senior or Staff ML Systems Engineer - LLM to scale AI infrastructure and production-grade ML tooling. You will build modular stacks, embed models into real-time workflows, and evaluate state-of-the-art AI tools to ensure... 
    Senior

    Trm-Labs

    San Francisco, CA
    4 hours ago
  • $103.2k - $189.2k

     ...massive datasets in real time to building systems that operate reliably on a global scale...  ...'d love to meet you. We are seeking a Senior Systems Engineer, Commercial Intelligence and Analytics...  ..., proactive signal delivery, and AI‑assisted workflows that operationalize... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    The Trade Desk

    San Francisco, CA
    1 day ago
  • Mercor is seeking a PyTorch Expert to guide teams in enhancing AI model performance. This remote contract role requires 40 hours a week and involves working with MLOps and ML systems engineering tasks. The ideal candidate should have 2+ years of experience in ML infrastructure... 
    Senior
    Remote job
    Contract work

    Mercor

    San Francisco, CA
    4 days ago
  • Crusoe, a leading AI infrastructure company, seeks a Senior Systems Engineer in compute to design and build our virtualization stack across thousands of AI compute servers. You’ll work with Linux kernel, hypervisors, and performance tuning, delivering scalable compute... 
    Senior

    Crusoe

    San Francisco, CA
    1 day ago
  • $160k - $250k

    Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should... 
    Senior

    Together AI

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference Systems Engineer. Be the first to apply!