Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Model Inference Engineer for Production-Scale AI

$325k

Jobleads-US

A leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal candidate has over 5 years of software engineering experience, strong familiarity with ML architectures, and experience with distributed systems. This role involves collaboration with researchers and focus on performance optimization. Compensation ranges from $325K to $490K. #J-18808-Ljbffr Jobleads-US

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Model Inference Engineer for Production-Scale AI in San Francisco, CA vacancy
  • MakerMaker is seeking a talented Senior ML Systems Engineer to build and maintain production inference systems in San Francisco. This role requires at least 3 years...  ...in production-grade infrastructure for large-scale models, along with strong analytical skills in... 
    Senior

    MakerMaker

    San Francisco, CA
    5 days ago
  • $220k - $320k

     ...Help us make inference blazingly fast. If you...  ...optimization techniques into production systems, we'd love...  ...language models for companies that...  ...frontier-quality AI at a fraction of the...  ..., and planet-scale hosting. We are a...  ...ten‑person team of engineers who work in‑person... 
    Senior
    Work at office

    Solana Foundation

    San Francisco, CA
    5 days ago
  • $167.2k - $209k

     ...DigitalOcean is expanding its AI Infrastructure...  .... We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In...  ...delivering high-scale, resilient data...  ...deploy and scale their models with industry-...  ...availing of all the productivity boosts granted by the... 
    Senior
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    San Francisco, CA
    4 days ago
  • Harrison Clarke is seeking experienced backend engineers to work with a high-growth AI company in San Francisco. Candidates will design and build backend services for a growing platform, ensuring efficiency and reliability. The ideal candidate will have a degree in Computer... 
    Senior

    Harrison Clarke

    San Francisco, CA
    3 days ago
  • Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today...  .... The role This isn't a model training role. You’ll...  ...inference systems that power production AI workloads. Working...  ...more efficient and built to scale. You’ll be: Building... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    3 days ago
  • $216.2k - $270.25k

    As a Software Engineer on the ML Infrastructure...  ...edge research and production systems,...  ...LLM workloads at scale. Build an internal...  ...integrate and optimize models for production and...  ...or text‑generation‑inference. Compensation and...  ...develop reliable AI systems for the world... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  •  ...seeking a talented software engineer to join their dynamic Inference team. This role involves...  ...implementing infrastructure for large-scale multimodal models, focusing on high-...  ...closely with researchers and product teams to push the boundaries of AI technology, ensuring... 

    Jobleads-US

    San Francisco, CA
    5 days ago
  • Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open... 

    Anyscale

    San Francisco, CA
    5 days ago
  • $150k - $237.5k

     ...low-cost and large-scale energy storage and...  ...telemetry, asset modeling, alerting, feature...  ...trust, learning, and engineering excellence, and we...  ...systems AI-accelerated development...  ...to make sure the product works well as a whole...  ...information, and inferences drawn from your PI... 
    Senior
    Full time
    Flexible hours

    Redwood Materials

    San Francisco, CA
    3 days ago
  • $150k - $237.5k

     ...low-cost and large-scale energy storage...  ...we already have. Senior Software Engineer, Energy Storage This...  ...telemetry, asset modeling, alerting,...  ...boundaries to ensure the product system works well...  ...time. Apply AI tools to accelerate...  ...information, and inferences drawn from your... 
    Senior
    Full time

    Redwood Materials

    San Francisco, CA
    3 days ago
  • $165k - $220k

     ...Essential Cloud for AI™. Built for...  ...innovators to build and scale AI with confidence...  ...and customer engineering teams, offering valuable...  ...to the CoreWeave product roadmap and...  ...contributions to open‑source inference frameworks....  ...optimization, or advanced model‑server... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    3 days ago
  • $188k - $275k

     ...Essential Cloud for AI™. Built for...  ...innovators to build and scale AI with confidence...  ...’ll Do The Field Engineering organization at CoreWeave...  ...the CoreWeave product roadmap and...  ...customers can train and inference on at scale,...  ...and operationalize models for managing customer... 
    Senior
    Permanent employment
    Contract work
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    3 days ago
  • Vast.ai Inc. is seeking a systems engineer with HPC or parallel programming experience to help scale AI inference. You will design and optimize GPU kernels and tensor libraries, leveraging CUDA/C++ and related frameworks to push the bleeding edge of AI performance. This... 

    Vast.ai Inc.

    San Francisco, CA
    3 days ago
  • $350k

    Mirendil is looking for engineers to build infrastructure for frontier reasoning models at their San Francisco location. This role focuses on large-scale reinforcement learning (RL) model training and requires a solid understanding of engineering principles. The ideal candidate... 
    Senior

    Mirendil

    San Francisco, CA
    5 days ago
  • Salesforce, Inc. is seeking a Senior Software Engineer to join the team responsible for the voice infrastructure at scale. The role focuses on deploying, maintaining, and monitoring voice services across multiple regions, ensuring high availability and quality for customers... 
    Senior

    Salesforce, Inc.

    San Francisco, CA
    2 days ago
  • $320k

    A leading AI research organization seeks a Model Quality Software Engineer to improve the coding capabilities of its AI model, Claude. The role involves designing and building evaluation systems, developing scalable infrastructure, and collaborating with researchers. The... 
    Senior

    anthropic

    San Francisco, CA
    3 days ago
  •  ...a Member of Technical Staff focused on AI Safety to lead red-teaming efforts and ensure...  ..., partner with researchers to define production safety standards, and research advanced...  ...expertise in LLM safety, strong software engineering skills, and relevant academic... 
    Senior

    Xcede

    San Francisco, CA
    4 days ago
  • $200k - $275k

    A cutting-edge AI technology firm in San Francisco is seeking a...  ...talented individual to join their Model Performance team. This role...  ...Model APIs that enhance inference capabilities for AI applications...  ...distributed systems and large-scale APIs, alongside strong debugging... 

    Baseten

    San Francisco, CA
    3 days ago
  • A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and...  ...Ideal candidates should have strong software engineering skills and experience with ML inference... 
    Senior

    Gimlet Labs

    San Francisco, CA
    3 days ago
  • Magnitude, located in San Francisco, is seeking a Sr. GTM Engineer to reimagine and scale the go-to-market motion. In this vital role, you will architect AI-powered experiments and integrate tools to drive growth. The ideal candidate has over 6 years in GTM or growth engineering... 
    Senior
    Flexible hours

    Magnitude

    San Francisco, CA
    3 days ago
  • Commure is building the AI Operating System for healthcare, enabling automated revenue...  ...and autonomous RCM processing at scale. The Claims Submissions team focuses on getting...  ...workflows and collaborate with clinicians and engineers to deliver reliable healthcare financial... 
    Senior

    Athelas

    San Francisco, CA
    3 days ago
  • A technology company in San Francisco is looking for a Network Engineer to maintain platform stability as traffic grows. This role involves...  ...design, managing firewalls, and tackling tech challenges at scale. Ideal candidates will have strong skills in networking,... 
    Senior

    craigslist

    San Francisco, CA
    3 days ago
  • $216.2k - $270.25k

    A technology firm in San Francisco is seeking a Senior Software Engineer to design and build scalable infrastructure for internal use. This role...  ...a competitive salary range of $216,200—$270,250 and includes benefits such as healthcare and PTO. #J-18808-Ljbffr Scale AI
    Senior

    Scale AI

    San Francisco, CA
    3 days ago
  • Acceler8 Talent is seeking a Senior Software Engineer to design and optimize AI inference systems for production workloads. You’ll work across runtime behavior, scheduling, memory management and system performance to deliver faster, more scalable AI inference. You’ll collaborate... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    3 days ago
  • Handshake is seeking a Senior Software Engineer on Operating Tooling to build internal products that power Handshake’s operators. You’ll...  ...ship high-impact tooling that scales with the business. You’ll collaborate...  ...with quality in a fast-moving AI-enabled environment. #J-18808-... 
    Senior
    Remote job

    Handshake

    San Francisco, CA
    3 days ago
  • $192k - $259.8k

    Harnham is looking for a Senior AI Product Engineer II in the San Francisco Bay Area to lead the development of agentic AI applications that impact...  ...architectural decisions, and delivering AI solutions at scale. Ideal candidates have over 6 years of software engineering... 
    Senior

    Harnham

    San Francisco, CA
    3 days ago
  • $200k - $320k

    A leading AI company in insurance automation is looking for a Senior Software Engineer who will ship end-to-end features, diagnose and debug across technology stacks, and tune performance for scale. This role requires 4+ years of software engineering experience with a strong... 
    Senior

    Raydar

    San Francisco, CA
    1 day ago
  • $175k - $230k

    A leading AI solutions provider seeks a Field Engineer, Agent Builder to execute AI agent builds for strategic customers in San Francisco. This technical role involves implementing and scaling enterprise-quality agents by collaborating with internal teams and customers... 
    Senior

    Decagon

    San Francisco, CA
    3 days ago
  • $190k - $282k

     ...Production Engineer, Security Engineering Join to apply for the Production Engineer, Security...  ...role at CoreWeave . CoreWeave is the AI Hyperscaler, delivering a cloud platform...  ..., or Go. Experience managing large-scale distributed systems and ensuring their reliability... 
    Senior
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    San Francisco, CA
    4 days ago
  • Scale AI is seeking a Senior Software Engineer for their San Francisco office. This role involves designing and developing secure and scalable applications for both internal and external users, focusing heavily on automation across various systems. The ideal candidate... 
    Senior
    Work at office

    Scale AI

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Model Inference Engineer for Production-Scale AI. Be the first to apply!