Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Model Inference Engineer for Production-Scale AI

$325k

Jobleads-US

A leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume production environments. The ideal candidate has over 5 years of software engineering experience, strong familiarity with ML architectures, and experience with distributed systems. This role involves collaboration with researchers and focus on performance optimization. Compensation ranges from $325K to $490K. #J-18808-Ljbffr Jobleads-US

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Model Inference Engineer for Production-Scale AI in San Francisco, CA vacancy
  • Databricks Mosaic AI is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join...  ...visibility team connected to research, product, and enterprise use cases, helping... 
    Senior

    Databricks

    San Francisco, CA
    5 days ago
  • $220k - $320k

     ...Help us make inference blazingly fast. If you...  ...optimization techniques into production systems, we'd love...  ...language models for companies that...  ...frontier-quality AI at a fraction of the...  ..., and planet-scale hosting. We are...  ...ten-person team of engineers who work in-person... 
    Senior
    Full time
    Work at office

    Inference

    San Francisco, CA
    3 days ago
  • $190k - $265k

     ...enabling data and AI teams to solve the...  ...business. Founded by engineers — and customer-...  ...interfacing with data to scaling our services and...  ...the platforms and products that power...  ...apps, AI agents, model training, model serving...  ...Foundation Model Inference team is the backbone... 
    Suggested
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $300 per month

     ...vertically integrated AI infrastructure...  ...believe in the scale of our ambition and...  ...:At Crusoe, our Production Engineering team ensures the...  ...re looking for a Senior Production Engineer...  ...large language models to help us build...  ...AI pipelines and inference servicesDefine, measure... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize... 
    Senior

    Causal Labs

    San Francisco, CA
    16 hours ago
  • $300 per month

     ...vertically integrated AI infrastructure company...  ...urgency, who believe in the scale of our ambition and...  ...RoleAt Crusoe, our Production Engineering team ensures the reliability...  .... We’re looking for a Senior Production Engineer...  ...-scale training and inference clustersAutomate... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  •  ...seeking a talented software engineer to join their dynamic Inference team. This role involves...  ...implementing infrastructure for large-scale multimodal models, focusing on high-...  ...closely with researchers and product teams to push the boundaries of AI technology, ensuring... 

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $150k - $237.5k

     ...low-cost and large-scale energy storage...  ...we already have. Senior Software Engineer, Energy Storage This...  ...telemetry, asset modeling, alerting,...  ...boundaries to ensure the product system works well...  ...time. Apply AI tools to accelerate...  ...information, and inferences drawn from your... 
    Senior
    Full time

    Redwood Materials

    San Francisco, CA
    1 day ago
  • Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open... 

    Anyscale

    San Francisco, CA
    3 days ago
  • $161k - $242k

    # Senior Software Engineer, Production EngineeringHarvey AI·San Francisco, CA·$161k - $241kfull-timeseniorPosted 6 days...  ...-class investor support. We’re scaling fast and defining a new category...  ...every customer interaction, every model inference, and every production workload.... 
    Senior

    Not Human Search

    San Francisco, CA
    3 days ago
  • $216k - $270k

    About Scale AIScale AI is the data foundation for AI, helping organizations...  ...and deploy reliable production AI applications. We...  ...than ever. New foundation models, reasoning techniques, agent...  ...one of the hardest engineering challenges.As a Senior Frontier Agent Engineer (... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • $350k

    Mirendil is looking for engineers to build infrastructure for frontier reasoning models at their San Francisco location. This role focuses on large-scale reinforcement learning (RL) model training and requires a solid understanding of engineering principles. The ideal candidate... 
    Senior

    Mirendil

    San Francisco, CA
    3 days ago
  • Engineering Manager, Foundation Model Inference (FMAPI)RDQ427R519At Databricks, we are driven by a...  ...operate the premier data and AI infrastructure platform,...  ...to lead a cutting-edge product to success, we invite you...  ...our customers to serve, scale, and optimize frontier models... 
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $192k - $240k

     ...visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service...  ...resources, and support you need to grow your career.Engineering at BrexEngineering at Brex is about building systems that scale with speed and intention. Our teams span... 
    Senior
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    1 day ago
  • A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and...  ...Ideal candidates should have strong software engineering skills and experience with ML inference... 
    Senior

    Gimlet Labs

    San Francisco, CA
    16 hours ago
  • $172.43k - $230.95k

     ...vertically integrated AI infrastructure...  ...who believe in the scale of our ambition and...  ...About This Role:The Senior Software Engineer for the AI Model Lifecycle team will...  ...building cutting-edge AI products and solving challenging...  ...on GPU systems and inference frameworks.Benefits:... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...world's best data and AI infrastructure...  ...business. Databricks’ Model Serving product provides enterprises...  ...real-time, low-latency inference, governance, monitoring...  ...operationalize models at scale with strong SLAs and cost efficiency.As a Senior Engineer, you’ll play a... 
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago
  • $190k - $265k

     ...enabling data and AI teams to solve the...  ...business. Founded by engineers — and customer-...  ...interfacing with data to scaling our services and...  ...the platforms and products that power...  ...apps, AI agents, model training, model serving...  ...Foundation Model Inference team is the backbone... 
    Full time
    Local area
    Worldwide

    Databricks

    San Francisco, CA
    4 days ago
  •  ...the world through our products. We empower consumers,...  ...our start-of-the-art AI models, allowing them to do things...  ...and efficient model inference, as well as...  ...We are looking for an engineer who wants to take the...  ...to rapidly increasing scale. Are self-directed... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $225k - $275k

     .... As the only vertically integrated AI infrastructure company built from the...  ...of urgency, who believe in the scale of our ambition and thrive on a path...  ...this RoleCrusoe Cloud is seeking a Senior Staff Network Production Engineer to own production reliability across... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $179k - $218k

     ...only vertically integrated AI infrastructure company...  ...urgency, who believe in the scale of our ambition and...  ...bridged.We are seeking a Senior Staff Data Center Operations Engineer, GPU Hardware Architecture...  ...hardware failures in the production environment. Lead Root Cause... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $148.5k - $223.9k

     ...SalesforceSalesforce is the #1 AI CRM, where humans...  ....Software Quality Senior Member of...  ...of our software engineering. While AI is...  ...apart at enterprise scale. We are looking for...  ...cutting-edge AI-powered products that tackle one of...  ...-in-the-Loop & Model Evaluation:... 
    Senior
    Full time
    Worldwide

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...systems generalist to build an automated inference optimization platform across hardware, compiler...  ...results, and secure handling of model and hardware data. This cross-stack role...  ...with research, infrastructure, security, product, and partnerships to deliver scalable, #J... 
    Senior

    Slope

    San Francisco, CA
    5 days ago
  • $200k - $400k

    Senior Software Engineer - Agentic Systems We are partnered with a highly technical AI research company building advanced AI...  ...funded, executing large‑scale programs, and...  ...combining large language models with structured...  ...workflows into real production toolchains. This... 
    Senior
    Full time
    Immediate start

    Strativ Group

    San Francisco, CA
    1 day ago
  •  ...We’re looking for a Senior Backend or Full-Stack Software Engineer (5+ years experience) who...  ...Sprinter, you’ll work on products that blend logistics, patient...  ...operations—building and scaling backend services, data...  ...end to end, from data modeling and business logic to UI... 
    Senior
    Full time
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday
    Flexible hours

    Sprinter Health

    San Francisco, CA
    1 day ago
  • $300 per month

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  ...a sense of urgency, who believe in the scale of our ambition and thrive on a path...  ..., AI-optimized cloud platform — and Production Engineering sits at the heart of that mission. As a... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    1 day ago
  •  ...systems that connect models to motors, sensors...  ...on real robots, in production. About the role As a Backend Software Engineer at Droyd, you’ll own...  ...that support learning, inference, control, and fleet...  ...person with a small, senior team across robotics, AI, and hardware. Your... 
    Senior

    Droyd

    San Francisco, CA
    3 days ago
  • $245k - $295k

     ...vertically integrated AI infrastructure...  ..., who believe in the scale of our ambition and thrive...  ...RoleCrusoe is seeking a Senior Staff Software Engineer to own how our...  ...intent-based designs into production automation, mentor a...  ...the authoritative data model (NetBox, Nautobot, or... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $165k - $241.4k

     ...role follows a hybrid work model, with in-office...  ...their ownership. Leveraging AI and an unparalleled set of...  ...supporting customers in scaling deployments while offering...  ...ImpactWe are seeking a skilled Senior Site Reliability Engineer (SRE) in Production Engineering with a strong... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    1 day per week

    CISCO Systems

    San Francisco, CA
    2 days ago
  • $270k - $340k

    Principal AI Research Scientist, Research...  ...to develop AI models and agents using their...  ...to all.About the Scaling Research TeamThe...  ...LLM) training and inference efficiency beyond...  ...implementation details with engineering partners.Role...  ...closely with product, data, and engineering... 
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Model Inference Engineer for Production-Scale AI. Be the first to apply!