Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Software Engineer, Model Serving Platform

Full-time

Sciforium

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

About the role

This is a rare chance to help architect and lead the development of Sciforium’s next-generation model serving platform , the high-performance engine that will bring a multimodal, highly efficient foundation model to market. As a senior technical leader, you’ll not only build core components yourself but also guide and mentor other engineers , influencing engineering direction, standards, and execution quality.

You will learn and shape the full AI stack: from GPU kernels and quantized execution paths to distributed serving, scheduling, and the APIs that power real-time AI applications. If you enjoy deep systems work, thrive on ownership, and want to lead engineers in building foundational AI infrastructure, this role puts you at the center of SciForium’s mission and growth.

What you'll do

  • Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.

  • Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems.

  • Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.

  • Collaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.

  • Build Python APIs and services that expose model capabilities to downstream applications.

  • Mentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.

  • Drive performance profiling, benchmarking, and observability across the inference stack.

  • Ensure high reliability and maintainability through testing, monitoring, and engineering best practices.

  • Troubleshoot and resolve complex issues across GPU, runtime, and service layers.

Ideal candidate profile

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience

  • 5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure.

  • Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)

  • Experience with Kubernetes/Ray, Containerization

  • Strong proficiency in C++, Python.

  • Strong debugging, profiling, and performance optimization skills at the system level.

  • Ability to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems.

  • Effective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality.

  • Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.

Nice-to-have

  • Experience with ML systems engineering, distributed GPU scheduling, open source inference engine like vLLM, Sglang, or TRT-LLM

  • Experience in building large scale ML/MLOps infrastructure

  • Proficiency in CUDA or ROCm and experience with GPU profiling tools

  • Experience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team.

  • Familiarity with multimodal model architectures, raw-byte models, or efficient inference techniques.

  • Contributions to open-source ML or HPC infrastructure

Benefits include

  • Medical, dental, and vision insurance

  • 401k plan

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

Equal opportunity

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Software Engineer, Model Serving Platform in San Francisco, CA vacancy
  •  ...Runware is the AI inference platform that builds and runs its own...  ...to end. Our Sonic Inference Engine has served more than 20 billion requests...  ...end users, with 400,000+ models behind a single integration,...  ...your own hands, and build and lead the Model Performance team as... 
    Platform
    Live in
    Remote work

    Runware

    San Francisco, CA
    8 days ago
  • $204k - $216k

     ...the collective intelligence platform for professional communities....  ...driven for the organization it serves. Let's achieve more,...  ...reasons over. You design the data models, schemas, and representations...  ...and models, partnering with engineers who build the pipelines. This... 
    Platform
    Local area

    Sapience AI Corporation

    San Francisco, CA
    20 days ago
  • $204k - $216k

     ...the collective intelligence platform for professional communities....  ...driven for the organization it serves. Let's achieve more,...  ...research role focused on the models at the foundation of collective...  ...models Partner with data engineering on the datasets that training... 
    Platform

    Sapience AI Corporation

    San Francisco, CA
    13 days ago
  •  ...Lead Software Engineer - Roku Location: On-Site - New York / Los Angeles /...  ...Paramount+ Roku application — the platform, the patterns, the...  ...~2+ years leading a team or serving as a technical lead ~ BS in...  ...command of the Roku threading model and where performance falls... 
    Platform
    Work experience placement
    Weekend work

    VH1

    San Francisco, CA
    1 day ago
  • $156.8k - $235.2k

     ...Lead Software Engineer - Apple Welcome to Paramount Streaming — the team behind...  ...video products. From platform innovation to global distribution...  ...Experience integrating ad-serving products into Apple applications...  ...whether issues are a data, model, or rendering problem.... 
    Platform

    Paramount Global Services

    San Francisco, CA
    4 days ago
  • $260k - $350k

     ...AI, an enterprise-grade platform, and deep domain...  ...Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible for...  ...high-performing team of software engineers responsible for...  ...AI infrastructure, LLM serving, or machine learning platforms... 
    Platform
    Full time

    Harvey

    San Francisco, CA
    8 days ago
  • $156.8k - $235.2k

     ...globe. As part of a leading global media and...  ...video products. From platform innovation to...  ...Were hiring a Lead Engineer on the AI Engagement...  ...build, and review software, supported by a...  ..., and pairing. Model good engineering habits...  ...integrating ad-serving products into Apple... 
    Platform
    Local area
    Worldwide

    Paramount Unified School District

    San Francisco, CA
    2 days ago
  • Accenture is a leading solutions and services company that helps the...  ..., our proprietary assets and platforms, and deep ecosystem...  ...Accenture's Enterprise Operating Model practice. We partner with Boards...  ...business and growth strategy - serving as the foundation for total... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    1 day ago
  • Accenture is a leading solutions and services company that helps the...  ..., our proprietary assets and platforms, and deep ecosystem...  ...Accenture's Enterprise Operating Model practice. We partner with Boards...  ...business and growth strategy - serving as the foundation for total... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    1 day ago
  •  ...to bring cutting-edge models into production. We're...  ...us and help build the platform engineers turn to ship AI products...  ...We are looking for Software Engineers to join our...  ...reuse, disaggregated serving). DevEx Improvement...  ...High Ownership : As the lead of a small team, you will... 
    Platform
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    8 days ago
  •  ...spans growth strategy, operating model redesign, and digital...  ...their most critical decisions and leading large, complex programs to successful...  ...of consulting talent, and serve as a visible leader within...  ...internal and external knowledge platforms Set the AI agenda on engagements... 
    Platform
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...best data and AI infrastructure platform so our customers can use deep...  ...their business. Databricks’ Model Serving product provides enterprises...  ...cost efficiency.As a Senior Engineer, you’ll play a critical role...  ...reliable and performant systems.Lead technical initiatives that... 
    Platform
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    13 hours ago
  • $190k - $265k

     ...world's best data and AI infrastructure platform so our customers can use deep data...  ...improve their business. Founded by engineers — and customer-obsessed — we leap at...  ...from data apps, AI agents, model training, model serving, and Vector Search. You'll be joining... 
    Platform
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    13 hours ago
  • $13 per hour

     ...career at the company leading workforce...  ...same founders and engineers who built the original...  ...opportunities in enterprise software.Agentforce...  ...is an AI-powered platform for designing, automating...  ...systems serving millions of users...  ...decision-making for AI model deployment, safety... 
    Platform
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $13 per hour

     ...career at the company leading workforce...  ...with an AI-powered platform for designing, automating...  ...powering the self-serve data...  ...Lead, and Principal Engineers to serve as a key...  ...production-grade software using modern engineering...  ...engineering: data modeling, DB performance tuning... 
    Platform
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar...  ...with hands-on support from AMD engineers the team is scaling rapidly to...  .... We are looking for strong software engineering foundations, hands-... 
    Platform
    Full time
    Flexible hours

    Sciforium

    San Francisco, CA
    4 days ago
  •  ...Description Job Description Lead Payload Systems Engineer   Status: Full Time...  ...through stratospheric platforms. Our lighter-than-air...  ...Systems Engineer will serve as the technical authority...  ...SolidWorks, CATIA) and system modeling tools (e.g., DOORS, Cameo,... 
    Platform
    Full time
    Remote work

    SCEYE INC

    San Francisco, CA
    25 days ago
  • $155k - $210k

     ...role What team will you be on? The Model Portfolio team within Multi-Asset Strategies...  ...a large and growing model portfolio platform serving an increasingly diverse set of client...  ...portfolio management by combining software engineering, quantitative problem-solving,... 
    Platform
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Flexible hours
    1 day per week

    BlackRock

    San Francisco, CA
    4 days ago
  • $220k - $320k

     ...specialized language models for companies that need...  ...up to 90% cheaper. Our platform handles everything end...  ...ten-person team of engineers who work in-person in...  ...founded and run their own software companies. We are high...  ...with the goal of serving models faster and cheaper... 
    Platform
    Full time
    Work at office

    inference

    San Francisco, CA
    4 days ago
  •  ...next generation of frontier models. By co-designing chips, systems...  ...for OpenAI’s supercomputing platform. About the Role You...  ...runtime within the inference engine that executes complex,...  ...upper layers of the cluster serving software stack, translating demanding... 
    Platform
    Remote job
    Full time

    openai

    San Francisco, CA
    4 days ago
  •  ...the Team The Product & Platform teams at OpenAI are responsible...  ...that our products can serve rapidly growing demand...  ...of product demand, model deployment, inference,...  ...Program Manager to lead the operating system for...  ...alignment across research, engineering, product, finance or... 
    Platform
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    4 days ago
  •  ...developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar...  ...with hands-on support from AMD engineers the team is scaling rapidly to...  ...Model Data Engineer to lead the strategy, creation, and curation... 
    Platform
    Full time
    Flexible hours

    Sciforium

    San Francisco, CA
    4 days ago
  • $405k

     ...committed researchers, engineers, policy experts,...  ...for a Staff Software Engineer to set technical...  ...that measure model capabilities across...  ...research roadmap Lead the design of...  ...to completion Serve as a senior technical...  ...infrastructure, or platforms that orchestrate many... 
    Platform
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  • $164.7k - $266k

     ...Intelligent Agreement Management platform, companies can create,...  ...that lets every engineering team at Docusign build,...  .... As the AI Platform Lead, you own the architecture...  ...— the infrastructure, model gateway and routing...  ...the inference and GPU serving infrastructure that other... 
    Platform
    Permanent employment
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    2 days ago
  • $103k - $264.1k

     ...performant, and scalable cloud platform for enterprise and...  ...Advanced Services Engineer, OCI Storage & File Services to serve as a senior technical leader...  ...Responsibilities Lead architecture, onboarding...  ...with highly complex software updates, upgrades, configuration... 
    Platform
    Temporary work
    Remote work
    Flexible hours
    Shift work

    Oracle Corporation

    San Francisco, CA
    3 days ago
  •  ...applications. You will own engineering execution, technical...  ...products and understands both model serving and model training—from experimentation...  .... Responsibilities Lead and develop our engineering...  ...focused roadmap and deliver software predictably. Stay... 
    Platform
    Full time
    Immediate start

    LlamaIndex

    San Francisco, CA
    8 days ago
  •  ...infrastructure and developer platform that powers millions of users...  .... About the role Self-serve is how Alchemy grows. The dashboard...  ...it are the primary revenue engine for our flagship products: developers...  ...Tuesday. You can build the model, audit the instrumentation,... 
    Platform
    Full time
    Work at office
    Worldwide
    Home office
    Flexible hours
    Shift work

    Alchemy

    San Francisco, CA
    8 days ago
  • $236k - $340k

     ...agentic AI, an enterprise-grade platform, and deep domain expertise, we’...  ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the...  ...Experience with AI infrastructure, LLM serving, or machine learning platforms.... 
    Platform
    Remote job
    Full time

    harvey

    San Francisco, CA
    4 days ago
  • $50 - $60 per hour

     ...States | Canada + 9 more Job title: Lead Software Engineer Team: Core Platform Pay Rate: $50-60 USD/hr...  ...architecture diagrams, requirements, data models, API contracts, runtime designs,...  ...practices. Reliability and Operations • Serve as a senior escalation point for... 
    Platform
    Contract work
    Remote work

    Braintrust

    San Francisco, CA
    18 days ago
  •  ...Description Job Description The Lead Software Engineer leads teams of software engineers...  .... The Lead Software Engineer serves as a role model and works in accordance with IT standards...  ....NET Core stack and Azure platform. Design and develop software applications... 
    Platform
    Work at office
    Remote work

    Worker's Compensation Insurance Rating Bureau

    San Francisco, CA
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Software Engineer, Model Serving Platform. Be the first to apply!