Lead Software Engineer, Model Serving Platform
Sciforium
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
About the role
This is a rare chance to help architect and lead the development of Sciforium’s next-generation model serving platform , the high-performance engine that will bring a multimodal, highly efficient foundation model to market. As a senior technical leader, you’ll not only build core components yourself but also guide and mentor other engineers , influencing engineering direction, standards, and execution quality.
You will learn and shape the full AI stack: from GPU kernels and quantized execution paths to distributed serving, scheduling, and the APIs that power real-time AI applications. If you enjoy deep systems work, thrive on ownership, and want to lead engineers in building foundational AI infrastructure, this role puts you at the center of SciForium’s mission and growth.
What you'll do
Lead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.
Build core serving components including execution runtimes, batching, scheduling, and distributed inference systems.
Develop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.
Collaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.
Build Python APIs and services that expose model capabilities to downstream applications.
Mentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.
Drive performance profiling, benchmarking, and observability across the inference stack.
Ensure high reliability and maintainability through testing, monitoring, and engineering best practices.
Troubleshoot and resolve complex issues across GPU, runtime, and service layers.
Ideal candidate profile
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure.
Strong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)
Experience with Kubernetes/Ray, Containerization
Strong proficiency in C++, Python.
Strong debugging, profiling, and performance optimization skills at the system level.
Ability to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems.
Effective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality.
Comfortable working from the office and contributing to a fast-moving, high-ownership team culture.
Nice-to-have
Experience with ML systems engineering, distributed GPU scheduling, open source inference engine like vLLM, Sglang, or TRT-LLM
Experience in building large scale ML/MLOps infrastructure
Proficiency in CUDA or ROCm and experience with GPU profiling tools
Experience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team.
Familiarity with multimodal model architectures, raw-byte models, or efficient inference techniques.
Contributions to open-source ML or HPC infrastructure
Benefits include
Medical, dental, and vision insurance
401k plan
Daily lunch, snacks, and beverages
Flexible time off
Competitive salary and equity
Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
- ...Runware is the AI inference platform that builds and runs its own... ...to end. Our Sonic Inference Engine has served more than 20 billion requests... ...end users, with 400,000+ models behind a single integration,... ...your own hands, and build and lead the Model Performance team as...PlatformLive inRemote work
$204k - $216k
...the collective intelligence platform for professional communities.... ...driven for the organization it serves. Let's achieve more,... ...reasons over. You design the data models, schemas, and representations... ...and models, partnering with engineers who build the pipelines. This...PlatformLocal area$204k - $216k
...the collective intelligence platform for professional communities.... ...driven for the organization it serves. Let's achieve more,... ...research role focused on the models at the foundation of collective... ...models Partner with data engineering on the datasets that training...Platform- ...Lead Software Engineer - Roku Location: On-Site - New York / Los Angeles /... ...Paramount+ Roku application — the platform, the patterns, the... ...~2+ years leading a team or serving as a technical lead ~ BS in... ...command of the Roku threading model and where performance falls...PlatformWork experience placementWeekend work
$156.8k - $235.2k
...Lead Software Engineer - Apple Welcome to Paramount Streaming — the team behind... ...video products. From platform innovation to global distribution... ...Experience integrating ad-serving products into Apple applications... ...whether issues are a data, model, or rendering problem....Platform$260k - $350k
...AI, an enterprise-grade platform, and deep domain... ...Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible for... ...high-performing team of software engineers responsible for... ...AI infrastructure, LLM serving, or machine learning platforms...PlatformFull time$156.8k - $235.2k
...globe. As part of a leading global media and... ...video products. From platform innovation to... ...Were hiring a Lead Engineer on the AI Engagement... ...build, and review software, supported by a... ..., and pairing. Model good engineering habits... ...integrating ad-serving products into Apple...PlatformLocal areaWorldwide- Accenture is a leading solutions and services company that helps the... ..., our proprietary assets and platforms, and deep ecosystem... ...Accenture's Enterprise Operating Model practice. We partner with Boards... ...business and growth strategy - serving as the foundation for total...PlatformWork experience placementLive inWork at officeLocal area
- Accenture is a leading solutions and services company that helps the... ..., our proprietary assets and platforms, and deep ecosystem... ...Accenture's Enterprise Operating Model practice. We partner with Boards... ...business and growth strategy - serving as the foundation for total...PlatformWork experience placementLive inWork at officeLocal area
- ...to bring cutting-edge models into production. We're... ...us and help build the platform engineers turn to ship AI products... ...We are looking for Software Engineers to join our... ...reuse, disaggregated serving). DevEx Improvement... ...High Ownership : As the lead of a small team, you will...PlatformFull timeFlexible hours
- ...spans growth strategy, operating model redesign, and digital... ...their most critical decisions and leading large, complex programs to successful... ...of consulting talent, and serve as a visible leader within... ...internal and external knowledge platforms Set the AI agenda on engagements...PlatformLive inWork at officeLocal area
$166k - $225k
...best data and AI infrastructure platform so our customers can use deep... ...their business. Databricks’ Model Serving product provides enterprises... ...cost efficiency.As a Senior Engineer, you’ll play a critical role... ...reliable and performant systems.Lead technical initiatives that...PlatformLocal areaWorldwide$190k - $265k
...world's best data and AI infrastructure platform so our customers can use deep data... ...improve their business. Founded by engineers — and customer-obsessed — we leap at... ...from data apps, AI agents, model training, model serving, and Vector Search. You'll be joining...PlatformLocal areaWorldwide$13 per hour
...career at the company leading workforce... ...same founders and engineers who built the original... ...opportunities in enterprise software.Agentforce... ...is an AI-powered platform for designing, automating... ...systems serving millions of users... ...decision-making for AI model deployment, safety...PlatformFull time$13 per hour
...career at the company leading workforce... ...with an AI-powered platform for designing, automating... ...powering the self-serve data... ...Lead, and Principal Engineers to serve as a key... ...production-grade software using modern engineering... ...engineering: data modeling, DB performance tuning...PlatformFull time- ...developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar... ...with hands-on support from AMD engineers the team is scaling rapidly to... .... We are looking for strong software engineering foundations, hands-...PlatformFull timeFlexible hours
- ...Description Job Description Lead Payload Systems Engineer Status: Full Time... ...through stratospheric platforms. Our lighter-than-air... ...Systems Engineer will serve as the technical authority... ...SolidWorks, CATIA) and system modeling tools (e.g., DOORS, Cameo,...PlatformFull timeRemote work
$155k - $210k
...role What team will you be on? The Model Portfolio team within Multi-Asset Strategies... ...a large and growing model portfolio platform serving an increasingly diverse set of client... ...portfolio management by combining software engineering, quantitative problem-solving,...PlatformFull timeApprenticeshipWork at officeLocal areaWork from homeFlexible hours1 day per week$220k - $320k
...specialized language models for companies that need... ...up to 90% cheaper. Our platform handles everything end... ...ten-person team of engineers who work in-person in... ...founded and run their own software companies. We are high... ...with the goal of serving models faster and cheaper...PlatformFull timeWork at office- ...next generation of frontier models. By co-designing chips, systems... ...for OpenAI’s supercomputing platform. About the Role You... ...runtime within the inference engine that executes complex,... ...upper layers of the cluster serving software stack, translating demanding...PlatformRemote jobFull time
- ...the Team The Product & Platform teams at OpenAI are responsible... ...that our products can serve rapidly growing demand... ...of product demand, model deployment, inference,... ...Program Manager to lead the operating system for... ...alignment across research, engineering, product, finance or...PlatformFull timeWork at officeRelocation package
- ...developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar... ...with hands-on support from AMD engineers the team is scaling rapidly to... ...Model Data Engineer to lead the strategy, creation, and curation...PlatformFull timeFlexible hours
$405k
...committed researchers, engineers, policy experts,... ...for a Staff Software Engineer to set technical... ...that measure model capabilities across... ...research roadmap Lead the design of... ...to completion Serve as a senior technical... ...infrastructure, or platforms that orchestrate many...PlatformWork at officeLocal areaVisa sponsorshipFlexible hours$164.7k - $266k
...Intelligent Agreement Management platform, companies can create,... ...that lets every engineering team at Docusign build,... .... As the AI Platform Lead, you own the architecture... ...— the infrastructure, model gateway and routing... ...the inference and GPU serving infrastructure that other...PlatformPermanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per week$103k - $264.1k
...performant, and scalable cloud platform for enterprise and... ...Advanced Services Engineer, OCI Storage & File Services to serve as a senior technical leader... ...Responsibilities Lead architecture, onboarding... ...with highly complex software updates, upgrades, configuration...PlatformTemporary workRemote workFlexible hoursShift work- ...applications. You will own engineering execution, technical... ...products and understands both model serving and model training—from experimentation... .... Responsibilities Lead and develop our engineering... ...focused roadmap and deliver software predictably. Stay...PlatformFull timeImmediate start
- ...infrastructure and developer platform that powers millions of users... .... About the role Self-serve is how Alchemy grows. The dashboard... ...it are the primary revenue engine for our flagship products: developers... ...Tuesday. You can build the model, audit the instrumentation,...PlatformFull timeWork at officeWorldwideHome officeFlexible hoursShift work
$236k - $340k
...agentic AI, an enterprise-grade platform, and deep domain expertise, we’... ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the... ...Experience with AI infrastructure, LLM serving, or machine learning platforms....PlatformRemote jobFull time$50 - $60 per hour
...States | Canada + 9 more Job title: Lead Software Engineer Team: Core Platform Pay Rate: $50-60 USD/hr... ...architecture diagrams, requirements, data models, API contracts, runtime designs,... ...practices. Reliability and Operations • Serve as a senior escalation point for...PlatformContract workRemote work- ...Description Job Description The Lead Software Engineer leads teams of software engineers... .... The Lead Software Engineer serves as a role model and works in accordance with IT standards... ....NET Core stack and Azure platform. Design and develop software applications...PlatformWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Software Engineer, Model Serving Platform. Be the first to apply!
- lead algorithm engineer San Francisco, CA
- lead system engineer San Francisco, CA
- lead security engineer San Francisco, CA
- lead engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- lead operating engineer San Francisco, CA
- lead network engineer San Francisco, CA
- client platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA






