Senior AI Infra Engineer - LLM Serving Platform
$216k - $270kScale AI, Inc.
A leading AI company based in San Francisco is seeking a Software Engineer for its ML Infrastructure team. You will design and build platforms to serve large language models (LLMs) reliably and efficiently. Ideal candidates will have over 5 years of experience in backend system design, strong programming skills in languages such as Python or Go, and familiarity with cloud infrastructure. The position offers a salary range of $216,000 to $270,000 USD and includes comprehensive benefits like health coverage and retirement benefits. #J-18808-Ljbffr Scale AI, Inc.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior AI Infra Engineer - LLM Serving Platform in San Francisco, CA vacancy
- ...Senior AI/ML Engineer — LLM & Agent Stack Every production AI system, whether it's powering customer... ...compute layer, a Kubernetes-based platform that abstracts ML workloads as standard... ...experience building distributed systems, infra, or ML platforms. ~ Deep practical...PlatformSenior
TrueFoundry
San Francisco, CA1 day ago $160k - $235k
...Senior AI Engineer, AI Platform Affinity stitches together billions of data points... ...You will design and build LLM-powered AI systems that efficiently... ...cross-functional (product, infra, data engineering, and... ...from unstructured data, serving embedding models to vectorize...PlatformSeniorWork at officeRemote workWorldwideFlexible hours2 days per week3 days per weekAffinity
San Francisco, CA1 day ago$150k - $250k
...Senior/Staff AI Engineer Job Locations US-CA-San Francisco - Remote... ...infrastructure behind real-world model serving and inference. This is the... ...do Build and optimize LLM serving and inference... ...systems, storage platforms, or adjacent distributed systems...PlatformSeniorFull timeRemote workDataDirect Networks Inc
San Francisco, CA1 day ago- ...Senior Software Engineer We're hiring a Senior Software Engineer onto our Applied AI team to build and extend the backend systems... ...that power our platform. This is a hands-on... ...prompt engineering or LLM fine-tuning work, this... ...that happen to serve some of the most interesting...PlatformSeniorWork at office
Alembic Technologies
San Francisco, CA1 day ago $200k - $275k
...data scientists and ML engineers to build and operate the... ...You You've built AI infrastructure at a startup... ..., transforms, and serves data at scale (S3, Iceberg... ...startup where you owned infra end-to-end This... ...You've only worked on platform teams at large companies...PlatformHome officeDay shiftHealthleap AI
San Francisco, CA1 day ago- ...Sciforium AI Infrastructure Role Sciforium is an AI infrastructure... ...proprietary, high-efficiency serving platform. Backed by multi-million-... ...hands-on support from AMD engineers the team is scaling rapidly... ...engine like vLLM, Sglang, or TRT-LLM Proficiency in CUDA or...PlatformSeniorWork at officeFlexible hours
Sciforium
San Francisco, CA6 hours ago $180k
A leading software platform in San Francisco is seeking a Senior Software Engineer to develop intelligent services that enhance the... ...engineering, focusing on AI and machine learning. Responsibilities... ...building features that leverage AI and LLM, creating services for user data...PlatformSenior$229.9k - $262.4k
...Overview Senior Lead AI Engineer At Capital One, we are creating responsible... ...to reimagine how we serve our customers and businesses... ...customers. Our AI models and platforms empower teams across Capital... ...introduce state-of-the-art LLM optimization techniques to improve...PlatformSeniorFull timePart timeLocal areaCapital One
San Francisco, CA5 days ago$229.9k - $262.4k
...Senior Lead AI Engineer,(MLX, Agentic AI, Gen AI platform Services) Overview: At Capital One, we are creating responsible and... ...capabilities to reimagine how we serve our customers and businesses who... ...Invent and introduce state-of-the-art LLM optimization techniques to...PlatformSeniorFull timePart timeLocal areaCapital One
San Francisco, CA1 day ago- ...role: SoFi's Staff AI Engineer is a hands-on AI... ...organization. This is a critical, senior role responsible for... ...our next-generation AI platform, particularly focusing... ...agentic frameworks and LLM deployment patterns.... ...organization. Model Serving Infrastructure: Support...PlatformSeniorRemote work
SoFi
San Francisco, CA3 days ago $155k
...employee. For us, it also serves as a practical... ...Team The Data Platform team sits within... ...to the semantic and AI layers that sit on... ...work for everyone - engineers, analysts, and business... ...'re looking for a Senior AI Data Engineer to... ...infrastructure or LLM-powered...PlatformSeniorLocal areaHome officeFlexible hoursScribd
San Francisco, CA1 day ago- ...Fieldguide is building AI agents for the most... .... As an AI Engineer, Quality , you will... ...building the unified platform, automated pipelines... ...levels. We'll calibrate seniority during interviews... ...platform that serves as the single source... ...Built and deployed LLM‑powered features serving...PlatformSeniorWork at officeRemote workWork from homeFlexible hours
$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating... ...AI capabilities to reimagine how we serve our customers and businesses who have... ...millions of customers. Our AI models and platforms empower teams across Capital One to...PlatformFull timePart timeLocal areaCapital One
San Francisco, CA7 days ago$150k - $180k
...Global (NYSE: ZETA) is the AI-Powered Marketing Cloud... ...the Zeta Marketing Platform (ZMP), our vision is to... ...a hands-on Agentic AI engineer to build bidder-adjacent... ...outcomes while keeping serving paths stable.... ...Agentic AI, RAG, LLM tool use, bid optimization...PlatformSeniorFull timeZeta Global
San Francisco, CA6 hours ago$216k - $270k
About Scale AI Scale AI is the data foundation... ...our data annotation platform, generative AI solutions... ...Role Overview As a Senior Forward Deployed AI Engineer on our Enterprise... ...Leadership & Collaboration Serve as the primary... ...devops, platform, or infra role Familiarity with...PlatformSeniorFull time- About Scale AI Scale AI is the data foundation... ...our data annotation platform, generative AI... ...Role Overview As a Senior Staff Forward Deployed AI Engineer on our Enterprise team... ...Leadership & Collaboration Serve as the primary... ...devops, platform, or infra role Familiarity with...PlatformSenior
- ...Francisco is seeking an experienced engineer for its Inference Platform team. This role involves managing end... ..., driving improvements in AI performance, and utilizing Kubernetes... ...Python or Go, and be familiar with LLM serving frameworks and deploying GPU workloads...PlatformSenior
$183k - $248k
...way. Our $1B+ learning platform serves tens of millions of students... ...to design and deliver AI-powered learning tools... ...Role As an Applied AI Engineer, you will be working at... ...AI & Agentic Systems - LLM‑powered tutoring,... ...Collaborate with and learn from senior ML/SWE teammates; write...PlatformSeniorWork at office3 days per week$216k - $270k
...As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable, reliable, and efficient serving of LLMs. Our platform powers cutting... ...platform to empower LLM capability discovery.... ...is to develop reliable AI systems for the world's...PlatformSeniorFull timeScale AI
San Francisco, CA1 day ago$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible... ...AI capabilities to reimagine how we serve our customers and businesses who... ...Invent and introduce state-of-the-art LLM optimization techniques to improve...PlatformSeniorFull timePart timeLocal areaCapital One
San Francisco, CA4 days ago$207k - $290k
...Description About JazzX AI: Vision:... ...SAIGroup's portfolio serves 2,000+ global... ...an experienced AI Engineer with deep expertise... ...join our team as a Senior Staff Architect. In... ...generation enterprise AGI platform. You will lead... ...large language model (LLM) training and fine-...PlatformSeniorWorldwideFlexible hoursJazzX AI
San Francisco, CA6 days ago$250.8k - $286.2k
...responsible and reliable AI systems, changing... ...class applied science and engineering teams to deliver our industry... ...to reimagine how we serve our customers and... ...customers. Our AI models and platforms empower teams across... ...introduce state-of-the-art LLM optimization techniques...PlatformSeniorFull timePart timeLocal area- Brain Co. in San Francisco is looking for an experienced engineer to lead backend systems and LLM integration. The role involves developing foundational systems, ensuring data privacy, and working closely with product and security teams. Ideal candidates will have 5+ years...Platform
- A leading AI technology firm in San Francisco is seeking a Senior Software Engineer for AIOps & Infrastructure. This role focuses on designing and optimizing scalable... ...and strong expertise in Kubernetes and cloud platforms. Join us to drive innovation in the financial...PlatformSenior
- A leading data and AI company in San Francisco is seeking a Senior Engineer to enhance their Model Serving platform. This role requires expertise in building large-scale distributed systems and collaboration across teams to optimize performance and reliability. Ideal candidates...PlatformSenior
- ...financial services company is looking for a Sr. Distinguished AI Engineer to innovate AI solutions and enhance customer interactions. The... ...in AI and software development, and knowledge of cloud platforms. The ideal candidate is passionate about AI research and possesses...PlatformSenior
- ...Senior AI Engineer Disney Entertainment and ESPN Product &... ...consumer media touch points serving millions of people... ...building the products and platforms that will power our... ...backend engineering, LLM orchestration, and developer... ...; able to work across infra, data, security, and...PlatformSenior
The Walt Disney Studios
San Francisco, CA1 day ago - ...Senior Software Engineer There are NO limits to your career: come shape the future... ...new ways to work with AI, this is the role for you!... ...Familiarity with the OutSystems platform or similar low-code/no-code... ...diverse as the organizations we serve, ensuring every individual...PlatformSeniorRemote workWorldwide3 days per week
OutSystems
San Francisco, CA1 day ago $314.8k - $359.3k
...Sr Distinguished AI Engineer At Capital One, we are creating responsible... ...to reimagine how we serve our customers and businesses... ...customers. Our AI models and platforms empower teams across Capital... ...and introduce state-of-the-art LLM optimization techniques to improve...PlatformSeniorFull timePart timeCapital One
San Francisco, CA13 hours ago- ...part of Schwab's AI Strategy & Transformation... ...together product, engineering, strategy, and... ...the scalable core platform for AI and... ...We're seeking a Senior AI Engineer who will... ...OpenAI) and deploying LLM-powered applications... ...workplace flexibility, serving our clients, and...PlatformSeniorWork at office
Charles Schwab
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Infra Engineer - LLM Serving Platform. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- client platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA