Inference Systems Engineer: Scalable AI Infrastructure
Jobleads-US
Sierra is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-hosted and provider-based inference, focusing on latency, reliability, and cost at scale.
You will work across distributed systems to build, optimize, and operate core inference infrastructure. This role emphasizes ownership of complex systems from design to production, and collaboration with frontier labs, providers, and
#J-18808-Ljbffr Jobleads-USVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Inference Systems Engineer: Scalable AI Infrastructure in San Francisco, CA vacancy
- ...Aimlroles is seeking a Principal Machine Learning Engineer to own and evolve critical AI systems across training, inference, and deployment. You will set technical... ...architectural depth with pragmatic delivery and scalable ML infrastructure. #J-18808-Ljbffr Jobleads-USSuggestedRemote job
- ...Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding... ...to define the long-term architecture, deploy scalable services, and contribute to open-source...Suggested
- ...Sierra’s AI agents rely on foundation models; as a Software Engineer on Inference, you’ll help define the inference architecture across... ...providers. You’ll work on systems for serving and routing... ...intersection of distributed infrastructure and AI. You don’t need to be...Suggested
- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... ...own everything from distributed infrastructure (global KV cache, continuous batching... ...to:Architect and implement scalable distributed infrastructure for model...SuggestedWork at officeLocal area
Atlassian
San Francisco, CA2 days ago - ....About the Central AI OrgOur organization... ...robust Atlassian AI infrastructure for the future. Our... ...Conversational AI system that integrates seamlessly... ...a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will... ...and implement scalable distributed infrastructure...SuggestedWork at officeLocal area
Atlassian
San Francisco, CA23 hours ago - ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer tooling to... ..., prioritizing performance, scalability, and reliability across the... ...platform. As a distributed systems engineer on the Inference Platform,...Flexible hours
- ...deeply in Generative AI — pioneering advanced... ...Principal Machine Learning Systems Engineer (P60) to lead... ...reliable, high-performance infrastructure.Working at... ...SystemsArchitect and implement scalable systems for training,... ...model training, inference pipelines, or search/...Work at officeLocal area
Atlassian
San Francisco, CA4 days ago $350k
...Join a rapidly growing AI infrastructure provider delivering... ...for AI training and inference across global cloud and... ...Site Reliability Engineer to lead the reliability... ...maintain observability systems, GPU telemetry... ...improve reliability and scalability Participate in customer...Full timeSan Francisco, CAmore than 2 months ago- ...Full-time Design and scale the infrastructure that allows AI agents to reliably search, extract, and... ...Why this role matters Own critical systems that power autonomous web understanding... ...and orchestration systems to build a scalable and reliable platform. Hiring...Full timeRemote workTrial period
$145k - $195k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time... ...Loft Orbital builds a space infrastructure providing a fast & simple path... ...to deliver a cohesive and scalable systemPartner with hardware... ...IoT connectivity, on-orbit AI, national security missions...Full timeTemporary workLoft Orbital
San Francisco, CA23 hours ago$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time... ...Loft Orbital builds a space infrastructure providing a fast & simple path... ...solutions are reusable, scalable, and understandable rather... ...IoT connectivity, on-orbit AI, national security missions...Full timeTemporary workLoft Orbital
San Francisco, CA23 hours ago$250k
...opportunity? Join a seed-stage AI infrastructure company building large-scale training and inference platforms previously... ...observability, alerting, and auto-healing systems for high-availability GPU... ..., DevOps, or Infrastructure Engineering roles supporting large-scale compute...Full timeImmediate startSan Francisco, CAmore than 2 months ago$232k - $319k
Secure Every Identity, from AI to HumanIdentity is the key... ...building the trusted, neutral infrastructure that enables organizations... ...velocity of SRE and product engineering by developing robust platforms... ...the design and operation of scalable, self-service Cloud...Permanent employmentLocal areaWorldwideFlexible hoursOkta
San Francisco, CA4 days ago- ...Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency. You...
$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...review, mentoring junior engineers, and providing technical guidance... ...products over public cloud infrastructure - AWS/Azure/GCP.- Proven experience... ...and developing distributed systems at scale. - Proficiency in...Full timeImmediate startSalesforce
San Francisco, CA4 days ago$210k - $255k
...only vertically integrated AI infrastructure company built from the ground... ...are seeking a Staff Software Engineer to design, build, and scale... ...customer-facing features, build systems from 0 to 1, and scale... ...before writing a line of code.Scalable Design Thinking: You plan how...Full timeTemporary workCrusoe
San Francisco, CA1 day ago$140k - $210k
...Klaviyo is building an AI-first company—and that... ...People Technology Engineer to be the first dedicated... ...and build intelligent systems that transform how we... ...business problems into scalable AI solutionsDriving an... ...to align on shared AI infrastructure and standardsContribute...Shift workKlaviyo
San Francisco, CA23 hours ago- ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers, storage, GPU drivers, and... ...systems. You will build production runtime infrastructure in Rust and Go, diagnose tough Linux and performance...
- ...upgrade manufacturing. We are engineers with deep experience across... ...into products, as well as AI-driven tools that highlight problems... .... We rebuilt the whole system, from X-ray capture, to... .... About the role: As an Infrastructure Engineer focused on On-Prem Systems...Work at officeFlexible hours
Lumafield
San Francisco, CA11 days ago - ...Required skills ~ Engineering ~322 Infra About... ...ecosystem of libraries for scalable machine learning.... ...accelerate the progress of AI applications out into... ...to be a distributed systems expert. Proud to... ...Engineer to join the Infrastructure team. Anyscale aims to...Full timeSan Francisco, CA4 days ago
- ...We are seeking a Full-Stack Engineer to build the product and infrastructure layer around an advanced wearable AI platform used in real-world... ...latency, connectivity, scalability, and hardware integration.... ...connecting wearable devices with AI systems. Design systems that...
MaxIT Consulting - Max Corporate Group
San Francisco, CA7 days ago $159.2k - $301.6k
...Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build... ...You will design and build the native infrastructure, service integration layers,... ...that are maintainable, testable, and scalable across multiple product surfaces. Improve...Full timeTemporary workLocal areaRemote workWorldwideAdobe Systems
San Francisco, CA2 days ago$300 per month
...mission‑critical inference for the world's most dynamic AI companies, such as... ...research, flexible infrastructure, and seamless developer... ...the platform engineers turn to to ship AI... ...and build robust systems, processes, automations... ...and maintaining scalable infrastructure....Flexible hoursBaseten
San Francisco, CA1 day ago$117k - $161k
Secure Every Identity, from AI to HumanIdentity is the key... ...building the trusted, neutral infrastructure that enables organizations... ...too, let's talk.The Senior Systems Engineer OpportunityAs a Senior Systems... ...pipelines to ensure repeatable, scalable, and automated deployments...Permanent employmentLocal areaWorldwideFlexible hoursOkta
San Francisco, CA14 hours ago$124k - $280k
...people in data and analytics engineering focus on leveraging advanced... ...developing and implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent decision... ...for LLM outputs- Developing scalable data storage solutions using...Full timeH1bPwC
San Francisco, CA23 hours ago- ...engineeringjobs.net, Inc. is seeking a senior backend engineer to lead a small, high-caliber team in San Francisco... ...You will establish engineering standards and drive scalable systems using TypeScript, AWS, and latest AI techniques. On-site in San Francisco; visa...
- ...Chroma Inc. is seeking an experienced distributed-systems engineer to help scale our open source data plane and cloud platform in San Francisco... ...of our storage, retrieval, and metadata components to support AI workloads at scale. You will collaborate with Database...
- ...Mixpeek is seeking a distributed systems engineer to help scale our data plane and cloud platform. You will build reliable components for vector search, storage, and metadata handling to support AI workloads at scale. You will work primarily with Rust, C++, or Zig,...
- ...Gallup's San Francisco office is seeking a senior software engineer to design and deliver full‑stack features, build production‑grade systems, and accelerate prototypes into scalable products. You’ll prototype with AI technologies, architect robust APIs, choose...Work at office3 days per week
$160k - $300k
A leading technology firm is seeking a Backend Engineer with 5+ years of experience to develop scalable systems and optimize performance. The ideal candidate will have expertise in backend development, proficiency in Python, Java, or Go, and a strong background in cloud...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Systems Engineer: Scalable AI Infrastructure. Be the first to apply!
Related searches
- senior linux systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- data systems engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- software system engineer San Francisco, CA
- space systems engineer San Francisco, CA
- electronic systems engineer San Francisco, CA