Senior AI Inference Systems Engineer
Cloudflare - HQ
Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a global network, working with AI/ML engineers, hardware partners, and product teams to solve distributed systems challenges. Hybrid roles in Austin, TX or London, UK with exposure to edge compute and real-time workloads. The ideal candidate has deep Rust experience, proficiency in network protocols, and a track record of optimizing performance #J-18808-Ljbffr CloudFlare
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Systems Engineer in San Francisco, CA vacancy
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems... ...across production workloads. You will collaborate with senior ML engineers to fine-tune and deploy open-source...Senior
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...Senior
- ...a leading platform for customer-facing AI agents, based in San Francisco with offices... ..., and Asia. We are seeking a Software Engineer on Inference to define Sierra’s inference... ...on fast, reliable, and cost-efficient systems. This role is a systems-first position...Suggested
- Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage...Senior
- Deepgram is seeking a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our speech, audio,... ...gates into CI/CD, working with Research, training, inference, and product teams to protect the customer experience...Senior
$300k - $400k
...Mirendil Inc. is seeking a Systems Engineer in San Francisco to locate bottlenecks and optimize how compute is utilized. You will influence AI workload design, system co-design, and data movement across machines to maximize goodput while ensuring correctness under load...Senior- ...where we have a legal entity. Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will own and drive the... ...multi-step retrieval workflows. Partner with Rovo and AI platform teams to evolve search infrastructure as a foundational...SeniorWork at officeLocal area
Atlassian
San Francisco, CA5 days ago - ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving... ...Tuesday Information Systems at Lambda is responsible for... ...the company—Finance, GTM, Engineering, and People—to implement tools... ...optimize latency, and control inference costs across teams. Automate...SeniorWork at officeLocal areaWork from homeFlexible hours
$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On-siteWanna join the adventure... ...of a traditional space mission.As a Senior Product Systems Engineer at Loft, you... ...observation, IoT connectivity, on-orbit AI, national security missions, and more. Leveraging...SeniorFull timeTemporary workLoft Orbital
San Francisco, CA3 days ago$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...on developing and implementing advanced AI and ML solutions to drive innovation and... ...and optimising algorithms, models, and systems to enable intelligent decision-making and...SeniorFull timeH1bPwC
San Francisco, CA3 days ago- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway...Senior
- ...and build high quality agentic search systems, addressing tail latency, throughput, concurrency... ...serving, query processing, and ML inference. Turn advances in information retrieval... ..., simplify fragmented systems, mentor senior engineers, and align technical and product...SeniorWork at officeLocal area
Atlassian
San Francisco, CA2 days ago - Mercor is seeking a senior DB engineer to design and evaluate real-world database engineering tasks for AI agents. You will craft challenging, self-contained assignments, implement robust checks for correctness under concurrency and failure, and analyze latency, throughput...Senior
- ...seeking a highly technical Enterprise Agent Systems Engineer to build and deploy advanced agent... ...strong software engineering with applied AI research judgment. You will work directly... ...with technical enterprise stakeholders. Seniority The search is open from exceptional new...Senior
$250k - $350k
...mission is to develop reliable AI systems for the world’s most... ...Staff Machine Learning Research Engineer, you will operate across the... ...needed — training/fine-tuning, inference, memory and retrieval, evaluation... ...technical direction, mentor senior and staff-track engineers and...SeniorFull timeScale AI
San Francisco, CA4 days ago- Deepgram is seeking a backend software engineer to lead the design and... ...services. You will build and optimize inference backends, orchestration, and... ...to-end features, tackle complex system challenges, and iterate rapidly in a fast-moving AI-first environment. #J-18808-Ljbffr...Senior
- ...Acceler8 Talent is seeking a hands-on Staff, Senior Staff, or Principal RTL Design Engineer for a seed AI hardware startup building a dedicated LLM inference ASIC. You will own a substantial RTL scope and translate microarchitecture into synthesizable RTL, collaborating...
- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence... ...& Notifications pod is creating the systems that determine what message a member... ...yearOperate reliable online and batch inference capabilities that meet clear contracts...SeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA1 day ago $159.2k - $301.6k
The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build the next generation of AI-enabled product and platform capabilities. This role sits at the intersection of large-scale systems engineering, applied AI, and production...SeniorFull timeTemporary workLocal areaRemote workWorldwideAdobe Systems
San Francisco, CA5 days ago- ...Ready to write your story?Join MoFo as a Senior Cloud Systems Engineeron our Information Technology... ...ABOUT THE ROLEThe Senior Cloud Systems Engineer is responsible for the architecture, engineering... ...and support of infrastructure for AI solutions, including Microsoft 365...SeniorWork experience placementWork at officeLocal area
Morrison & Foerster
San Francisco, CA1 day ago - Leadout Capital in San Francisco seeks a Distributed Systems Software Engineer for Public Cloud at Senior/Lead/Principal levels. You will design scalable backend... ...nodes. You will work with Kubernetes, Terraform, and AI-powered tooling, contribute to open source like...Senior
$185.5k - $232k
...Senior Site Reliability Engineer New York, NY; Boston, MA; San Francisco, CA About... ...Bio is a tech and AI driven pharma company differentiated... ...infrastructure, delivery systems, and operational practices... ...data systems, ML pipelines, inference, and agentic software. Research...SeniorWork experience placementWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA3 days ago$250k - $300k
...only vertically integrated AI infrastructure company built... ...Crusoe.About the Role:As a Senior Engineering Manager, you will lead an engineering... ...and hands-on with the inference stack end to end: profiling... ...balances team leadership with core systems and performance engineering...SeniorTemporary workCrusoe
San Francisco, CA3 days ago$124k - $280k
...people in data and analytics engineering focus on leveraging advanced technologies... ...and implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent decision... ...system and health plans. As a Senior Manager, you will drive use case...SeniorFull timeH1bPwC
San Francisco, CA2 days ago- Nscale is seeking a Principal AI Engineer to lead the inference and post-training pillar of our AI systems engineering organization in the United States. You will shape... ...offs, drive cross-team collaboration, and mentor senior engineers while representing Nscale externally...
- Salesforce is seeking senior software developers to impact our AI-enabled CRM platform. You will build scalable components for distributed filesystems, review code, and mentor junior engineers, while leveraging Java, Python and cloud services across AWS/Azure/GCP. We embrace...Senior
- Leadout Capital seeks an experienced Distributed Systems Software Engineer - GovCloud (Senior/Lead) to join our public cloud engineering team in the U.S. You... ...systems, ensure high availability, and integrate AI-driven tooling into production workflows. The role emphasizes...Senior
- ...intelligence. We build the systems that make large-scale visual inference fast, reliable, and... ...other leading investors. Engineers at Hedra work across boundaries... ...Role We’re looking for a Senior or Staff Software... ...not need to come from an AI company or already be an...SeniorWork at office
$215k - $275k
About the Role Join a small engineering team building the backend infrastructure for a... ...-focused healthcare platform and its AI copilot. You will own critical systems across data ingestion, warehousing, and distributed model inference, helping make the platform reliable and...SeniorVisa sponsorship- ...powering the next generation of AI products. We build the... ...platform where high-performance inference, orchestration, and observability... ...that owns fal's core product systems — the connected tissue the whole... ...expose usage, cost, and access. Engineer for correctness and resilience...SeniorVisa sponsorshipRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Systems Engineer. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai engineer San Francisco, CA
- data systems engineer San Francisco, CA
- director systems engineering San Francisco, CA