Senior Backend Engineer: Data Infrastructure & AI Inference
True Talent Solutions Partners
True Talent Solutions Partners is seeking a senior backend engineer to own the radiology-focused platform's data ingestion, warehousing, and model inference infrastructure on AWS. You will ensure reliability, observability, and scalable deployments, while collaborating with ML teams on evolving pipelines. The role requires 5+ years in backend/data infrastructure, proficiency in Go/Python/Java, and experience with HIPAA-compliant systems. On-site in San Francisco, visa sponsorship available. #J-18808-Ljbffr True Talent Solutions Partners
$200k - $250k
...we are building the AI Search Infrastructure that powers modern AI... ...Our team includes engineers, researchers, product... ...through one layer: our inference gateway. It allows users... ...a proxy, gateway, or data plane on the critical... ...closes A strong backend generalist (Python, Kubernetes...SeniorImmediate startRemote workWork from homeFlexible hours- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection,... ...role emphasizes building aproxy/gateway on the critical data path, with a focus on streaming responses and graceful degradation...Senior
$160k - $250k
Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should...Senior$160k - $250k
Together AI is building the Inference Platform that brings the most advanced generative AI models... ...‑latency load balancing across data centers and model engine pods. Develop auto‑scaling... ...building the next generation AI infrastructure. Compensation We offer competitive...SeniorFull timeLocal area- ...Health is building the core infrastructure for medical imaging AI in the United States. You... ..., build, and operate the data ingestion pipeline, data warehouse... ..., and a distributed inference system that powers... ...practice. You’ll work across the backend stack, shaping schemas,...Senior
- ...leading fintech company in San Francisco is seeking a Senior Software Engineer to join their Product Data Platform team. This role focuses on building scalable and reliable data infrastructure, requiring over 7 years of backend engineering experience with a strong emphasis on...Senior
- Lila Sciences in San Francisco is seeking a Senior Software Engineer with backend experience to join their Data Platform Team. The role involves designing and building high-performance APIs, managing diverse data systems, and collaborating with scientists and engineers...Senior
$210k - $230k
DOSS in San Francisco seeks an experienced engineer to design and build core data models and tooling for our Operations Cloud platform. The role involves... ...mentoring teams, and improving operational efficiencies using AI technologies. Candidates should have a strong ETL...Senior- ...Sphere is using AI to codify the world's international... ...'s first AI-native tax engine (which will be the... ...the need for scalable infrastructure to support transaction... ...volumes of transaction data. You’ll be getting very... .... Our core application backend and data pipeline services...SeniorLocal area
- Slope is hiring a senior backend engineer to own the backend systems that power its embedded credit, payments and underwriting. You will turn ambiguous... ..., latency, and correctness. You will build scalable APIs, data models, and tooling for the credit risk team, working with...SeniorRemote work
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still a builder, to own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU...SeniorPermanent employmentFull time$300k
...stealth-mode hyperscale data center startup building an AI and cloud platform, powered... ...scale model training, or inference. Our client operates... ...tune, and operate inference engines such as vLLM, SGLang, and... .... ~ Familiarity with Infrastructure-as-Code tools (Terraform,...SeniorPermanent employmentWorldwide$180k - $230k
Madrona Venture Labs in San Francisco is seeking a talented engineer to design the core EAV data model and build a Git-style version-control engine. You'll work with AI-assisted tooling and ensure the scalability of our white-labeled data warehouse. The ideal candidate...Senior$195k - $225k
...The Role As the Senior Software Engineer – Backend (Systems / Infrastructure) you’ll architect and deliver... ...APIs, performance, and data integrity — while... ...collaborating with frontend and AI teams to enable magical... ...to integrate GPU inference pipelines into user workflows...Senior- Affirm in San Francisco is seeking engineers to build and scale data platforms and services for real-time... ...and ownership. The role emphasizes backend systems with Python or Kotlin,... ...and collaboration across product and infrastructure to deliver reliable, scalable solutions...Senior
- ...intelligence firm for clinical development is hiring a Senior Backend and Data Platform Engineer in San Francisco, CA. The role focuses on building robust... ...and data engineering, with a strong emphasis on SQL and AI-powered data systems. Competitive compensation and comprehensive...Senior
- Finch is hiring a senior backend engineer to design and scale API-driven services in a hybrid SF/NYC environment. You will own large initiatives... ...product and security, and ship reliable systems that support our data-driven platform. The role requires 7+ years in backend...SeniorWork at office2 days per week
- A leading compensation platform company in San Francisco is seeking experienced backend engineers to build and maintain robust, data-rich systems for compensation processes. Ideal candidates have strong product intuition and hands-on experience with technologies like Node...SeniorFlexible hours
$180k - $225k
...powering the next generation of AI products. We build the infrastructure, tools, and model access... ...where high-performance inference, orchestration, and... ...fal, you will build the data infrastructure that turns... ...intersection of software engineering and data engineering. You...SeniorCurrently hiringRelocation package- General Compute is building a dedicated data center network to support its heterogeneous accelerator fleet for AI/HPC workloads. You will design and deploy the entire... ...management, shaping the backbone that powers inference across our fleet. #J-18808-Ljbffr General Compute
$240k - $360k
...the RoleWe're looking for a Senior Staff Data Engineer to be the technical... ...evolves as the company's AI ambitions scale. You'll work... ..., serving layers, and the infrastructure that makes ML models production... ...model training and inference workflows reliably.Raise the...SeniorWork at officeLocal areaImmediate startRemote workWorldwide3 days per week- ...Senior Data Platform Engineer Handshake is hiring a Senior Data Platform Engineer... ...to build and operate the infrastructure that moves data reliably... ...our career marketplace and AI products. On the Data and... ...workloads, including batch inference, evaluation datasets, and...SeniorFull timeWork at officeLocal areaRemote workFlexible hours
- Senior Software Engineer, Data Engineering Join to apply for the Senior Software Engineer, Data Engineering... ...open platform for evaluating how AI models perform in the real world.... ...team and build the data pipelines and infrastructure that powers real‑world AI evaluation...SeniorPermanent employmentWork at office
- Cline is seeking a Senior Infrastructure Engineer to build and scale infrastructure supporting AI inference pipelines, backend APIs, and enterprise integrations. You will design scalable, low‑latency systems, define SLAs/SLIs/SLOs, and lead cloud strategy across AWS/GCP...Senior
- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Software Engineer - Backend, Data ProductsAs a Senior Software Engineer on Backend, Data Products... ...development (Apache NiFi or similar) and fluency with AI coding assistants as part of your workflow.Performance-sensitive...Senior
- ...addresses.About the Data Cloud TeamRippling... ..., visualizations, AI-powered analytics,... ...Cloud is the data infrastructure layer that powers... ..."context-aware, senior analyst" for HR and... ...- Owns the query engine (RQL, Rippling Query... ...both product backend capabilities and user...SeniorWork at office3 days per week
- Firecrawl is the easiest way to turn the web into data AI agents can use. This role focuses on building and maintaining the infrastructure that powers reliable data collection at scale, enduring sites that fight back, and keeping the proxy layer healthy and cost-efficient...Senior
- Quanata, LLC is seeking a Senior Back End Engineer to design, build, and maintain core services and infrastructure powering Quanata’s products and operations. You will develop scalable back end systems, connect data and machine learning workflows, and ensure performance...SeniorRemote job
$170k - $230k
...Learning’s mission to harness transformative AI technologies to make world-class teaching and learning accessible to everyone. As a Senior Software Engineer at Kira, you will own core backend systems and infrastructure that power critical product workflows. This role...SeniorFull timeLive inWork at officeLocal areaFlexible hours$175k - $250k
...Python micro‑services for conversational AI orchestration—audio capture, streaming... ...Collaborate cross‑functionally with ML, product, data engineering, and client‑SDK teams to deliver... ...into voice agents. Familiarity with GPU inference and streaming pipelines. Salary and...SeniorFull timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer: Data Infrastructure & AI Inference. Be the first to apply!
- java developer backend San Francisco, CA
- senior backend developer San Francisco, CA
- back-end developer San Francisco, CA
- lead backend developer San Francisco, CA
- backend software engineer San Francisco, CA
- backend python developer San Francisco, CA
- remote back end developer San Francisco, CA
- data systems engineer San Francisco, CA
- finance data engineer San Francisco, CA
- data engineer contract San Francisco, CA



