AI Infra Engineer
$200k - $275kHealthLeap
About Healthleap HealthLeap builds AI that helps clinicians prioritize patients, surfaces the right data, and gets patients the care they need earlier, so they can leave the hospital sooner. We integrate with hospital electronic health record systems, screen 100% of patients daily, and risk-rank them in real time. Clinicians at Cedars-Sinai and Penn Medicine start every morning with HealthLeap - with Houston Methodist, Emory, and Intermountain Health deploying now. Real results: 39% more diagnoses. 4 days earlier detection. $11M/year ROI for our first site at Cedars Sinai. 7× revenue growth in 7 months. We started with malnutrition. We're expanding to every major condition to ensure no patient falls through the cracks. Sequoia and First Round are backing us to build the platform that screens every patient for everything and drives tangible outcomes. We're ~15 people. >$7M raised. SF-based, hybrid-friendly. Early enough to shape the product. Late enough to know it works. Results that are changing lives.
About the Role Build the infrastructure that screens every hospital patient, every day. HealthLeap processes billions of data points from hospital EHRs. Data flows through secure connections, transforms through data pipelines, and powers ML models that clinicians rely on every morning. You'll work alongside our data scientists and ML engineers to build and operate the infrastructure that makes this possible. Why you You've built AI infrastructure at a startup where you owned everything. The person who set up the AWS accounts, wrote the Terraform, deployed the ML models, and debugged the VPN at 2am. You've taken models from Jupyter notebooks to production. You're the person who figures things out when the docs don't help. What you'll do
We respect your time. If there's a fit, you'll know fast. Compensation & Benefits
About the Role Build the infrastructure that screens every hospital patient, every day. HealthLeap processes billions of data points from hospital EHRs. Data flows through secure connections, transforms through data pipelines, and powers ML models that clinicians rely on every morning. You'll work alongside our data scientists and ML engineers to build and operate the infrastructure that makes this possible. Why you You've built AI infrastructure at a startup where you owned everything. The person who set up the AWS accounts, wrote the Terraform, deployed the ML models, and debugged the VPN at 2am. You've taken models from Jupyter notebooks to production. You're the person who figures things out when the docs don't help. What you'll do
- Deploy new hospitals: site-to-site VPNs, networking, container services, data pipelines
- Build reliable data infrastructure that ingests, transforms, and serves data at scale (S3, Iceberg, Spark, Dagster, Airflow)
- Partner with data scientists and ML engineers to productionize models and get them running reliably at scale
- Own AWS infrastructure: multi-account orgs, ECS/EKS, Terraform, networking
- Set up observability: monitoring, alerting, logging that actually helps debug issues
- Make hospital deployments faster and more reliable
- 5+ years engineering experience, with significant infrastructure work
- Deep AWS experience: networking, IAM, ECS/EKS, S3, and the rest
- Solid with Terraform or similar infrastructure-as-code
- Experience with data pipelines and orchestration (Dagster, Airflow, or similar)
- You've operated production systems, not just built them
- You figure things out, even when documentation doesn't exist
- MLOps experience: deploying and monitoring ML models in production
- Healthcare data standards (FHIR, HL7v2)
- Experience with Kubernetes, service mesh, or complex networking
- Background at an early-stage startup where you owned infra end-to-end
- Startup unpredictability feels like chaos to you. We find it exciting.
- You've never owned something end-to-end. Here, you own outcomes, not tasks.
- You wait to be told what to do next. We need people who see what's needed and do it.
- You're looking for a 9-5 with predictable hours. We care about deep work and deep rest (we have a minimum leave policy), but when a hospital go-live is on the line, we show up - even if that means a 60+ hour week.
- You've only worked on platform teams at large companies. We need someone who's built infra from scratch.
- You see collaboration as interruption. We see it as leverage. The best engineers here are constantly pulling each other in. If you prefer to work in isolation, this isn't the right fit.
- Intro call - Get to know each other
- Technical - 1-2 interviews
- Onsite - Coding, case study, team meet (~4-5 hours)
- Decision - Same week as onsite
We respect your time. If there's a fit, you'll know fast. Compensation & Benefits
- Salary: $200,000 - $275,000 base
- Equity: Meaningful ownership in an early-stage company
- Healthcare: 100% of premiums covered
- PTO: Unlimited, with a recommended minimum of 20 days
- 401(k): 4% match
- Equipment: Laptop + budget for your home office
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Infra Engineer in San Francisco, CA vacancy
- ...people interact with the web by building AI agents that can reliably do everyday digital... ..., etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT... ...generalist web‑agent Work closely with product engineers to translate cutting‑edge AI capabilities...SuggestedWork at officeRelocationVisa sponsorship
$200k - $275k
...work alongside our data scientists and ML engineers to build and operate the infrastructure... ...this possible. Why You You've built AI infrastructure at a startup where you owned... ...an early-stage startup where you owned infra end-to-end This Role Is Not For You...SuggestedHome officeDay shift- A leading AI technology firm in San Francisco is seeking an AI Infra Engineer to enhance their infrastructure. The successful candidate will design and maintain Kubernetes clusters and manage Slurm for distributed training. Important skills include extensive experience...Suggested
- Algora Public Benefit Corporation is looking for an AI Cloud Infra Engineer to join their team in San Francisco. You will ensure the reliability of backend systems and work closely with engineers to plan for future growth. The ideal candidate has strong cloud infrastructure...Suggested
- Kindredventures is hiring senior and staff engineers for our AI product engineering team in San Francisco. This hands-on role focuses on fine-tuning LLMs and optimizing data flows, impacting how companies hire exceptional talent. The ideal candidate will have 5+ years...Suggested
- palma.ai is seeking a seasoned software engineer to join its core team and build a multi-tenant control plane for AI. This role involves designing robust product features and managing deployment complexities in real-time systems. Successful candidates will have a strong...
- A leading AI technology firm in San Francisco is seeking a Senior Software Engineer for AIOps & Infrastructure. This role focuses on designing and optimizing scalable AI infrastructure, automating LLMOps and MLOps workflows, and improving system reliability. The ideal candidate...
$190k - $270k
AI Chopping Block, Inc. is seeking an AI Infrastructure Engineer in San Francisco. This role requires maintaining user-facing services and production systems, specializing in systems while ensuring their reliability and scalability. Candidates should have 5+ years of experience...$190k - $270k
AI Chopping Block, Inc. is looking for an AI Infrastructure Engineer to maintain user-facing services and production systems. You'll lead operations with tools like Ansible, Terraform, and Kubernetes while ensuring reliability and scalability. The role requires a strong...- A leading biotech firm in San Francisco is looking for an experienced engineer to build supportive infrastructure for their AI drug discovery models. This role involves close collaboration with product teams and offers opportunities for continuous learning in a fast-paced...
$150k - $200k
A groundbreaking AI-driven technology company in San Francisco is seeking to disrupt the SAP industry. This role focuses on deploying and managing environments using AWS and Terraform while ensuring security and compliance for enterprise clients. Ideal for builders and...- Hamilton Barnes Associates Limited is looking for a Senior Storage Engineer to support large-scale AI infrastructure in San Francisco. This role involves designing scalable storage solutions for high-performance GPU platforms. The ideal candidate has extensive experience...Remote job
- A healthcare technology startup is looking for an experienced engineer to build and manage AI infrastructure for hospitals. You will be responsible for deploying AWS services and collaborating with data scientists to handle patient data efficiently. The ideal candidate...
$190k - $270k
AI Chopping Block, Inc. in San Francisco is looking for an AI Infrastructure Engineer to ensure the highest quality service and keep production systems running smoothly. Candidates should have over 5 years of experience, a Bachelor's degree in a relevant field, and expertise...- A leading AI research and development firm in San Francisco is seeking infrastructure engineers to build the systems that power Codex agents. This role focuses on designing execution environments, developing orchestration systems, and optimizing performance and reliability...
$190k - $270k
AI Chopping Block, Inc. is looking for an AI Infrastructure Engineer to ensure smooth operation of user-facing services and production systems. You will handle infrastructure with tools like Ansible, Terraform, and Kubernetes while participating in on-call rotations for...$190k - $270k
AI Chopping Block, Inc. is looking for an AI Infrastructure Engineer based in San Francisco, California. The role involves ensuring production systems run smoothly, building infrastructure with tools like Ansible and Kubernetes, and implementing operational processes....$190k - $270k
Databricks is seeking a Staff Software Engineer for AI Research Infrastructure in San Francisco. The role involves designing and implementing systems for large-scale data processing, developing the research stack for AI research, and partnering with teams to create robust...$150k - $275k
Fluidstack in San Francisco is looking for a Product Engineer to work on their AI-integrated software stack. The successful candidate will own features from concept to outcome, identify problems, design solutions, and enhance operational efficiency. Qualifications include...- Xterra AI in San Francisco is hiring an AI Research Engineer to develop and build infrastructure for cutting-edge AI systems that tackle complex scientific challenges. In this role, you will work closely with AI researchers and domain experts to design agent infrastructures...
- A cutting-edge technology company in San Francisco is seeking a Solutions Engineer to guide customers through technical discovery and deployment. This role demands a strategic mindset with 3+ years of related engineering experience. Responsibilities include building demo...
$150k
Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible for building evaluation infrastructure, designing data pipelines, and implementing fine-tuning processes. Ideal candidates have...- Granica is looking for a skilled engineer specializing in distributed systems to design self-optimizing data infrastructure. This role involves... ...large-scale data systems. Join us to pioneer advancements in AI infrastructure while enjoying competitive salary, equity, and...
- Drata is seeking a Senior Platform AI Engineer in San Francisco to develop our AI infrastructure, responsible for building and managing the systems that support AI features across compliance platforms. You'll collaborate with cross-functional teams to enhance production...
- Cacheflow is seeking a skilled individual to join their AI Platform team in San Francisco. You'll take charge of the development... ...stack. Ideal candidates will have extensive experience in software engineering and AI infrastructure support. The position offers a...
- A leading software company is seeking a Full-Stack Platform Engineer to support the core platform behind its financial intelligence infrastructure. This role involves backend development, integrating AI capabilities, and building scalable systems for enterprise biopharma...
$150k - $200k
...Opportunity We're building the world's first viral agent. An AI purpose built for influencer marketing. Not a tool. Not a platform... ...across product, design, and business. Familiarity with cloud infra (AWS/GCP) and container tools (Docker, Kubernetes). Knowledge...- ...revolutionizing software development with AI-powered formal verification. We've developed... ...the role Join our team as an AI Engineer and help us push the boundaries of what's... ...~3+ years of production experience in ML Infra, DataOps, distributed training. Proficiency...Contract work
- A leading AI startup in San Francisco seeks a Senior Platform and Infrastructure Engineer. This role involves designing multi-cloud systems and developing secure deployment tooling for Enterprise Agent OS. The ideal candidate will have 3-7 years of experience in cloud infrastructure...
- AI Engineer Location: San Francisco or New York City About Pathwork Pathwork is redesigning life & health insurance jobs for the AI age.... ...stack, end‑to‑end : You’re comfortable moving between modeling, infra, and product‑facing code Have an entrepreneurial mindset and...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infra Engineer. Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- embedded ai engineer
- ai network engineer


