Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior/Staff Platform Engineer, Data & AI Infrastructure

$190k - $260k
Full-time

Keebler Health

About the role

Keebler Health builds AI-driven risk adjustment and hospitalization-prevention products for healthcare organizations. Over the next few quarters we’re tripling the volume of clinical data we manage, and the systems that got us here won’t get us there. We’re looking for a hands-on senior engineer to own the scaling of our data and AI infrastructure: storage, retrieval, model throughput, and the compute and network underneath it.

This isn’t a greenfield role. You’ll work on real systems under real load in a HIPAA-regulated AWS environment, alongside a small, senior team.

This is a US-based remote position. We have a strong preference for candidates based in North Carolina or New York, where our team hubs are.

What you’ll build

We’re tripling the clinical data we manage over the next few quarters. You’ll work on the data and AI platform that makes that growth routine rather than heroic, working in a HIPAA-regulated AWS environment alongside a small, senior team.

  • A retrieval layer that scales with the data. Our embedding store is 8TB today and heading toward ~25TB. You’ll decide how semantic search is built for that scale: index strategy, quantization, partitioning, tiering, or a different storage engine entirely. You’ll set the latency and recall targets and the cost model behind them.

  • A model gateway for every LLM workload. Today, high-volume workloads can run into provider rate limits. You’ll design the shared layer that all model traffic goes through: queueing and backpressure, batching, caching, prioritization, and routing across providers and models. The goal is that product teams never think about quotas.

  • Network and cluster foundations that scale with us. You’ll evolve the AWS networking and compute foundations behind our data and AI workloads, partnering with our DevOps engineer to anticipate capacity limits and address bottlenecks before they affect delivery. That could mean improving network addressing, cluster capacity, or resource utilization.

  • A data architecture that separates workloads by design. Bulk ingestion, transactional traffic, and analytics currently share Aurora. You’ll define how each should be served, whether through staging pipelines, replicas, CDC into a warehouse or lakehouse, or something else, so that ingestion volume can grow without touching application performance.

  • A self-hosted inference platform . We already serve OCR models on vLLM and are expanding into open-weight LLMs. You’ll build the platform around them: benchmarking and model selection, GPU capacity planning, autoscaling, throughput tuning, and a clear framework for which workloads belong on self-hosted models versus commercial APIs.

Experience that’s relevant

You don’t need to have solved these exact problems before. We care about adjacent experience and sound judgment about tradeoffs. Strong candidates will have several of the following:

  • Large-scale search or retrieval systems. This could be vector databases (pgvector, OpenSearch k-NN, Pinecone, Turbopuffer, Milvus), but classic search infrastructure (Elasticsearch/Lucene), recommender candidate retrieval, or any work tuning latency on large indexes is directly applicable. You should understand the tradeoffs between ANN index types, memory footprint, recall, and cost.

  • High-throughput systems built on quota-limited dependencies. Work in payments, ad-tech, data integrations, or anywhere you’ve had to push large volumes through third-party APIs with hard limits. You know how to use token buckets, priority queues, idempotent retries, and graceful degradation.

  • Postgres at scale. Deep experience with query planning, partitioning, bulk ingestion (COPY, staging tables, batching), connection management, and replica strategy. Aurora-specific experience is a plus. Experience separating OLTP from analytical workloads (CDC into a warehouse or lakehouse, for example) is especially valuable.

  • AWS networking and Kubernetes. You’re comfortable with VPC design, subnet planning, and EKS networking (VPC CNI behavior, prefix delegation, secondary CIDRs, IPv6), or you have the equivalent depth on another major cloud.

  • Capacity planning and cost modeling. You can project how a system behaves at 3x, identify which components scale nonlinearly, and make a cost-aware case for when to optimize and when to re-architect.

  • Observability. You instrument before you optimize, and you’re comfortable with metrics, tracing, and profiling across application and database layers.

  • Production model inference. Experience serving models on GPUs in production, whether that’s LLMs on vLLM, SGLang, TGI, or TensorRT-LLM, or earlier-generation serving on Triton or TorchServe. You should understand the levers that matter for throughput and cost, including continuous batching, KV cache memory, quantization (AWQ, GPTQ, FP8), tensor parallelism, and GPU instance selection. Experience running GPU workloads on Kubernetes (node pools, the NVIDIA device plugin, Karpenter or a similar autoscaler) is especially relevant.

Nice to have

  • Experience in a regulated environment (HIPAA, SOC 2, PCI, or similar), including working under BAAs and data-residency constraints

  • Familiarity with LLM application infrastructure: embedding pipelines, multi-provider routing, Bedrock or OpenAI, batch inference APIs

  • Startup experience, where you were the person who both made the architectural decision and shipped it

  • Python and/or TypeScript fluency, plus infrastructure-as-code (Terraform, CDK, Pulumi)

What success looks like in the first six months

Semantic search latency is well within product requirements at current volume, with a credible path to 3x. Model throughput is no longer a recurring incident category. Nightly loads complete without database alarms. The team has a capacity plan it trusts.

What We Offer

  • Competitive salary, equity options, and benefits package.

  • A fast-paced, innovative environment.

  • Professional growth and development opportunities.

  • A collaborative and supportive team culture.

  • The chance to make a meaningful impact on the healthcare industry.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior/Staff Platform Engineer, Data & AI Infrastructure in Remote vacancy
  • $200k - $233k

     ...that. We build the infrastructure behind Dynamic...  ...only independent platform in the market. We...  ...now Getting the data right is not an internal...  ...foundation every engine and every customer...  ...We’re hiring a Staff/Principal Data Platform...  .... Strong AI skills. You use AI... 
    Senior
    Full time
    Remote work
    Home office

    Helm Health

    Remote
    10 days ago
  •  ...are helping electrical engineers save time and...  ...electromagnetic simulation, ML/AI, and high-performance...  ...We’re looking for a Senior or Staff Platform Engineer to build and...  ...operate secure cloud infrastructure and automate the...  ...safe deployment and data access. Work with the... 
    Senior
    Full time

    Quilter

    Remote
    18 days ago
  • $156k - $215k

     ...secure our future. As AI reshapes how...  ...enterprises, critical infrastructure, and the technologies...  ...cybersecurity. Our AI-native platform unifies protection...  ...endpoint, cloud, identity, data, and AI systems to...  ...outcomes. As a Staff AI Platform Engineer, Infrastructure Services... 
    Senior
    Full time
    Local area
    Home office
    Flexible hours

    SentinelOne

    Remote
    10 days ago
  • $170k

     ...their suppliers at scale. Our AI research and monitoring...  ...of our unique, proprietary data platform - this helps our customers make...  ...behind our GraphQL APIs, and the infrastructure that brings our data into...  .... Craft is an AI-native engineering organization. Claude Code is... 
    Senior
    Full time
    Remote work

    Craft Machine Inc

    Remote
    2 days ago
  • $215k - $235k

     ...redefining what's possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI...  ...board. Job Summary We are hiring a Senior Staff Engineer to set the technical direction for the Data Platform and to build it hands-on. Databricks is... 
    Senior
    Full time
    Live in
    Flexible hours

    Qualified Health PBC

    Remote
    8 days ago
  • $240k - $335k

     ...the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering...  ...evolves as the company's AI ambitions scale. You'll work...  ...pipelines, serving layers, and the infrastructure that makes ML models... 
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  •  ...geofencing SDKs, maps APIs, and AI-enabled solutions for...  ...the role We're looking for a Data Platform Engineer to build out the next...  ...molds, technically: either Staff level expertise in one stack...  ...vision of full-stack location infrastructure, but we also know that customer... 
    Senior
    Work at office
    Remote work

    RADAR

    New York, NY
    1 day ago
  • $180k - $225k

     ...that. We build the infrastructure behind Dynamic...  ...only independent platform in the market. We...  ...people. Getting the data right is not an...  ...foundation every engine and every...  ...them. We’re hiring Senior and Staff engineers who are...  ...We build with AI every day, both in... 
    Senior
    Full time
    Remote work
    Home office

    Helm Health

    Remote
    8 days ago
  • $244k - $305k

     ...You Will Join:  AI and ML are at the...  ...Assistance Engineering initiatives by adopting...  ...of Airbnb's data, the complexity of...  ...Make: In this Senior Staff Machine Learning...  ...evaluation and data infrastructure, balancing speed,...  ...robust evaluation platforms for agent behavior... 
    Senior
    Full time
    Work experience placement
    Casual work
    Live in
    Work at office
    Remote work

    Airbnb

    Remote
    10 days ago
  • $139k - $183k

     ...meaningfully expand what our engineering and care teams can accomplish using AI. This role builds the platform that makes that...  ...runs on cloud infrastructure, you also bring a...  .... Work with the data platform so agents...  ...platform hygiene. ~ Senior Staff-level judgment: you... 
    Senior
    Full time

    Cityblock Health

    Remote
    14 days ago
  •  ...we are helping electrical engineers save time and accomplish more...  ...simulation, ML/AI, and high-performance computing...  ...Rigor We’re looking for a Senior or Staff Platform Engineer to lead customer-facing...  ...Platform team builds the infrastructure that runs these compute-intensive... 
    Senior
    Full time

    Quilter

    Remote
    18 days ago
  • $262.22k

     ...Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their...  ...biggest brands. We are looking for a Senior Staff Platform Engineer to lead the design and evolution of our global cloud infrastructure, with deep expertise in  Microsoft... 
    Senior
    Base plus commission
    Full time
    Temporary work
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Veeam Software

    Remote
    4 days ago
  • $136k - $245k

     ...modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems...  ...We're seeking an experienced Sr. Platform Data Engineer to architect, deploy, and operate the core data infrastructure and platform services underpinning... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    Remote
    28 days ago
  •  ...built for the way people and AI agents work today. As one...  ...digital future. Our Infrastructure Services organization is responsible...  ...Stateful Services. As a Senior Staff Cloud Platform Engineer, you set the multi-year...  ...and edge and in stateful data systems, and you understand... 
    Senior
    Full time
    Immediate start
    Remote work

    1password

    Canada
    a month ago
  • $181.2k - $317.1k

     ...all started when engineer Fred Luddy wrote code...  ...ServiceNow is the AI control tower for...  ...Our ServiceNow AI platform brings together any AI, any data, and any workflow—...  ...a seasoned IC5 Senior Staff Engineer with deep...  ...way software and infrastructure are built.12+ years... 
    Senior
    Permanent employment
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Santa Clara, CA
    2 days ago
  •  ...their suppliers at scale. Our AI research and monitoring...  ...of our unique, proprietary data platform - this helps our customers make...  ...behind our GraphQL APIs, and the infrastructure that brings our data into...  .... Craft is an AI-native engineering organization. Claude Code is... 
    Senior
    Remote job
    Full time

    craft.co

    Remote
    7 days ago
  •  ...Shield AI is a venture-backed defense-tech company with...  ...Description: The Sr. Staff Platform / Data Reliability Engineer is responsible for making...  ...closely with the Senior Staff Data Engineer, who...  ...with the existing Cloud & Infrastructure team, which owns cloud accounts... 
    Senior
    Full time
    Temporary work
    Part time
    Worldwide

    Shield AI

    Remote
    11 days ago
  • $113.33k - $198.17k

     ...Salesforce Salesforce is the #1 AI CRM, where humans with...  ...is looking for a motivated Platform Solution Engineer to join our extremely...  ...with information security, infrastructure, and networking capabilities...  ...about how we use your personal data and your rights, including... 
    Senior
    Full time

    Salesforce

    Remote
    7 days ago
  • $213k - $263k

     ...also be applied to a range of vehicle platforms and product use cases. The Waymo...  ...car. We are looking for experienced data-minded software engineers and data scientists to help us...  ...Design and implement robust tools and infrastructure for data mining, exploration, and analysis... 
    Senior
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  •  ...reliable, and resilient AI compute at scale. We've built a versatile cloud platform that eliminates infrastructure barriers, empowering builders...  ...a Kubernetes Platform Staff Infrastructure Engineer to join our team during...  ...regional scaling, multi-data center cluster... 
    Senior
    Remote job
    Full time
    Temporary work
    Work at office
    Flexible hours

    tensorwave

    Remote
    7 days ago
  • $101.6k - $152.4k

     ...possible in healthcare. As a Senior Platform Engineer, you are a hands-on...  ...sits at the intersection of data engineering, cloud platform...  ...networking — building the infrastructure and pipelines that make Ensemble...  .... Continuous Learning & AI Fluency — Stays current... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Work from home

    Ensemble Health Partners

    Remote
    10 days ago
  • $140k - $200k

     ..., technology, and data to deliver impactful...  ...span Data & AI, Cybersecurity, Risk...  ...industry expertise with engineering excellence to help...  ...clients modernize platforms, unlock data...  ...seeking an experienced Senior Platform Engineer...  ...management of infrastructure powering enterprise... 
    Senior
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP

    New York, NY
    2 days ago
  •  ...As Senior Staff Engineer, Infrastructure Systems, you will own the GPU software stack on every Runware node: the firmware, the kernel and NVIDIA driver...  ...contribute fixes to the open-source tools we depend on. Use AI to accelerate the work: agents for log and Xid triage,... 
    Senior
    Full time
    Remote work
    Flexible hours

    Runware

    California
    6 days ago
  •  ...Senior Infrastructure/ Platform Engineer (TS/SCI): Hybrid, Suitland, MD A fast-growing, profitable defense technology company is hiring a Senior Infrastructure/ Platform Engineer. They build data management and AI platforms for maritime domain awareness, and their software... 
    Senior
    Full time
    Contract work
    Home office

    Landshark Recruiting

    Baltimore, MD
    1 day ago
  •  ...the Role As an Infrastructure Engineer at Fieldguide, you...  ...decisions, build platforms that other teams...  ...abstractions, and AI-enabled tooling that...  ...of SQL and NoSQL data systems....  ...Responsibilities At the Senior level, you may:...  ...executives. At the Staff level, you may:... 
    Senior
    Remote work
    Work from home
    Flexible hours

    Fieldguide.ai

    New York, NY
    1 day ago
  • $135k - $170k

     ...Our partner is looking for a Staff/Senior Data Engineer based in the United States....  ...of a modern data and analytics infrastructure within an innovative robotics and AI environment. You will build and...  ...Storage, Jira, web analytics platforms, and other sources into BigQuery... 
    Senior
    Full time
    Remote work
    Worldwide

    Jobgether

    Remote
    7 days ago
  • $190.9k - $334.1k

     ...It all started when engineer Fred Luddy wrote...  ...ServiceNow is the AI control tower for business...  ...Our ServiceNow AI platform brings together any AI, any data, and any workflow-...  ...Job Description Senior Staff Software Engineer, Agentic Search Infrastructure About the Role Join... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Mountain View, CA
    1 day ago
  • Senior AI Platform Engineer (Data and Analytics Cloud Engineer) Immediate need for a talented Senior AI Platform Engineer (Data and Analytics Cloud...  ...control, build automation, and CI/CD pipelines for infrastructure and application deployments. Deploy infrastructure as code... 
    Senior
    Contract work
    Local area
    Immediate start

    Pyramid Consulting

    Raleigh, NC
    1 day ago
  • $152k - $287.5k

     ...NVIDIA is hiring engineers to build and operate the governed infrastructure platform behind our Electronic Design Automation (EDA)...  ...including a solid understanding of data structures, algorithms, testing,...  ...NVIDIA dedicated to scaling the AI infrastructure that powers... 
    Senior
    Full time

    NVIDIA

    California
    1 day ago
  • Senior Staff Infrastructure Engineer The Senior Staff Infrastructure Engineer is a critical, hybrid remote role...  ...Qualifications: Enterprise AI: Experience designing, evaluating, and...  ...affordable, attritable, mission-configurable platforms that give U.S. and allied... 
    Senior
    Permanent employment
    Temporary work
    Remote work

    Firestorm

    San Diego, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior/Staff Platform Engineer, Data & AI Infrastructure. Be the first to apply!