Senior/Staff Platform Engineer, Data & AI Infrastructure
$190k - $260kKeebler Health
About the role
Keebler Health builds AI-driven risk adjustment and hospitalization-prevention products for healthcare organizations. Over the next few quarters we’re tripling the volume of clinical data we manage, and the systems that got us here won’t get us there. We’re looking for a hands-on senior engineer to own the scaling of our data and AI infrastructure: storage, retrieval, model throughput, and the compute and network underneath it.
This isn’t a greenfield role. You’ll work on real systems under real load in a HIPAA-regulated AWS environment, alongside a small, senior team.
This is a US-based remote position. We have a strong preference for candidates based in North Carolina or New York, where our team hubs are.
What you’ll build
We’re tripling the clinical data we manage over the next few quarters. You’ll work on the data and AI platform that makes that growth routine rather than heroic, working in a HIPAA-regulated AWS environment alongside a small, senior team.
A retrieval layer that scales with the data. Our embedding store is 8TB today and heading toward ~25TB. You’ll decide how semantic search is built for that scale: index strategy, quantization, partitioning, tiering, or a different storage engine entirely. You’ll set the latency and recall targets and the cost model behind them.
A model gateway for every LLM workload. Today, high-volume workloads can run into provider rate limits. You’ll design the shared layer that all model traffic goes through: queueing and backpressure, batching, caching, prioritization, and routing across providers and models. The goal is that product teams never think about quotas.
Network and cluster foundations that scale with us. You’ll evolve the AWS networking and compute foundations behind our data and AI workloads, partnering with our DevOps engineer to anticipate capacity limits and address bottlenecks before they affect delivery. That could mean improving network addressing, cluster capacity, or resource utilization.
A data architecture that separates workloads by design. Bulk ingestion, transactional traffic, and analytics currently share Aurora. You’ll define how each should be served, whether through staging pipelines, replicas, CDC into a warehouse or lakehouse, or something else, so that ingestion volume can grow without touching application performance.
A self-hosted inference platform . We already serve OCR models on vLLM and are expanding into open-weight LLMs. You’ll build the platform around them: benchmarking and model selection, GPU capacity planning, autoscaling, throughput tuning, and a clear framework for which workloads belong on self-hosted models versus commercial APIs.
Experience that’s relevant
You don’t need to have solved these exact problems before. We care about adjacent experience and sound judgment about tradeoffs. Strong candidates will have several of the following:
Large-scale search or retrieval systems. This could be vector databases (pgvector, OpenSearch k-NN, Pinecone, Turbopuffer, Milvus), but classic search infrastructure (Elasticsearch/Lucene), recommender candidate retrieval, or any work tuning latency on large indexes is directly applicable. You should understand the tradeoffs between ANN index types, memory footprint, recall, and cost.
High-throughput systems built on quota-limited dependencies. Work in payments, ad-tech, data integrations, or anywhere you’ve had to push large volumes through third-party APIs with hard limits. You know how to use token buckets, priority queues, idempotent retries, and graceful degradation.
Postgres at scale. Deep experience with query planning, partitioning, bulk ingestion (COPY, staging tables, batching), connection management, and replica strategy. Aurora-specific experience is a plus. Experience separating OLTP from analytical workloads (CDC into a warehouse or lakehouse, for example) is especially valuable.
AWS networking and Kubernetes. You’re comfortable with VPC design, subnet planning, and EKS networking (VPC CNI behavior, prefix delegation, secondary CIDRs, IPv6), or you have the equivalent depth on another major cloud.
Capacity planning and cost modeling. You can project how a system behaves at 3x, identify which components scale nonlinearly, and make a cost-aware case for when to optimize and when to re-architect.
Observability. You instrument before you optimize, and you’re comfortable with metrics, tracing, and profiling across application and database layers.
Production model inference. Experience serving models on GPUs in production, whether that’s LLMs on vLLM, SGLang, TGI, or TensorRT-LLM, or earlier-generation serving on Triton or TorchServe. You should understand the levers that matter for throughput and cost, including continuous batching, KV cache memory, quantization (AWQ, GPTQ, FP8), tensor parallelism, and GPU instance selection. Experience running GPU workloads on Kubernetes (node pools, the NVIDIA device plugin, Karpenter or a similar autoscaler) is especially relevant.
Nice to have
Experience in a regulated environment (HIPAA, SOC 2, PCI, or similar), including working under BAAs and data-residency constraints
Familiarity with LLM application infrastructure: embedding pipelines, multi-provider routing, Bedrock or OpenAI, batch inference APIs
Startup experience, where you were the person who both made the architectural decision and shipped it
Python and/or TypeScript fluency, plus infrastructure-as-code (Terraform, CDK, Pulumi)
What success looks like in the first six months
Semantic search latency is well within product requirements at current volume, with a credible path to 3x. Model throughput is no longer a recurring incident category. Nightly loads complete without database alarms. The team has a capacity plan it trusts.
What We Offer
Competitive salary, equity options, and benefits package.
A fast-paced, innovative environment.
Professional growth and development opportunities.
A collaborative and supportive team culture.
The chance to make a meaningful impact on the healthcare industry.
$200k - $233k
...that. We build the infrastructure behind Dynamic... ...only independent platform in the market. We... ...now Getting the data right is not an internal... ...foundation every engine and every customer... ...We’re hiring a Staff/Principal Data Platform... .... Strong AI skills. You use AI...SeniorFull timeRemote workHome office- ...are helping electrical engineers save time and... ...electromagnetic simulation, ML/AI, and high-performance... ...We’re looking for a Senior or Staff Platform Engineer to build and... ...operate secure cloud infrastructure and automate the... ...safe deployment and data access. Work with the...SeniorFull time
$156k - $215k
...secure our future. As AI reshapes how... ...enterprises, critical infrastructure, and the technologies... ...cybersecurity. Our AI-native platform unifies protection... ...endpoint, cloud, identity, data, and AI systems to... ...outcomes. As a Staff AI Platform Engineer, Infrastructure Services...SeniorFull timeLocal areaHome officeFlexible hours$170k
...their suppliers at scale. Our AI research and monitoring... ...of our unique, proprietary data platform - this helps our customers make... ...behind our GraphQL APIs, and the infrastructure that brings our data into... .... Craft is an AI-native engineering organization. Claude Code is...SeniorFull timeRemote work$215k - $235k
...redefining what's possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI... ...board. Job Summary We are hiring a Senior Staff Engineer to set the technical direction for the Data Platform and to build it hands-on. Databricks is...SeniorFull timeLive inFlexible hours$240k - $335k
...the RoleWe're looking for a Senior Staff Data Engineer to be the technical backbone of our Data & ML Platform team — the foundation powering... ...evolves as the company's AI ambitions scale. You'll work... ...pipelines, serving layers, and the infrastructure that makes ML models...SeniorWork at officeLocal areaImmediate startRemote workWorldwide3 days per week- ...geofencing SDKs, maps APIs, and AI-enabled solutions for... ...the role We're looking for a Data Platform Engineer to build out the next... ...molds, technically: either Staff level expertise in one stack... ...vision of full-stack location infrastructure, but we also know that customer...SeniorWork at officeRemote work
$180k - $225k
...that. We build the infrastructure behind Dynamic... ...only independent platform in the market. We... ...people. Getting the data right is not an... ...foundation every engine and every... ...them. We’re hiring Senior and Staff engineers who are... ...We build with AI every day, both in...SeniorFull timeRemote workHome office$244k - $305k
...You Will Join: AI and ML are at the... ...Assistance Engineering initiatives by adopting... ...of Airbnb's data, the complexity of... ...Make: In this Senior Staff Machine Learning... ...evaluation and data infrastructure, balancing speed,... ...robust evaluation platforms for agent behavior...SeniorFull timeWork experience placementCasual workLive inWork at officeRemote work$139k - $183k
...meaningfully expand what our engineering and care teams can accomplish using AI. This role builds the platform that makes that... ...runs on cloud infrastructure, you also bring a... .... Work with the data platform so agents... ...platform hygiene. ~ Senior Staff-level judgment: you...SeniorFull time- ...we are helping electrical engineers save time and accomplish more... ...simulation, ML/AI, and high-performance computing... ...Rigor We’re looking for a Senior or Staff Platform Engineer to lead customer-facing... ...Platform team builds the infrastructure that runs these compute-intensive...SeniorFull time
$262.22k
...Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their... ...biggest brands. We are looking for a Senior Staff Platform Engineer to lead the design and evolution of our global cloud infrastructure, with deep expertise in Microsoft...SeniorBase plus commissionFull timeTemporary workLocal areaImmediate startRemote workWorldwideFlexible hours$136k - $245k
...modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems... ...We're seeking an experienced Sr. Platform Data Engineer to architect, deploy, and operate the core data infrastructure and platform services underpinning...SeniorPermanent employmentWork experience placementWork at officeLocal areaRemote work- ...built for the way people and AI agents work today. As one... ...digital future. Our Infrastructure Services organization is responsible... ...Stateful Services. As a Senior Staff Cloud Platform Engineer, you set the multi-year... ...and edge and in stateful data systems, and you understand...SeniorFull timeImmediate startRemote work
$181.2k - $317.1k
...all started when engineer Fred Luddy wrote code... ...ServiceNow is the AI control tower for... ...Our ServiceNow AI platform brings together any AI, any data, and any workflow—... ...a seasoned IC5 Senior Staff Engineer with deep... ...way software and infrastructure are built.12+ years...SeniorPermanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week- ...their suppliers at scale. Our AI research and monitoring... ...of our unique, proprietary data platform - this helps our customers make... ...behind our GraphQL APIs, and the infrastructure that brings our data into... .... Craft is an AI-native engineering organization. Claude Code is...SeniorRemote jobFull time
- ...Shield AI is a venture-backed defense-tech company with... ...Description: The Sr. Staff Platform / Data Reliability Engineer is responsible for making... ...closely with the Senior Staff Data Engineer, who... ...with the existing Cloud & Infrastructure team, which owns cloud accounts...SeniorFull timeTemporary workPart timeWorldwide
$113.33k - $198.17k
...Salesforce Salesforce is the #1 AI CRM, where humans with... ...is looking for a motivated Platform Solution Engineer to join our extremely... ...with information security, infrastructure, and networking capabilities... ...about how we use your personal data and your rights, including...SeniorFull time$213k - $263k
...also be applied to a range of vehicle platforms and product use cases. The Waymo... ...car. We are looking for experienced data-minded software engineers and data scientists to help us... ...Design and implement robust tools and infrastructure for data mining, exploration, and analysis...SeniorFull timeRemote work- ...reliable, and resilient AI compute at scale. We've built a versatile cloud platform that eliminates infrastructure barriers, empowering builders... ...a Kubernetes Platform Staff Infrastructure Engineer to join our team during... ...regional scaling, multi-data center cluster...SeniorRemote jobFull timeTemporary workWork at officeFlexible hours
$101.6k - $152.4k
...possible in healthcare. As a Senior Platform Engineer, you are a hands-on... ...sits at the intersection of data engineering, cloud platform... ...networking — building the infrastructure and pipelines that make Ensemble... .... Continuous Learning & AI Fluency — Stays current...SeniorFull timeWork at officeLocal areaRemote workWork from home$140k - $200k
..., technology, and data to deliver impactful... ...span Data & AI, Cybersecurity, Risk... ...industry expertise with engineering excellence to help... ...clients modernize platforms, unlock data... ...seeking an experienced Senior Platform Engineer... ...management of infrastructure powering enterprise...SeniorFull timeTemporary workRemote workWorldwide- ...As Senior Staff Engineer, Infrastructure Systems, you will own the GPU software stack on every Runware node: the firmware, the kernel and NVIDIA driver... ...contribute fixes to the open-source tools we depend on. Use AI to accelerate the work: agents for log and Xid triage,...SeniorFull timeRemote workFlexible hours
- ...Senior Infrastructure/ Platform Engineer (TS/SCI): Hybrid, Suitland, MD A fast-growing, profitable defense technology company is hiring a Senior Infrastructure/ Platform Engineer. They build data management and AI platforms for maritime domain awareness, and their software...SeniorFull timeContract workHome office
- ...the Role As an Infrastructure Engineer at Fieldguide, you... ...decisions, build platforms that other teams... ...abstractions, and AI-enabled tooling that... ...of SQL and NoSQL data systems.... ...Responsibilities At the Senior level, you may:... ...executives. At the Staff level, you may:...SeniorRemote workWork from homeFlexible hours
$135k - $170k
...Our partner is looking for a Staff/Senior Data Engineer based in the United States.... ...of a modern data and analytics infrastructure within an innovative robotics and AI environment. You will build and... ...Storage, Jira, web analytics platforms, and other sources into BigQuery...SeniorFull timeRemote workWorldwide$190.9k - $334.1k
...It all started when engineer Fred Luddy wrote... ...ServiceNow is the AI control tower for business... ...Our ServiceNow AI platform brings together any AI, any data, and any workflow-... ...Job Description Senior Staff Software Engineer, Agentic Search Infrastructure About the Role Join...SeniorWork at officeImmediate startRemote workFlexible hours- Senior AI Platform Engineer (Data and Analytics Cloud Engineer) Immediate need for a talented Senior AI Platform Engineer (Data and Analytics Cloud... ...control, build automation, and CI/CD pipelines for infrastructure and application deployments. Deploy infrastructure as code...SeniorContract workLocal areaImmediate start
$152k - $287.5k
...NVIDIA is hiring engineers to build and operate the governed infrastructure platform behind our Electronic Design Automation (EDA)... ...including a solid understanding of data structures, algorithms, testing,... ...NVIDIA dedicated to scaling the AI infrastructure that powers...SeniorFull time- Senior Staff Infrastructure Engineer The Senior Staff Infrastructure Engineer is a critical, hybrid remote role... ...Qualifications: Enterprise AI: Experience designing, evaluating, and... ...affordable, attritable, mission-configurable platforms that give U.S. and allied...SeniorPermanent employmentTemporary workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior/Staff Platform Engineer, Data & AI Infrastructure. Be the first to apply!
- staff design engineer Remote
- engineering aide Remote
- project engineer assistant project manager Remote
- staff data engineer Remote
- technology administrator Remote
- staff engineer Remote
- senior staff engineer Remote
- assistant engineer Remote
- senior staff systems engineer Remote
- research assistant engineering Remote




