Senior AI Inference & Runtime Platform Engineer
Matcha
AZX in the United States seeks an experienced platform engineer to own the layer where AI work happens: the machines, isolation boundary, and the models running on them. You’ll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control-plane endpoint before you go home — building the fork engine, the guest agent, and the multi-substrate model lifecycle. We’re looking for individuals who’ve built this stack, operated it at scale, or both. #J-18808-Ljbffr Matcha
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference & Runtime Platform Engineer in Eastern, KY vacancy
- DRW, a diversified trading firm, is seeking an AI Inference Platform Engineer to build, operate, and optimize systems that serve large language and... ...serving platform end-to-end, onboarding models, tuning runtimes and configurations, and improving latency, throughput, reliability...Senior
$147.05k - $230.85k
## Senior Machine Learning Platform Engineer — Model Hosting & MLOpsApply: Spring, Texas, United... ...into a secure, scalable inference service. The work spans... ...for custom ML and AI models across AWS and Azure... ...models, such as inference runtimes, deployment patterns, endpoint...SeniorFull timeTemporary workRelocationFlexible hoursShift work- ...As a Senior Platform Engineer at Equiforte, you will build and scale the core infrastructure that powers our AI-native financial reporting platform. You'll work at the intersection of... ...models in production with low-latency inference and high availability Drive technical...Senior
Equiforte
Eastern, KY2 days ago - Accellor is an AI-native services firm delivering... ...AI, data, and engineering capabilities. We seek... ...Architect — AI Systems, Inference & Platform Internals to design,... ...focuses on inference runtime, model serving, GPU infrastructure... ...safety, requiring a senior hands-on architect...Senior
- ...3 Job Description The isolved Senior Software Engineer, AI Platform role owns both program execution and... ...Build and maintain agentic runtime infrastructure, including orchestration... ...building production LLM-powered systems - inference, RAG, agentic patterns, or AI...SeniorLive in
iSolved HCM
Eastern, KY19 hours ago $50k
...MHC is a global provider of AI-powered SaaS solutions for document... ...with confidence. Our platform helps enterprise and mid-... ...motivated and technically skilled Senior Platform Engineer to join our growing... ...including infrastructure and runtime environments that enable autonomous...SeniorRemote workFlexible hoursMHC Automation
Eastern, KY19 hours ago- Subtle Medical is seeking a Senior Platform Engineer to join our Platform Engineering team. This role is... ...and platform systems that power our AI-driven medical imaging products. You will... ...and manage the cloud infrastructure and runtime environment that supports them, with...SeniorRemote job
$161.5k - $218.5k
...Description: We are building a central AI control plane to support the safe, scalable, and efficient use of AI across Arm’s engineering teams. This hands‑on platform engineering role will help deliver and own the runtime platforms that make AI services reliable,...SeniorWork at officeLocal areaRotating shiftARM
Eastern, KY1 day ago- Arm Limited is building a centralized AI control plane to support safe, scalable AI across Arm’s engineering teams. This hands-on platform engineering role will own the runtime platforms that make AI services reliable, secure, observable and supportable at Arm scale. You...Senior
$160k - $219k
Senior Software Engineer, Agentic AI Platform C3 AI (NYSE: AI), is the Enterprise AI application software company.... ...and run them on reliable, scalable runtimes and end-to-end pipelines in a... ...latency, throughput, scalability, and inference cost across the platform. Strengthen...SeniorWork experience placement- Apple Inc. is seeking a Senior/Staff Software Engineer to design and build core components... ...Apple’s unified data+ML platform powered by Ray. This... ...large-scale training and inference workloads across diverse compute... ...will contribute to the runtime, orchestration layer, and...Senior
- Bernard is building the AI and ML platform behind its products, spanning search, retrieval, training, evaluation, inference, and model deployment. You will own the diagnostics and customer-support brain powering voice and chat agents with shared context, memory, and learning...Senior
- ...team Department: Software Engineering Reports To: Build &... ...Manager Type: Full-Time Level: Senior (individual-contributor platform engineering track)... ...team that owns them Apply AI-assisted tooling in the pipeline... ...change deployed Platform runtime operations Operate the...SeniorFull timeRemote work
- ...5 New York, NY 10017 Job Title : Sr. AI Platform Engineer What We’re Looking for (Minimum Qualifications... ...or other distributed orchestration & inference frameworks. Experience with developing... ...optimizing vector databases and model runtimes for cost and performance....Senior
- ...by tier‑one investors in physical AI to make intelligent, self‑improving... ...We’re looking for an exceptional Senior Software Engineer, Edge Platform to own components of and build out... ...LLMs on edge hardware, including inference runtimes and resource constraints. Experience...SeniorFull timeLocal areaRemote work
$191.25k - $225k
...learn more about working at Coinbase. Senior Machine Learning Platform Engineer As a Senior Machine Learning... ...distributed training, and highly available inference services, directly shaping how ML... ...builder. Utilizes generative AI responsibly, maintaining human oversight...SeniorLocal area$94.9k - $176.3k
## Senior Platform EngineerApplyremote type: Hybridlocations: United States... ...the team**Our Platform Engineering team builds and operates the... ...systems that power CoCounsel's AI agent platform — the... ...agent experiences and the AI runtime layer, the CI/CD and deployment...SeniorWork at officeLocal areaFlexible hoursShift work- Fleet AI, Inc. is an applied AI company building human-AI collaboration at scale. Our platforms enable fast, verifiable training and evaluation of agents across environments, backed... ...by top investors. The team owns the agent runtime, environment deployment, and the production...
- DoorDash’s GenAI Platform team builds the shared infrastructure that... ...GPU serving, high-throughput inference, and model fine-tuning to... ...observability, partnering with ML engineers and platform teams to... ...production systems. #J-18808-Ljbffr AI Chopping Block, Inc.
$204k - $247k
...Senior Software Engineer Join us in building the next generation of AI infrastructure that will power innovation across our organization... ...engineer to support our Platform team, which owns the AWS... ...frameworks. Familiarity with AI inference serving technologies (vLLM,...SeniorNeuralsolutions
Eastern, KY2 days ago- ...Autodesk is seeking a Principal Software Developer to design and implement AI features for the platform. You will collaborate with product managers, developers and operations to shape the platform roadmap and deliver robust AI-enabled software. You will drive API design...Senior
Pomona College
Eastern, KY19 hours ago - SIXGEN is seeking a Platform DevOps Engineer in Columbia, MD to design, build, and manage scalable AI infrastructure across cloud and on-prem environments. You will enable rapid prototyping, automate deployments, and ensure secure, auditable operations for enterprise AI...SeniorRemote job
- ...Solutions Architect to be the senior technical authority for Token Factory’s serverless inference and fine-tuning. You will lead... ...other architects while shaping the platform roadmap. This role focuses on... ...move PoCs to production. #J-18808-Ljbffr AI Chopping Block, Inc.Senior
- Circana is seeking an experienced Senior DevOps Engineer to design and scale enterprise platforms across on-prem and hyperscaler clouds in a hybrid environment. You will lead CI/CD automation, IaC, and platform reliability to support development and operations teams. The...Senior
- ...possible Project Description : We are seeking a talented Senior Platform Engineer to join our Enterprise Hosting Services team at the... ...platforms and AWS GovCloud platforms while supporting emerging AI capabilities, modern containerized workloads, and enterprise...SeniorContract workRemote work
Bryant Technologies
Eastern, KY19 hours ago - ...Help build the platforms that the world's best teams rely on. Our... ...starts with the real artifacts of engineering: architecture notes, pull... ..., cloud, modernization, AI workflows, and delivery systems... ...the Role We are seeking a Senior Platform Engineer to drive the...SeniorFull timeLive inRemote work
Epsilon ASI
Eastern, KY19 hours ago - ...artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving... ..., and operational efficiency About Role The Senior Platform Engineer is a senior technical leader responsible for designing, implementing...SeniorRemote workFlexible hours
Accrete
Eastern, KY19 hours ago - NVIDIA Corporation is seeking a Senior Developer Relations Manager to cultivate a robust developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. You will lead outreach, create runnable demos and extensive documentation, and represent...Senior
- Ampcus is seeking an experienced AI Platform Engineer / DevOps Specialist to join our enterprise infrastructure team in Charlotte, NC on a hybrid... ...leveraging Vertex AI, GKE, Terraform, and Kubernetes. This senior role requires 7+ years in platform engineering with strong...SeniorContract work
- Roblox Corporation is seeking a Principal Software Engineer for the Engineering Acceleration team to help build a unified service management platform, developer tools powered by AI, and scalable change-management infrastructure for thousands of Roblox engineers. You will...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference & Runtime Platform Engineer. Be the first to apply!
Related searches
- machine learning ai engineer Eastern, KY
- ai developer Eastern, KY
- ai engineer remote Eastern, KY
- ai ml engineer Eastern, KY
- ai prompt engineer Eastern, KY
- senior ai engineer Eastern, KY
- ai engineer Eastern, KY
- client platform engineer Eastern, KY
- platform engineering manager Eastern, KY
- platform developer Eastern, KY