Senior AI Inference & Runtime Platform Engineer
Matcha
AZX in the United States seeks an experienced platform engineer to own the layer where AI work happens: the machines, isolation boundary, and the models running on them. You’ll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control-plane endpoint before you go home — building the fork engine, the guest agent, and the multi-substrate model lifecycle. We’re looking for individuals who’ve built this stack, operated it at scale, or both. #J-18808-Ljbffr Matcha
- AZX is pioneering AI-driven transformations across climate and sustainability. We are seeking an experienced engineer to own the machine-layer stack, including inference control planes and a secure sandboxing platform. You will write Rust, build Kubernetes controllers,...Senior
- AZX is building an AI transformation platform with secure, hardware-isolated execution for agent-generated code. You will own the layer where AI workloads run, including inference control plane, sandboxed microVMs, and multi-substrate model lifecycles, using Rust, Kubernetes...SeniorRemote job
- ...critical industries through AI transformation. We... ...home — building the fork engine, the guest agent, and the... ...this class of stack (an inference-serving or serverless-GPU platform), operated it hard at scale... ...for. Oversee the sandbox runtime and its host-side control...SeniorFull timeRemote workWork visaFlexible hoursDay shift
- Engineering - Data Platform - Senior Software Engineer United States Job Description Posted Wednesday, August... ...firms. The Role As Senior Engineer - AI Platform, you will build the self-... ...LiteLLM, OpenRoute, AWS BedRock) and inference optimization. Experience in real estate...SeniorWeekend workAfternoon shift
$140k - $200k
...accessible to every collector, old or new. Our engineering mission is to democratize technology... ...every collector.We’re looking for a Senior Platform Engineer to join our Platform... ...generalize beyond a single use case.Bring AI into the engineering workflow. Prototype...SeniorFull timeRemote workWorldwideFlexible hoursShift work$119.3k - $196.6k
...The Ordinary and NIOD, and BALMAIN Beauty.DescriptionThe Senior Lead, Finance Platform Engineering provides engineering leadership and is accountable for... ...Technology Platform (BTP) adoption, OneStream integration, and AI-enabled engineering capabilities where appropriate....SeniorFull timeLocal area- Positron AI is seeking an exceptional ASIC Architect to shape the future of AI inference hardware. You will collaborate across architecture, software, ML, systems, and silicon implementation to design next-generation accelerators for frontier models. The role requires breadth...SeniorRemote job
- Valkai, Inc. is seeking an experienced infrastructure engineer to build and operate secure, scalable systems underpinning our agents and... ...and self-hosted environments while collaborating with product and AI engineers. The role emphasizes pragmatic engineering judgment,...Senior
- ...-notch technology products.As a Senior Lead Software Engineer - ML Engineer for Agent Platform at JPMorgan Chase within the Commercial... ...and runs NEO, the firm's agent runtime platform for Payments Technology... ...of enterprise-authorized AI-assisted engineering practices to...Senior
- Avalara, Inc. is seeking a strategic engineering leader to drive the next wave of AI-enabled platform innovation for a flagship SaaS product with multi‑million revenue and rapid growth. You will oversee multi‑year replatforming, mentor high‑performing teams, and partner...Senior
- ...Chase is seeking a Senior Director of Software Engineering to lead multiple technical areas within the Card Technology organization. You will drive the adoption of AI-enabled engineering, cloud-native modernization, and robust SDLC practices across multi-region deployments...Senior
- Plenful is hiring a Senior Software Engineer to build and improve our data platform powering our automation engine. You’ll operate as the technical owner of this layer... ...we model domain entities, serve rich context to AI‑driven automation, and maintain auditability #J-1...Senior
- Fetch is seeking a Senior Software Engineer (P4) to join the Data Platform team. You will architect and evolve systems powering Fetch's data products, including pipelines, delivery infrastructure, and partner integrations. You will own high-impact problems, drive reliability...Senior
$61k - $101k
...certification in software engineering concepts, plus 5+... ...systems, microservices, and platform architecture and... ...supporting production AI/ML platforms, including... ...deployment, model serving/inference, and GPU... ...role. We are seeking a Senior Lead Software Engineer...SeniorFull time- Databricks is seeking a Senior Software Engineer for the Data Platform team to help build the Data Intelligence Platform that automates decision-making across... ..., partner with product, data science and Applied AI teams, and shape how data powers the business at scale...Senior
- MetTel in New York City seeks a Senior Software Engineer - Data Platform to join the Data Engineering team. You will design and build scalable data pipelines... ...contribute to data lakehouse design, observability, and AI‑assisted development while ensuring code quality, test...Senior
- ...Job Description Senior AI & Platforms Engineer Location: NYC, NY (3 days onsite minimum) Contract Need only local candidates who can go for F2F. Job Summary: Role Overview We are seeking a Senior Engineer to build and scale our next-generation...SeniorContract workTemporary workLocal area
- Senior Software Engineer, Agentic Platform - Moveworks Company Description Who we are Moveworks is the Agentic AI Assistant platform that empowers the entire workforce. Our platform enables... ...The Role We're building the runtime infrastructure that powers Moveworks'...SeniorWork at officeRemote workFlexible hours
$184.7k - $324.8k
Senior Software Platform Engineer, Apple Pay New York City, New York, United States Software and Services We build and operate the internal developer... ...permanent fix or a guardrail rather than a runbook entry. Work AI-forward by using coding agents and LLM-based tooling as a...SeniorPermanent employmentRelocation- C3 AI is building the platform that makes autonomous intelligence reliable in the real world. We seek a Senior Software Engineer to help develop the C3 Agentic AI Platform, a system where agents observe, reason, decide, and act on live data across industries. Expect collaboration...Senior
$142.3k - $263.3k
...Intelligence (CDI) is the central data, AI, and machine learning engineering team in ASE Media. We own the... ...Store and more.The Data Engineering Platform (DEP) is how CDI does that work at scale... ...tooling.We are looking for a Senior Platform Software Engineer to own the...SeniorContract workWork at officeRelocation- Dentsu Aegis Network Ltd. seeks a senior engineering leader to own the technical roadmap for our enterprise-scale data and AI infrastructure in Chicago. You will guide a multi-disciplinary team, balance hands-on design with governance, and manage global vendor relationships...Senior
$168k - $270.25k
...the unlimited potential of AI to define the next era of computing... ...impact on the world. As a Senior Software Engineer, you will help drive the... ...and operation of the Linux platform that powers the physical Linux... .... Experience with container runtimes, Kubernetes, immutable...Senior- ...marketplace in the US, using AI to connect 14 million... ...highly skilled and innovative Senior Full-Stack Engineer to architect high-performance... ...velocity across our B2B platform. You’ll play a pivotal role... ...Nitro server engines, Bun runtime, PrimeVue components, or streaming...SeniorRemote work
$300 per month
...intelligence. As the only vertically integrated AI infrastructure company built from the... .... About the Role: We are seeking Senior Software Engineers to design and develop internal... ...management processes and enhancing our cloud platform’s overall performance as we...SeniorTemporary work- ...builds the world’s largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times... ...Cerebras' Wafer-Scale Engine (WSE). We build the compiler... ...kernel enablement, and runtime integration that... ...runtime engineers, cloud platform teams, AI researchers,...Senior
- We're looking for a talented, senior engineering professional ready to take their career to new heights... ...Technology Compute Infrastructure Platforms team, you will design, engineer, and... ...incident actions.Uses enterprise-authorized AI capabilities within the work...Senior
- ...make a real impact by building advanced cloud platforms that power data-driven decision making. At... ...ideas matter and your skills drive change.As a Senior Lead Software Engineer, Cloud Platform at JPMorgan Chase in the Corporate AI and Machine Learning Data Platforms team,...SeniorWork at officeShift work
- ...vulnerability remediation workflows within the CI/CD pipeline. Engineering Productivity & Metrics Implement and maintain data... ...ServiceNow ITSM ). Feature Management: Experience with runtime configuration or decoupling deployments from releases using...Senior
- ...Rocket Lab is seeking a Senior Software Engineer I - Data Engineering to design and scale core data platforms powering operations. Based onsite in Long Beach, CA, you’ll build pipelines, storage, APIs, and processing tools used by engineers across the company. You’ll collaborate...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference & Runtime Platform Engineer. Be the first to apply!
- ai ml engineer Brooklyn, NY
- ai prompt engineer Brooklyn, NY
- senior ai engineer Brooklyn, NY
- machine learning ai engineer Brooklyn, NY
- ai developer Brooklyn, NY
- ai engineer Brooklyn, NY
- ai engineer remote Brooklyn, NY
- platform engineer Brooklyn, NY
- client platform engineer Brooklyn, NY
- platform developer Brooklyn, NY


