Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference & Runtime Platform Engineer

Matcha

AZX in the United States seeks an experienced platform engineer to own the layer where AI work happens: the machines, isolation boundary, and the models running on them. You’ll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control-plane endpoint before you go home — building the fork engine, the guest agent, and the multi-substrate model lifecycle. We’re looking for individuals who’ve built this stack, operated it at scale, or both. #J-18808-Ljbffr Matcha

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference & Runtime Platform Engineer in Brooklyn, NY vacancy
  • AZX is pioneering AI-driven transformations across climate and sustainability. We are seeking an experienced engineer to own the machine-layer stack, including inference control planes and a secure sandboxing platform. You will write Rust, build Kubernetes controllers,... 
    Senior

    AZX

    Brooklyn, NY
    4 days ago
  • AZX is building an AI transformation platform with secure, hardware-isolated execution for agent-generated code. You will own the layer where AI workloads run, including inference control plane, sandboxed microVMs, and multi-substrate model lifecycles, using Rust, Kubernetes... 
    Senior
    Remote job

    Uncover

    Brooklyn, NY
    4 days ago
  •  ...critical industries through AI transformation. We...  ...home — building the fork engine, the guest agent, and the...  ...this class of stack (an inference-serving or serverless-GPU platform), operated it hard at scale...  ...for. Oversee the sandbox runtime and its host-side control... 
    Senior
    Full time
    Remote work
    Work visa
    Flexible hours
    Day shift

    Matcha

    Brooklyn, NY
    4 days ago
  • Engineering - Data Platform - Senior Software Engineer United States Job Description Posted Wednesday, August...  ...firms. The Role As Senior Engineer - AI Platform, you will build the self-...  ...LiteLLM, OpenRoute, AWS BedRock) and inference optimization. Experience in real estate... 
    Senior
    Weekend work
    Afternoon shift

    LightBox

    Brooklyn, NY
    3 days ago
  • $140k - $200k

     ...accessible to every collector, old or new. Our engineering mission is to democratize technology...  ...every collector.We’re looking for a Senior Platform Engineer to join our Platform...  ...generalize beyond a single use case.Bring AI into the engineering workflow. Prototype... 
    Senior
    Full time
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Collectors

    Jersey City, NJ
    5 hours ago
  • $119.3k - $196.6k

     ...The Ordinary and NIOD, and BALMAIN Beauty.DescriptionThe Senior Lead, Finance Platform Engineering provides engineering leadership and is accountable for...  ...Technology Platform (BTP) adoption, OneStream integration, and AI-enabled engineering capabilities where appropriate.... 
    Senior
    Full time
    Local area

    Estée Lauder

    Long Island City, NY
    2 days ago
  • Positron AI is seeking an exceptional ASIC Architect to shape the future of AI inference hardware. You will collaborate across architecture, software, ML, systems, and silicon implementation to design next-generation accelerators for frontier models. The role requires breadth... 
    Senior
    Remote job

    Positron AI

    Brooklyn, NY
    5 days ago
  • Valkai, Inc. is seeking an experienced infrastructure engineer to build and operate secure, scalable systems underpinning our agents and...  ...and self-hosted environments while collaborating with product and AI engineers. The role emphasizes pragmatic engineering judgment,... 
    Senior

    Valkai, Inc.

    Brooklyn, NY
    1 day ago
  •  ...-notch technology products.As a Senior Lead Software Engineer - ML Engineer for Agent Platform at JPMorgan Chase within the Commercial...  ...and runs NEO, the firm's agent runtime platform for Payments Technology...  ...of enterprise-authorized AI-assisted engineering practices to... 
    Senior

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  • Avalara, Inc. is seeking a strategic engineering leader to drive the next wave of AI-enabled platform innovation for a flagship SaaS product with multi‑million revenue and rapid growth. You will oversee multi‑year replatforming, mentor high‑performing teams, and partner... 
    Senior

    Avalara, Inc.

    Brooklyn, NY
    3 days ago
  •  ...Chase is seeking a Senior Director of Software Engineering to lead multiple technical areas within the Card Technology organization. You will drive the adoption of AI-enabled engineering, cloud-native modernization, and robust SDLC practices across multi-region deployments... 
    Senior

    Jobleads-US

    Jersey City, NJ
    1 day ago
  • Plenful is hiring a Senior Software Engineer to build and improve our data platform powering our automation engine. You’ll operate as the technical owner of this layer...  ...we model domain entities, serve rich context to AI‑driven automation, and maintain auditability #J-1... 
    Senior

    RXinsider LTD.

    Brooklyn, NY
    3 days ago
  • Fetch is seeking a Senior Software Engineer (P4) to join the Data Platform team. You will architect and evolve systems powering Fetch's data products, including pipelines, delivery infrastructure, and partner integrations. You will own high-impact problems, drive reliability... 
    Senior

    Fetch

    Brooklyn, NY
    1 day ago
  • $61k - $101k

     ...certification in software engineering concepts, plus 5+...  ...systems, microservices, and platform architecture and...  ...supporting production AI/ML platforms, including...  ...deployment, model serving/inference, and GPU...  ...role. We are seeking a Senior Lead Software Engineer... 
    Senior
    Full time

    J.P. Morgan

    Jersey City, NJ
    3 days ago
  • Databricks is seeking a Senior Software Engineer for the Data Platform team to help build the Data Intelligence Platform that automates decision-making across...  ..., partner with product, data science and Applied AI teams, and shape how data powers the business at scale... 
    Senior

    Uncover

    Brooklyn, NY
    5 days ago
  • MetTel in New York City seeks a Senior Software Engineer - Data Platform to join the Data Engineering team. You will design and build scalable data pipelines...  ...contribute to data lakehouse design, observability, and AI‑assisted development while ensuring code quality, test... 
    Senior

    MetTel

    Brooklyn, NY
    4 days ago
  •  ...Job Description Senior AI & Platforms Engineer Location: NYC, NY (3 days onsite minimum) Contract Need only local candidates who can go for F2F. Job Summary: Role Overview We are seeking a Senior Engineer to build and scale our next-generation... 
    Senior
    Contract work
    Temporary work
    Local area

    BuzzClan LLC

    Brooklyn, NY
    17 days ago
  • Senior Software Engineer, Agentic Platform - Moveworks Company Description Who we are Moveworks is the Agentic AI Assistant platform that empowers the entire workforce. Our platform enables...  ...The Role We're building the runtime infrastructure that powers Moveworks'... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Moveworks

    Brooklyn, NY
    2 days ago
  • $184.7k - $324.8k

    Senior Software Platform Engineer, Apple Pay New York City, New York, United States Software and Services We build and operate the internal developer...  ...permanent fix or a guardrail rather than a runbook entry. Work AI-forward by using coding agents and LLM-based tooling as a... 
    Senior
    Permanent employment
    Relocation

    Apple Inc.

    Brooklyn, NY
    2 days ago
  • C3 AI is building the platform that makes autonomous intelligence reliable in the real world. We seek a Senior Software Engineer to help develop the C3 Agentic AI Platform, a system where agents observe, reason, decide, and act on live data across industries. Expect collaboration... 
    Senior

    C3 AI

    Brooklyn, NY
    4 days ago
  • $142.3k - $263.3k

     ...Intelligence (CDI) is the central data, AI, and machine learning engineering team in ASE Media. We own the...  ...Store and more.The Data Engineering Platform (DEP) is how CDI does that work at scale...  ...tooling.We are looking for a Senior Platform Software Engineer to own the... 
    Senior
    Contract work
    Work at office
    Relocation

    Apple Inc.

    Brooklyn, NY
    3 days ago
  • Dentsu Aegis Network Ltd. seeks a senior engineering leader to own the technical roadmap for our enterprise-scale data and AI infrastructure in Chicago. You will guide a multi-disciplinary team, balance hands-on design with governance, and manage global vendor relationships... 
    Senior

    Dentsu Aegis Network Ltd.

    Brooklyn, NY
    4 days ago
  • $168k - $270.25k

     ...the unlimited potential of AI to define the next era of computing...  ...impact on the world. As a Senior Software Engineer, you will help drive the...  ...and operation of the Linux platform that powers the physical Linux...  .... Experience with container runtimes, Kubernetes, immutable... 
    Senior

    NVIDIA Corporation

    Brooklyn, NY
    4 days ago
  •  ...marketplace in the US, using AI to connect 14 million...  ...highly skilled and innovative Senior Full-Stack Engineer to architect high-performance...  ...velocity across our B2B platform. You’ll play a pivotal role...  ...Nitro server engines, Bun runtime, PrimeVue components, or streaming... 
    Senior
    Remote work

    LaraBench

    Brooklyn, NY
    4 days ago
  • $300 per month

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  .... About the Role: We are seeking Senior Software Engineers to design and develop internal...  ...management processes and enhancing our cloud platform’s overall performance as we... 
    Senior
    Temporary work

    Linuxconfig

    Brooklyn, NY
    1 day ago
  •  ...builds the world’s largest AI chip, 56 times larger...  ...-leading training and inference speeds; over 10 times...  ...Cerebras' Wafer-Scale Engine (WSE). We build the compiler...  ...kernel enablement, and runtime integration that...  ...runtime engineers, cloud platform teams, AI researchers,... 
    Senior

    Cerebras

    Brooklyn, NY
    1 day ago
  • We're looking for a talented, senior engineering professional ready to take their career to new heights...  ...Technology Compute Infrastructure Platforms team, you will design, engineer, and...  ...incident actions.Uses enterprise-authorized AI capabilities within the work... 
    Senior

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  •  ...make a real impact by building advanced cloud platforms that power data-driven decision making. At...  ...ideas matter and your skills drive change.As a Senior Lead Software Engineer, Cloud Platform at JPMorgan Chase in the Corporate AI and Machine Learning Data Platforms team,... 
    Senior
    Work at office
    Shift work

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...vulnerability remediation workflows within the CI/CD pipeline. Engineering Productivity & Metrics Implement and maintain data...  ...ServiceNow ITSM ). Feature Management: Experience with runtime configuration or decoupling deployments from releases using... 
    Senior

    Shrive Technologies LLC

    Secaucus, NJ
    3 days ago
  •  ...Rocket Lab is seeking a Senior Software Engineer I - Data Engineering to design and scale core data platforms powering operations. Based onsite in Long Beach, CA, you’ll build pipelines, storage, APIs, and processing tools used by engineers across the company. You’ll collaborate... 
    Senior

    Rocket Lab

    Brooklyn, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference & Runtime Platform Engineer. Be the first to apply!