Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Core Product Software Engineer — ML Inference & APIs

Baseten

A dynamic AI platform company in New York is looking for a Software Engineer to join their Core Product team. In this role, you'll be responsible for building and maintaining core product features, enabling users to effectively deploy machine learning models. As a developer-oriented position, strong coding skills in languages like Python and a passion for ML are essential. The role offers competitive compensation and benefits including 100% insurance coverage and generous PTO policies. #J-18808-Ljbffr Baseten

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Core Product Software Engineer — ML Inference & APIs in New York, NY vacancy
  •  ...memorable. Today, Kustomer is the core platform for some of the...  ...looking for a Full Stack Software Engineer to join our Product Engineering team. The...  ...components and libraries Develop APIs and integrate with external...  ...with integrating AI or ML-powered capabilities into web... 
    Suggested

    Kustomer

    New York, NY
    1 day ago
  • $300k - $325k

    Join to apply for the Sr Software Engineer - Core Services role at Rokt Join to apply...  ...profits—from the extra products or services they sell. This...  ...-functionally with Product, ML, and SRE to ensure performance...  ...interviewing at Rokt by 2x Inferred from the description for this... 
    Suggested
    Full time
    Live in
    Work at office

    Rokt

    New York, NY
    1 day ago
  • $180k - $360k

     ...powers mission‑critical inference for the world's most...  ...cutting‑edge models into production. We're growing quickly...  ...help build the platform engineers turn to to ship AI products...  ...you’ll focus on Model API's — the infrastructure...  ...and curiosity. ML experience is a plus, but... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    1 day ago
  • $165k - $242k

     ...for building and evolving the core backend systems and shared...  ...in defining and maintaining API standards across teams, ensuring...  ...collaborate closely with Product and various Engineering teams to design systems that...  ...in high-scale data or ML infrastructure systems. Experience... 
    Suggested
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    25 days ago
  • $155.7k - $208.7k

    Lead Product Software Engineer - Data Systems Job ID: 10151200 Overview...  ...data is at the core of this effort. We are...  ...foundational systems, APIs, data platforms, and infrastructure...  ...serving, model inference integration, experimentation...  ...Experience supporting ML workflows (model... 
    Suggested
    Full time
    Worldwide

    5014 Disney Entertainment & Sports LLC

    New York, NY
    2 days ago
  • $201k - $264k

    Role Overview As a Staff Software Engineer on the Core Infrastructure team at...  ...as it scales products, regions, customers, and...  ...routes millions of daily inference requests while maintaining model API compatibility and enabling...  ...infrastructure for AI/ML workloads or high-... 
    Relocation package

    Harvey

    New York, NY
    1 day ago
  • $180k - $360k

     ...powers mission‑critical inference for the world's...  ...‑edge models into production. We’re growing quickly...  ...a GPU Kernel Engineer to join our team at...  ...optimization Responsibilities Core Engineering...  ...GPU kernels for key ML operations,...  ...Knowledge of: CUDA C++ API Memory access patterns... 
    Flexible hours

    Baseten

    New York, NY
    6 hours ago
  • $150k - $250k

     ...Mbodi builds the software layer that lets industrial...  ...compiled neural inference. As one of our early engineers, you'll work on the core systems that...  ...model, and the APIs that tie...  ...Work closely with ML and robotics engineers...  ...distributed systems, with production exposure to... 
    Work at office
    3 days per week

    Mbodi

    New York, NY
    5 hours ago
  • Core Platform @ Pave We build the foundational services, APIs, and abstractions that enable every...  ...enterprise-grade software with speed and...  ...years of backend engineering experience building...  ...and Node.js Strong product intuition with...  ..., data modeling; ML/AI platform experience... 

    Pave

    New York, NY
    1 day ago
  •  ...Solutions Engineer The Technical Success team is responsible...  ...on the OpenAI suite of products, ensuring developers and...  ...and answering product, API, and LLM-related...  ...Generative AI/traditional ML solutions and have knowledge...  ...and human needs at its core, and to achieve our... 
    Work at office
    Relocation package

    OpenAI

    New York, NY
    3 days ago
  •  ...role focuses on building production-quality iOS applications where AI is a core interaction layer, not...  ...through backend APIs. Design UX patterns for...  ...closely with backend and ML engineers on API design and system...  ...TensorFlow Lite (on-device inference) How We Work Our... 
    Remote work

    Bjak

    New York, NY
    2 days ago
  • $165k - $330k

     ...mission‑critical inference for the world's most...  ...‑edge models into production. We’re growing...  ...build the platform engineers turn to ship AI products...  ...across product, software development,...  ...ComfyUI workflows as APIs Responsibilities...  ...its relevance in ML projects. Drive customer... 
    Work experience placement
    Flexible hours

    Baseten

    New York, NY
    1 day ago
  • $225k - $300k

     ...Datalab is building the core infrastructure for...  ...for a fullstack engineer who wants to build...  ...includes building core inference workflows, creating...  ...-source repos and API. This is a high-...  ...engineering, product thinking, and community...  ...Experience with Python ML frameworks (PyTorch... 

    Data Lab

    New York, NY
    2 days ago
  • $213k - $263k

     ...a range of vehicle platforms and product use cases. The Waymo Driver has provided...  ...challenges. The Eval Authoring APIs team’s mission is to establish the...  ..., technically hands‑on Senior Software Engineer to design and implement these core authoring APIs. In this hybrid role... 
    Full time
    Remote work

    Waymo

    New York, NY
    1 day ago
  • $250k - $300k

     ...a world‑class engineering team to redefine...  ...pipelines, and APIs that form the foundation...  ...and implement core systems...  ...backend services, ML models, and...  ...For 5+ years of software engineering experience...  ...developing production‑ready...  ...feature stores, inference pipelines) Work... 
    Full time
    Work at office
    Remote work

    North

    New York, NY
    1 day ago
  • $180k - $220k

     ...Pivotal Health combines software, data, and service...  ...hiring a Staff Software Engineer to help build new products at Pivotal from the...  ...role sits on the AI/ML Engineering team. You...  ...especially strong in APIs, backend systems, data...  ...hire around our core hubs–Los Angeles and... 
    Remote work
    Flexible hours

    Pivotal Health

    New York, NY
    6 hours ago
  • $320k

    Staff + Senior Software Engineer, Inference Deployment About Anthropic Anthropic’s...  ...every model update must reach production safely, quickly, and...  ...optimization problem at its core: validation and deployment...  ...production systems Experience with ML inference or training... 
    Visa sponsorship
    Shift work

    Anthropic

    New York, NY
    1 day ago
  • $182k - $242k

     ...building, and inference at scale, we’re...  ...intersection of software, hardware, and...  ...at scale. The engineering team is responsible...  ...thousands of ML practitioners interact...  ...and API design to the React...  ...with ML science, product, iOS, and SRE...  ...represented through our core values: Be... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    New York, NY
    1 day ago
  • $405k

    Staff+ Software Engineer, Inference Runtime Remote-Friendly (Travel-Required) | San...  ...shared, accelerator-agnostic core of our inference serving...  ...in systems engineering or ML infrastructure, with the ability...  ...Background operating production as a validation surface at... 
    Remote job
    Visa sponsorship

    Anthropic

    New York, NY
    1 day ago
  • $155.7k - $208.7k

     ...Overview: ESPN Product & Technology...  ...of engineers, product developers...  ...data is at the core of this effort....  ...seeking a Lead Software Engineer with deep...  ...foundational systems, APIs, data platforms...  ...serving, model inference integration,...  ...supporting ML workflows (model... 

    Disney Entertainment and ESPN Product & Technology

    New York, NY
    28 days ago
  • $157k - $205k

     ...empower everyone to create software. We believe anyone...  ...’ve achieved: Our product is working, and we...  ...working on Bubble’s core product, the Bubble Editor...  ...closely with senior engineers and learning from...  ...Typescript, Node.js AI/ML: Python, LLM APIs (OpenAI, Anthropic,... 
    Work at office
    Relocation
    Relocation package
    Flexible hours

    Bubble

    New York, NY
    more than 2 months ago
  • $160k - $240k

     ...growing quickly with a product people love and we’...  ...for a product engineer with 3+ years of experience...  ...help us build the software backbone of modern...  ...in shaping the core systems that power...  ...Automation & AI - LLMs and ML models that route...  ...workflows. API & Webhooks - Design... 
    Permanent employment
    Immediate start
    Home office

    Stable

    New York, NY
    1 day ago
  • $180k - $250k

     ...scaled cybersecurity products loved and trusted by tens...  ...strong team includes software engineers, AI researchers,...  ...Responsibilities Ship core product features across...  ...back‑end services and APIs. You will own features...  ...security engineers, AI/ML researchers and product... 

    Artemis Security

    New York, NY
    1 day ago
  • $185k - $225k

     ...through intelligent, scalable software. We’re looking for a Senior Product Engineer to help build polished, user-facing...  ...: Experience working with AI/ML workflows or AI APIs (e.g., OpenAI). Familiarity...  ...year ago Software Engineer, Web Core Product & Chrome Extension New... 
    Full time
    Remote work

    Denu Recruit

    New York, NY
    4 days ago
  • $175k - $275k

     ...intelligently orchestrates production and editing through natural...  ...Square). About the Role Backend engineering at Mirage isn’t narrowly...  ...building the systems, services, APIs, and ML pipelines that power all of...  ...quality Design and operate core platform infrastructure, including... 
    Local area
    Night shift

    Mirage

    New York, NY
    2 days ago
  • $145k - $160k

     ...skilled and experienced Senior Data and Software Engineer I (API) to join our team. In this role, you...  ...Qualifications Extensive experience building production-grade RESTful APIs with proven...  ...engineering Experience in modeling: Snowpark ML, TensorFlow Expert-level experience... 
    Full time
    Contract work
    Work at office

    affinitysolutions

    New York, NY
    1 day ago
  • $123k - $165k

     ...Entertainment and ESPN Product & Technology...  ...global organization of engineers, product...  ...seeing a Product Software Engineer II to join...  ...across platform, core-ui, and brand UI packages...  ...frameworks, REST APIs, relational databases...  ...generics, type inference, versioning, ESM/CJS... 
    Work experience placement

    Disney Entertainment and ESPN Product & Technology

    New York, NY
    8 days ago
  • $222.8k - $334.2k

     ..., and Toronto. The Core Experience teams are...  ...consumption with ML and personalized experiences...  ...IOS and Android engineers across Reddit and...  ...and partner with product, design, and other...  ...senior leadership. Software development experience...  ...maintainable APIs is a plus. Benefits... 
    Work experience placement
    Work at office
    Remote work
    Home office
    Flexible hours

    Reddit

    New York, NY
    2 days ago
  •  ...an AI Solutions Engineer to design, build, and ship production AI systems across...  ...combines two core capabilities: building...  ...as an ML engineer, AI engineer, or software engineer shipping...  ...language model APIs and at least one...  ...WebAR, on‑device inference) Familiarity with... 
    Hourly pay
    Permanent employment
    Full time
    Contract work

    Next League, LLC

    New York, NY
    6 hours ago
  • $269.1k - $307.2k

     ...As a Distinguished Engineer at Capital One,...  ...learning experts, product managers and people...  ...based enterprise AI+ML system delivering...  ...model training, model inference and feature...  ...of experience in software engineering At least...  ...architecture, and API platforms At least... 
    Local area

    Capital One

    New York, NY
    6 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Core Product Software Engineer — ML Inference & APIs. Be the first to apply!