Core Product Software Engineer ML Inference & APIs
Baseten
A dynamic AI platform company in New York is looking for a Software Engineer to join their Core Product team. In this role, you'll be responsible for building and maintaining core product features, enabling users to effectively deploy machine learning models. As a developer-oriented position, strong coding skills in languages like Python and a passion for ML are essential. The role offers competitive compensation and benefits including 100% insurance coverage and generous PTO policies. #J-18808-Ljbffr
- ...their digital core and unleashing... ...Supply Chain and Engineering, and Talent, with... ...complex software sales cycles by... ...delivering compelling product demonstrations,... ...-based and ML detection. Agents... ...Understanding of file, API and event-based... ..., managed LLM inference, event...SuggestedWork experience placementLive inWork at officeLocal area
- ...The Senior Staff Product Marketing Engineer at the company Technologies will collaborate with Core and SDK engineers to articulate complex developer experiences, produce practical demonstrations, and craft compelling technical narratives. You will influence product positioning...Suggested
- ...powers mission-critical inference for the world's most dynamic... ...-edge models into production. Join us and help build the platform engineers turn to ship AI products... ...oriented toolsInterest in ML/AI infrastructure and willingness... ...platforms: SDKs, CLIs, APIs, and self-serve...SuggestedFlexible hours
$194k - $349k
...The Platform API team builds the... ...management. Every engineering team that... ...machine learning inference runtime: a stable... ...design through production delivery, make... ...: an on-sensor ML inference runtime... ...experience managing software engineering... ..., OpenVINO, or Core ML, including...SuggestedPermanent employmentWork experience placementWork at officeLocal area$300k - $325k
...Join to apply for the Sr Software Engineer - Core Services role at Rokt... ...their profits—from the extra products or services they sell. This... ...-functionally with Product, ML, and SRE to ensure performance... ...interviewing at Rokt by 2x Inferred from the description for this...SuggestedFull timeLive inWork at office- ...and Craft Ventures.The Core Platform Team @... ...at the center of Pave Engineering, bridging product and platform engineering... ...foundational services, APIs, and abstractions... ...ship enterprise-grade software with speed and confidence... ...ETLs, data modeling; ML/AI platform...Flexible hours
$123k - $215.25k
...benefitsJob Function: Engineering &... ...We also provide product management for core enterprise platforms... ...systems, integrating ML models, LLMs, and... ...such as robust inference services, retrieval... ...' Experience in software development,... ...design, scalable APIs, and cloud-native...$184.9k - $250.2k
...re looking for a Sr. Software Development Engineer to join the... ...recommendation is a first-class product concern, not an... ...systems that sit at the core of how advertisers... ...- Real-time ML inference — systems that evaluate... ...agent coordination — APIs and contracts that allow...InternshipLive inFlexible hours$160k - $240k
Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO... ...Join the team that is building the core infrastructure for AI at Bloomberg.... ...Bloomberg AI Inference Platform provides production-grade managed infrastructure for...Temporary workFor contractorsWork experience placement- ...Olo is hiring a Software Engineer to join the Core team within the Order Engineering group. You will contribute code, help shape architecture, and mentor... ...you work from anywhere within NI. You’ll collaborate on API services, baskets, orders, and promotions, participate in...Remote work
$185k - $225k
...: Senior Full Stack Engineer – Core UX Location : New... ...building professional-grade software for the insurance... ...processes. The company’s products are already in... ...with full-stack, data, ML, and DevOps engineers... ...scalable backend systems and APIs that support user-...Full timeWork at office$125k - $225k
...the leading AI & Agent Engineering observability and evaluation... ...first prototype to production scale, Arize AX unifies... ...from traditional ML to generative AI and agentic... ...will be a part of the core team that drives product... ...solutions range from clean APIs that magically...For contractorsWork experience placementRemote workWork from homeShift work$165k - $250k
...Mbodi builds the software layer that lets industrial... ...compiled neural inference. As one of our early engineers, you'll work on the core systems that... ...model, and the APIs that tie... ...Work closely with ML and robotics engineers... ...distributed systems, with production exposure to...Work at office3 days per week$125k - $150k
...Job Title Senior Software Engineer, 1 Job... ...Engineer 1 to join our AI/ML Engineering Platform... ...will collaborate with product owners, Data... ...using KServe and build APIs using FastAPI for low latency inference Build observability... ...: Core Tech Stack Backend...Temporary workWork at officeLocal areaRemote workFlexible hours2 days per week$164.6k - $213.1k
...governed responsibly, engineered for scalability, and designed... ...Data & AI Product Engineer is a hands-on... ...platforms, data pipelines, APIs, integrations, and cloud... ...tracking, CI/CD for models, inference patterns, drift... ...purpose and guided by our core values - Win Together,...Full timeTemporary workWork at officeLocal areaRelocation packageShift work3 days per week- ...Baseten is hiring a Technical Product Marketing Manager to articulate complex Baseten products for ML engineers, platform teams, and executive buyers.... ...monitor the competitive landscape across inference, Model APIs, training, and the core platform. You’ll partner with...
$158.1k - $213.8k
...of customers discover products and engage with brands... ...models. Our platform solves core production challenges:... ...go through the full software development cycle but more... ...systems and ML infrastructure, and work... ...of software development engineer or related occupational...Permanent employmentTemporary workInternshipFlexible hours- ...powers mission-critical inference for the world's most... ...cutting-edge models into production. We're growing quickly... ...help build the platform engineers turn to ship AI products... ...and evolve core observability platforms... ...Exposure to a variety of ML startups, offering unparalleled...Flexible hours
$185k - $225k
...: Senior Full Stack Engineer – Core UX \n Location : New... ...building professional-grade software for the insurance... .... \n The company’s products are already in... ...with full-stack, data, ML, and DevOps engineers... ...scalable backend systems and APIs that support user-facing...Work at office- ...groundbreaking new product line that will transform... ...-Driven Full Stack Engineer, you'll be part of... ..., back end, and AI/ML initiatives, while... ...initiatives. Our core stack includes... ...Integrate AI models and APIs for tasks like... ...model training and inference Craft seamless user...Remote work
$229.9k - $262.4k
AI Engineer 5 ((AI Foundations, LLM Core and Agentic AI) Overview: At Capital... ...applications of AI & ML are bringing... ...capabilities with breakthrough product experiences and... ...deploy, and support AI software components including... ...language model inference, agents and multi-agent...Full timePart timeLocal area$197.3k - $225.1k
AI Engineer 4 (AI Foundations, LLM Core and Agentic AI) Overview: At Capital... ...applications of AI & ML are bringing... ...capabilities with breakthrough product experiences and... ...deploy, and support AI software components including... ...language model inference, agents and multi-agent...Full timePart timeLocal area- ...team The Applied AI Engineering team is responsible... ...thought partner for our API customers, working to... ...industry and drive them to production through strong... ...former startup founders, software and ML engineers, technical product... ...human needs at its core, and to achieve our...Work at officeRelocation package
- ...opportunities, and strengthen engineering quality through... ...: Requires 5+ years of software engineering experience building production microservices, plus hands... ...LLM applications or AI/ML systems in production. Candidates... ...integrate AI models and APIs, and experienced in...
$150.9k - $202.4k
Job Posting Title:Senior Product Software Engineer - FrontendReq ID:10153777Job Description:Technology is... ...this role, you will design and develop core governance capabilities used across all... ...building and consuming RESTful APIs and working with state management patternsFamiliarity...Full timeWork experience placement$220k - $330k
...the data centers, software, and applications... ...for a Staff AI Engineer (Specialised)to set... ...for part of the inference platform at the core of our AI cloud:... ...Serving platform and APIs: serving engines... ...with research, product, and... ...production AI systems or ML research at scale...Flexible hours$160k - $330k
...mission-critical inference for the world's... ...models into production. We're growing... ...build the platform engineers turn to ship AI... ...tools and APIs, expose services... ...Experience building a software‑defined network... ...‑plane or 5G core networking, or... ...a variety of ML startups, offering...Flexible hours$122k - $240.5k
Position Summary Software Engineer III with Agentic AI... ...from experimentation to production, and organizations... ...RESTful and asynchronous APIs on cloud-native infrastructure... ..., leveraging our core engineering expertise.... ...and delivering AI/ML solutionsAt least 1 year...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$185k - $225k
...through intelligent, scalable software. We’re looking for a Senior Product Engineer to help build polished, user-facing... ...: Experience working with AI/ML workflows or AI APIs (e.g., OpenAI). Familiarity... ...year ago Software Engineer, Web Core Product & Chrome Extension New...Full timeRemote work$222.8k - $334.2k
...and Toronto. The Core Experience teams... ...content consumption with ML and personalized... ...IOS and Android engineers across Reddit and will... ...and partner with product, design, and other... ...senior leadership. Software development... ...design maintainable APIs is a plus. Benefits...Work experience placementWork at officeRemote workHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Core Product Software Engineer ML Inference & APIs. Be the first to apply!
- entry level product engineer New York, NY
- senior software design engineer New York, NY
- digital design engineer New York, NY
- senior physical design engineer New York, NY
- senior manager product engineering New York, NY
- staff design engineer New York, NY
- design engineer New York, NY
- cad design engineer solidworks New York, NY
- mep design engineer New York, NY
- physical design engineer New York, NY






