Backend Platform Engineer - AI Inference & Observability
BaseTen
Baseten is hiring a backend/distributed systems engineer to join our Product Platform in San Francisco. You will design telemetry pipelines, own observability platforms, and build billing systems while enabling faster developer velocity and robust CI/CD. You will work across multi-cloud infrastructure, partner integrations, and cross-team initiatives to ship reliable, scalable systems for production AI inference. #J-18808-Ljbffr
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Backend Platform Engineer - AI Inference & Observability in New York, NY vacancy
$180k - $240k
...foundation for agent engineering in the real world, helping... ...to production-ready AI agents that teams can... ...grown to also offer a platform for building, evaluating... ...includes LangSmith (Observability, Evaluation, Deployment... ...looking for a Senior Backend Engineer to join us. In...SuggestedWork at officeFlexible hoursLangChain, Inc.
New York, NY3 days ago- ...LangChain, Inc. is seeking a Senior Backend Engineer to design and build the backend systems powering LangSmith's observability and evals platform at scale. You will work on core services... ...developers monitor and evaluate their AI applications, with a focus on backend feature...Suggested
LangChain, Inc.
New York, NY13 hours ago - ...powers mission-critical inference for the world's most dynamic AI companies, like Cursor,... ...us and help build the platform engineers turn to ship AI products... .... We’re hiring a backend/distributed systems engineer... ...agentic development Observability platform Please come...SuggestedFlexible hours
US Health Partners, LLC
New York, NY36 minutes ago - ...LangChain is seeking a Senior Backend Engineer to build and maintain the... ...systems powering LangSmith’s observability, evaluation, and production... ...services that monitor and evaluate AI applications at scale,... ...throughput systems, databases, and cloud platforms. #J-18808-Ljbffr...Suggested
Applied Methods Inc
New York, NY12 hours ago - LangChain in NYC is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability and evals platform. You’ll work on core services for tracing, monitoring, and evaluation workflows, collaborating with frontend and product...Suggested
$180k - $250k
...Platform Engineer (Python/AWS) sought for a fast-growth and cutting-edge data/AI startup in New York. This is a well-funded and former Palantir alumni founded business... ...deployment processes focusing on automation and observability. Skills sought: Bachelors degree in Comp...Attis
New York, NY3 days ago- ...Braintrust is the agent observability platform. By actively applying intelligence to agent traces and automatically... ...agents operate in production. This Software Engineer role emphasizes REST/APIs, Backend, Python, Cloud, Go, AI/LLM, and ML, with remote-friendly options and...Remote work
JobLarper
New York, NY13 hours ago $190k - $300k
Principal Observability Platform Engineer - Nscale About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start... ...GPU utilisation, training job visibility, inference latency. Prior experience defining...Flexible hours- ...powers mission-critical inference for the world's most dynamic AI companies. By uniting... ...us and help build the platform engineers turn to ship AI products... ...authentication.Instrument deep observability (metrics, traces, logs)... ...distributed systems, backend infrastructure, or...Flexible hours
baseten
New York, NY12 hours ago $10k
...manage what they spend across AI providers and subscriptions.... ....We’re looking for a senior backend engineer to build the systems behind... ...company initiatives such as inference accounting, and figuring out... ..., performance, and observability of systems as customer usage...Full timeWork at officeRemote workHome officeFlexible hoursRamp
New York, NY3 days ago$130k - $400k
...Backend Engineer, MarketplaceLocation: San Francisco or New... ...Late-Stage / Series C AI Infrastructure... ...AI development. Their platform connects enterprises... ...improves reliability, observability, and scalability across... ...or production model inference systemsExperience with...Work at officeRecruiting from Scratch
New York, NY4 days ago$180k - $250k
...Senior Backend Engineer, Managed Services New York, New York,... ...Who We Are Lightning AI is the company behind... ..., we build an end-to‑end platform for developing, training,... ...training, and production inference, with security, observability, and control built in....For contractorsWork at officeWork from homeFlexible hours2 days per weekLightning AI
New York, NY2 days ago- ...inflection point. AI-powered drug... ...builder of Atrix’s backend infrastructure ,... ...APIs, and real-time inference systems ,... ...foundational to how our platform works and scales.... ...rich backend engineering challenges like:... ...features Improve observability, traceability,...Remote work
// Praxis //
New York, NY14 hours ago $180k - $250k
...Backend EngineerLondon, England, United Kingdom... ...StatesWho We AreLightning AI is the company... ...build an end-to-end platform for developing, training... ..., and production inference, with security, observability, and control built in... ...for a Backend Engineer to help develop and...Work at officeWork from homeFlexible hours2 days per weekLightning AI
New York, NY4 days ago$200k - $240k
...to everyone through AI. We need backend infrastructure that... ...scale our AI doctor platform to billions of consultations... ...supporting model inference, data preprocessing,... .... How We Work Engineering‑first org: no project... ...Monitoring, logging, observability tools Preferred Qualifications...Full timeDoctronic
New York, NY3 days ago$250k - $300k
...Our client, an AI-driven healthcare organization, is hiring a Senior Backend Engineer to join the team in New York. The successful... ...-time clinical monitoring platform, developing services that process... ...into production and ensure inference services run reliably....Alldus
New York, NY1 day ago- ...Cloud is a fast-growing, AI-native infrastructure... ...GPU compute, inference services, and infrastructure... ...APAC. As a Reference Platform NVIDIA Cloud Partner... ...Infrastructure Backend Engineering Development Engineer... ...methodologies. # Develop observability and telemetry...
Jobrapido
New York, NY2 days ago $250k
...They are building an AI-powered care orchestration platform designed to unify... ...with a robust backend infrastructure to... ...looking for staff-level engineers to help design,... ...from low-latency inference pipelines to workflow... ...CI/CD, testing, observability, and production deployments...Remote workByteHire Limited.
New York, NY3 days ago- ...Evertune AI is hiring in the United States for a senior backend engineer to take ownership of the AI Discovery platform's backend. You will design and scale distributed systems, implement cloud infrastructure patterns, and optimize integrations with OpenAI and other LLM...
Evertune AI
New York, NY3 days ago $270.4k - $365k
...the infrastructure platform that turns large-... ...-consumable AI infrastructure. This... ...part of a software engineering team. You will... ...AI training and inference workloads. You will... ...from changes in backend infrastructure.... ...rollout, rollback, observability, and incident learning...Work at officeLocal areaRemote workGroq, Inc.
New York, NY36 minutes ago$159k - $263k
...You’ll build the backend systems that power... ...needs into durable platform capabilities. This... ...Collaborate with frontend engineers on API contracts... ...You’ve integrated AI/ML capabilities... ...systems (inference, pipelines, or tooling... ...projects. You’ve used observability tooling (metrics,...Full timeContract workFlexible hours- ...Clipbook Engineering RoleYou'd be one of the first... ...& build core backend systems. Drive architectural... ...? deployment ? observing users rely on what... ....Integrate AI into real-world workflows... ..., fine-tuning, inference optimization.... ...hats. There's no platform team to hand things...
Clipbook
New York, NY4 days ago $165k - $330k
...A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure...Baseten
New York, NY3 days ago- ...Bloomberg is building core AI infrastructure to host, deploy, and serve ML models... ...scalability, performance, and governance. The AI Inference platform leverages KServe and open-source tools... ...across the platform, mentoring engineers and collaborating with cross-functional...
Bloomberg
New York, NY4 days ago - AppGate is seeking a Staff/Principal Platform Engineer in New York City to lead the foundational AI platform and infrastructure. You’ll own APIs, cloud and self-managed components, ensuring fast, reliable and observable systems at scale, while setting technical direction...
- Lightning AI is seeking a Senior Software Engineer to design and build the backend systems powering AI agent orchestration and execution... ...’ll create scalable APIs and platform capabilities for tool use,... ..., with a strong emphasis on observability and performance. #J-18808-...
- ...As a Staff Software Engineer on the Agent Platform team, you will help secure tens... ...reliability, scalability, observability, and operability improvements... ...Your Toolkit: Our backend services are primarily developed... ...provide engineers with modern AI-powered tools to improve...Temporary workLocal areaWorldwideFlexible hours
SentinelOne
New York, NY11 hours ago $210k
...client, an early-stage AI Software company, is... ...AI /Machine Learning Platform Engineer to join their team in... ..., evaluation, inference and model deployment.... ...automated testing, CI/CD, observability, reusable infrastructure... ...across models, backend systems, data platforms...Alldus
New York, NY4 days ago- ...seeking a Senior Software Engineer to join the Workflows team... ...You will design and build backend services powering workflow... ...You will contribute to an AI-first platform, implement reliable, event-... ...emphasize scalability and observability. #J-18808-Ljbffr Standard...
- ...a Principal Software Platform Engineer to own the architecture... ...of a next-generation AI and machine learning platform... ...that are scalable, observable, secure, and... ...both real-time and batch inference workloads. Developing... ...with a strong focus on backend services and API development...
Jobrapido
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Platform Engineer - AI Inference & Observability. Be the first to apply!
Related searches
- java developer backend New York, NY
- senior backend developer New York, NY
- back-end developer New York, NY
- backend software engineer New York, NY
- backend python developer New York, NY
- remote back end developer New York, NY
- client platform engineer New York, NY
- platform engineering manager New York, NY
- platform developer New York, NY
- platform engineer New York, NY