Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)
$180k - $240kEngg
- Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)LangChain · New York, NYLocation: New York, NYSalary: $180,000- $240,000Experience: 5+ yearsFunding: $45MPosted: Oct 8, 2026LangChain is hiring a Senior Backend Software Engineer, AI Observability & Evals Platform (NYC) based in New York, NY. Every apply link on Engg.space goes straight to the company's own careers page - no recruiter middleman, no generic job-board form.Apply directly at LangChain## Role detailsABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world. Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater. ABOUT THE TEAM The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done. ABOUT THE ROLE We are looking for a Senior Backend Engineer to join us. In this role you will be building the backend systems that power LangChain’s observability and evals platform. You will work on the core services that allow developers to monitor and evaluate their AI applications at scale. While the focus is on backend feature development, familiarity with fullstack or frontend engineering, performance tuning, and debugging production issues would be extremely valuable. WHAT YOU'LL DO - Design, develop, and maintain backend services and APIs to support LangSmith’s tracing, monitoring, and evaluation workflows. - Collaborate on architectural decisions to ensure systems are performant and maintainable. - Optimize storage and query performance for high-volume observability and evaluation data. - Ensure system reliability through strong testing, monitoring, and alerting practices. - Troubleshoot and resolve production issues, performing root-cause analysis and implementing long-term fixes. - Create and maintain technical documentation, including system design and API references. - Work closely with full-stack engineers, product managers, and product designers on rolling out new features. WHAT YOU'LL BRING - 5+ years of professional experience in backend engineering working on highly complex products - Proficiency in one or more backend languages/frameworks, ideally Python or Go - Strong understanding of API design and building reliable data services. - Experience with high-throughput or mission-critical systems. - Demonstrated ability to optimize backend services for performance and reliability. - Experience with database systems (Postgres, Redis, Clickhouse), and cloud platforms (AWS, GCP, Azure) - Strong communication skills, with the ability to collaborate cross-functionally - Customer centricity and ownership mentality Compensation Annual salary range: $180,000- $240,000 Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations. BENEFITS Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
- J-18808-Ljbffr Engg
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Software Engineer, AI Observability & Evals Platform (NYC) in New York, NY vacancy
- LangChain in NYC is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability and evals platform. You’ll work on core services for tracing, monitoring, and evaluation workflows, collaborating with frontend and product...PlatformSenior
- LangChain is seeking a Senior Backend Engineer to build and maintain the LangSmith observability and evals platform. You will own core backend services, APIs, and data pipelines to... ...enable developers to monitor and evaluate AI applications at scale. In this role, you will...PlatformSenior
- ...operating layer. Its platform enables financial... ...with real-time data, AI, and automation. This... ...About the Role As a Senior Rust Backend Engineer, you will work... ...secure, high-performance software across core and edge... ...testing, improve observability, and benchmark performance...PlatformSeniorFull timeRemote workWork from home
Revenue3
New York, NY6 days ago - ...’re building the clinical AI infrastructure that health... ...scribes, Concurrence is the platform our customers use to build... ...you. ABOUT THIS ROLE As a Senior Backend/Infra Engineer at Amigo, you’ll build the... ...Improving performance, observability, and operational health across...PlatformSeniorFull timeFlexible hours
$173.48k - $213.96k
...ROLEWe are seeking a seasoned backend software engineer and hands-on technical lead... ...of Peloton’s e-commerce platform across web, retail, and emerging... ..., automated testing, and observability tools like DataDogTrack... ...Familiarity with leveraging AI tooling within modern software...PlatformSeniorLocal areaPeloton Cycle
New York, NY4 days ago- Torch is a rapidly growing startup building AI-enabled healthcare procurement software. We seek a Senior Backend Engineer to help evolve our platform, design scalable distributed systems, and implement agentic workflows that power next‑gen AI experiences. You will ensure...PlatformSenior
$159k - $263k
...You’ll build the backend systems that power... ...electromagnetic capabilities—software that ingests real-... ...into durable platform capabilities. This... ...with frontend engineers on API contracts... ...You’ve integrated AI/ML capabilities into... .... You’ve used observability tooling (metrics,...PlatformSeniorFull timeContract workFlexible hoursTwenty Inc.
New York, NY4 days ago$173.48k - $213.96k
Backend Software Engineer And Technical LeadWe are seeking a seasoned backend software... ...of Peloton's e-commerce platform across web, retail, and... ...Kubernetes, automated testing, and observability tools like DataDogTrack... ...with leveraging AI tooling within modern software...PlatformSenior- Senior Backend Engineer, Agentic Workflows - Hybrid New York... ...a week Location: NYC, NY working at a... ...growing start-up software company whose... ...commerce software platform streamlines healthcare... ...generation of AI-enabled product experiences... ..., alerting, and observability systems for AI...PlatformSeniorWork at officeRemote workRelocation3 days per week
- Overview Journey.ai is a growth-stage... ...protection. Our software provides secure payments... ...Zero Knowledge® platform, agents can... ...Denver area. Our engineering team is currently... ...OpenTelemetry for end-to-end observability. Some of our core... ...of expertise in backend development)...PlatformSeniorFull timeFor contractorsRemote work3 days per week
$139.6k - $200k
Senior Backend Developer - Integrations Charlotte,... ...a single, secure platform. By delivering true... ...leveraging advanced AI-powered care... ...days (offices in NYC, Denver, CO and Charlotte... ...and high-quality software delivery. Make informed... ...scalability and observability of systems....PlatformSeniorLocal areaFlexible hours$180k - $250k
Senior Backend Engineer, Managed Services New York, New York... ...We Are Lightning AI is the company... ...build an end-to‑end platform for developing,... ...developer‑first software with cost‑efficient... ..., with security, observability, and control... ...(San Francisco, NYC, or Seattle, with...PlatformSeniorFor contractorsWork at officeWork from homeFlexible hours2 days per week$160k - $240k
Senior Backend Engineer | AI Infrastructure & Distributed SystemsAll... ...infrastructure behind an AI platform before the... ...with a venture-backed NYC startup building an... ...performance, reliability, observability, and scalability.... ...of professional software engineering experience...PlatformSenior- ...Senior AI Software Engineer (AI Products) Location: NYC or Remote MUST HAVE startup EXPERIENCE OR... ...products for our financial platform. This is a significant... ...The work will include backend services, data... ...Build evaluation, observability, and feedback loops for...PlatformSeniorFull timeFor contractorsImmediate startRemote work
Stellent IT LLC
New York, NY2 days ago - ...Title: Senior Backend AI Engineer Location: NYC NY Phoenix AZ (Onsite) Duration: Full-time Job... ...systems. Experience with cloud platforms and services and containerization... ...model gateways Evaluation observability and safety tooling for autonomous...PlatformSeniorFull time
Diverse Lynx LLC
New York, NY8 days ago - Taxo.ai, Inc. in New York City is seeking a Senior Software Engineer (Voice AI) to own core voice-runtime services for... ...handling, tool orchestration, and observability, influencing platform decisions with the CTO and... ...-on across frontend and backend pipelines, integrate with...PlatformSenior
$200k - $275k
...us… Knit is the AI-native consumer research platform helping brands automate... ...to build out our NYC engineering team and are... ...agents, offline/online evals, drift detection,... ...React, Next.js Backend: Python, FastAPI... .... Expertise in observability (OpenTelemetry/Prometheus...PlatformSeniorFlexible hoursKnit
New York, NY25 days ago$190k - $220k
...Our client is a Series A AI healthcare company in... ...role You'll join the Platform & Integrations team, which is currently three engineers. The team owns how... ...You'll own an end-to-end backend system within your first... ...Kubernetes Location: NYC (Flatiron), in office...PlatformSeniorFull timeWork at officeClosr
New York, NY1 day ago- ...'re not just building AI features, we're building... ...features, but through platform-level infrastructure... ...bet at the company.As a Senior Engineer on AI Platform, you'll... ...systems that are observable, self-correcting, and... ...will need5+ years of software engineering experience...PlatformSeniorWork at office3 days per week
Rippling
New York, NY4 days ago - ...generation of social intelligence - an AI-native platform that helps some of the world's most... ...join a small but mighty team where engineers own systems end-to-end - not tickets.... ...error rates, and make ingestion reliable, observable, and predictable. Design data access...PlatformSenior
Plot Technologies, Inc
New York, NY3 days ago - ...Senior Backend Engineer WHY THIS ROLE EXISTS Our client is building AI technology to make healthcare accessible and free for... ...healthcare tools and internal platform workflows Process... ...Monitoring, logging, and observability tools NICE TO HAVE...PlatformSenior
NxT Level
New York, NY2 days ago - ...hiring in New York, NY for a Senior Backend Engineer on the Integrations team. You... ...ship integrations with external platforms and own projects end to end,... ...developer tooling. We value AI-augmented development and high ownership. This hybrid NYC role offers strong technical...PlatformSenior
- ...continuous load, while bringing AI-assisted approaches into production engineering. You will take... ...ll Do Strengthen backend services that process high... ...keep a round-the-clock platform dependable. Partner... ...data stores, observability and container orchestration...PlatformSeniorFull timeWork at office
Fast-growing technology company
New York, NY11 hours ago $182.75k - $278.5k
...their practice on our software, serving over 1 million... ..., and investing in the platform foundations to enable this... ...better. The Work Backend at Headway involves... ...work on: The Modern AI-enabled Clinical System... ...The Insurance Billing Engine: We apply AI pragmatically...PlatformSeniorFlexible hoursShift workHeadway - Design & Development
New York, NY4 days ago- Chalice, a leading AI platform for brands, is seeking a Senior Software Engineer to build scalable APIs, containerized deployments, and event-driven architectures in a hybrid NYC/remote setup. You will own core platform code, mentor junior engineers, and collaborate with...PlatformSeniorRemote job
- Bandana is building a premier job search and career platform for blue-collar workers. We seek a senior backend engineer to drive engineering excellence, shape... ...teammates and guiding best practices. This role targets NYC-area talent with substantial impact and growth opportunities...PlatformSenior
$158.4k - $207.9k
...'re Oscar. We're hiring a Senior Software Engineer, Backend to join our Engineering team... ...a full stack technology platform and a focus on serving our... ...Golang.Experience owning observability stack tooling, e.g. Grafana... ....Artificial Intelligence (AI): Our AI Guidelines outline...PlatformSeniorFull timeWork at officeFlexible hoursOscar Health Insurance
New York, NY3 days ago- ...effodio Senior Backend Software Engineer (Tech Lead) Full-Time | Remote - United States About effodio Founded... ...analytics. Our advanced platform harnesses modern distributed systems,... ...other legally protected characteristic. AI in Our Hiring Process effodio uses AI...PlatformSeniorFull timeRemote workVisa sponsorshipWork visa
Effodio, Inc.
New York, NY13 hours ago $153k - $179k
...are the rewards.As a Senior Software Engineer, you’ll architect, build, and scale the backend services, infrastructure... ...-class decentralized platform for trading real-... ...system reliability, observability, and operational rigor... ...seeing your application.AI Usage Disclosure:...PlatformSeniorContract workWork at officeWorldwideFlexible hoursShift workNight shiftWeekend work3 days per weekRobinhood Financial
New York, NY5 days ago- ...in New York City seeks a Senior Product Manager to shape... ...roadmap for the Financial Platforms & Data domain, enabling billing... ...Revenue Operations, and Engineering to build a cohesive data... ...across analytics and AI initiatives. This hybrid NYC role offers a base salary...PlatformSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Software Engineer, AI Observability & Evals Platform (NYC). Be the first to apply!
Related searches
- java developer backend New York, NY
- senior backend developer New York, NY
- back-end developer New York, NY
- lead backend developer New York, NY
- backend software engineer New York, NY
- backend python developer New York, NY
- remote back end developer New York, NY
- client platform engineer New York, NY
- platform engineering manager New York, NY
- platform developer New York, NY