Software Engineering Manager, AI Observability & Evals Platform (New York, NY)
$200k - $250kStartups
About Us
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
About the Team
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
About the role
We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You’ll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.
What you'll do
Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
Strengthen LangChain’s engineering culture through mentorship, high-quality code, and technical excellence
Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
Engage directly with customers to understand their needs and translate them into actionable product improvements
What you'll bring
Experience managing or tech-leading teams delivering complex full-stack products
Strong technical background in Go/Python and React/Typescript
Solid understanding of databases (Postgres, Redis and ClickHouse)
Proven ability to design high throughput data-intensive systems
Bias towards shipping quickly and learning from customers
Strong communication skills—able to collaborate with internal stakeholders and engage directly with customers
Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
Annual salary range: $200,000- $250,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
Benefits
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
#J-18808-Ljbffr$220k - $350k
...the largest global platform for the LGBTQ+... ...platforms, networks, observability, forward deployment engineering, enterprise architecture, and AI foundations across... ...based vulnerability management, secure software supply chain... ...all.From finding new ways to measure sustainability...PlatformFull timeLive inWorldwideFlexible hours$250k
...Dev Ops & QA Engineering Company... ...technology and software solutions.... ...software and AI, an... ...to enable a new wave of ultrasound... ...and software platform. Butterfly’s... ...establish release management processes... ...). Drive observability and site... ...office in New York City, NY. Benefits...PlatformH1bWork at officeImmediate start2 days per week$195k - $205k
...powering the new savings economy. Our platform redefines... ...savers. The Engineering team is... ...Engineering Manager to lead our AI Engineering... ...modern AI and software engineering.... ...scalability, observability, and operational... ...in our New York office, and... ...are based on NY and other...PlatformWork at office- ...AI Enabled Modernization - Agentic Software Engineer - Vice President (New York, NY) location_on New York, NY,... ...Intelligence, risk management, big data,... ...frameworks, and observability mechanisms... ...pipelines, data platforms, or operational... ...layers. AI Evals: Experience designing...PlatformFull timeTemporary workWork at office
$199k
...New York, NY, USA; San Francisco, CA, USA... ...looking for an Engineering Manager to lead one of... ...Jade, our AI-powered financial... ...caliber team of software engineers... ...experiences and evals to the guardrails and observability that keep Jade... ...and intuitive platforms, we empower our...PlatformFull timeWork at officeLocal areaRemote workNight shift$121.79k - $156k
Senior Project Manager - Strategic Projects (Cloud, AI, Databricks) IT/Health IT/Informatics New York, NY ID: 1156167_RR00115459 Full-Time/Regular NYU Langone Health is a fully integrated health system that consistently achieves the best patient outcomes through a rigorous...Full time$200k - $360k
...Build the Engine Behind Crosby's AI-Native Legal Platform Crosby is the first... ...at Crosby in New York, NY is for someone who... ...systems — prompt management tooling, evaluation... ...are reliable, observable, and maintainable... ...: ~3+ years of software engineering experience...PlatformFull timeWork at office$180k - $240k
...Senior Software Engineer, Platform at Tabs — New York, NY Tabs, the AI Operating System for Revenue, is seeking a Senior Software Engineer, Platform in New... ...tooling, CI/CD pipelines, developer containers, observability stacks, and the API standards every product team...PlatformFull timeContract workWork at office$199k
...Chicago, IL, USA; New York, NY, USA; San Francisco, CA,... ...builds the products and platforms that give members access... ..., and grow a group of engineers, and define the... ...Provide full people management for 3-5 direct reports... ...technically yourself Use AI coding tools and workflows...PlatformFull timeWork at officeLocal areaRemote workFlexible hours$206.1k - $309.15k
...comprehensive ad platforms for... ...involves leading software solution... ...resource management.Job DescriptionResponsibilities... ...multiple engineering teams.... ...testing, observability, and... ...of AI-assisted software... ...new applications... ...PrinciplesCompensationNew York Pay Range:... ...: NY - New York,...PlatformFull timeNight shiftWeekend work$196k - $245k
...Staff Software Engineer, Liquidity Management New York, NY, United States At Ripple Treasury, you... ...and maintains core platform capabilities giving treasury... ...and banks, and develop AI/ML features for... ...best practices including observability, incident response, and...PlatformFull timeWork at officeLocal areaFlexible hours- ...At the forefront of this shift, Fireworks AI is seeking a driven Member of Technical Staff, Software Engineer in New York, NY . In this full-time role, you will build and... ...Engineer at Fireworks AI As a core platform engineer, you will bridge the gap between heavy...PlatformFull timeShift work
$164k
New York, NY, USA; San Francisco, CA, USA About the role... ...the products and platforms that give members access... .... As a Senior Software Engineer in Lending, you’ll work... ...We also actively use AI where it can improve... ...for scale, resiliency, observability, and operational excellence...PlatformFull timeWork at officeLocal areaRemote workFlexible hours- Account Executive, AI SaaS | Onsite in New York, NY | Local Candidates Only, 5 Days... ...sell an AI-powered SaaS platform to technical and business... ...including product leaders, engineering leaders, CMOs, revenue... ...prospecting, negotiation, pipeline management, and forecasting...PlatformContract workWork at officeLocal areaRemote workRelocation
$103.75k - $174.75k
...: 2026-10-08Location: New York, NY, United StatesSalary:... ...the Decision Science engine for Global Servicing,... ...analytics, data science, AI/GenAI, and decisioning... ...Capabilities, Control Management, Strategy, Operations,... ...working with Technology and platform teams to support...PlatformVisa sponsorship$208k - $312k
...js, v0, and AI SDK, we create... .... Now, software is entering a new era, and the... ...building the platform for that... ...a Software Engineer to join the... ...onsite in New York City . If... ...offices (SF, NY, London, or... ...evaluation and observability story: test... ...-time evals that make agents...PlatformWork at officeRemote workWorldwideMonday to Friday$196k - $230k
...International engineering team's... ...scale our platform to support... ...millions of new customers in... ...helping people manage their... ...Full Stack Software Engineer, you... ...either our New York City,... ...Reliability & Observability: Ensure backend... ...New York, NY; Bellevue,... .... AI Usage Disclosure...PlatformWork at officeWorldwideFlexible hoursShift work3 days per week$200k - $275k
...speed and accuracy. Our AI-enabled platform turns siloed and... ...looking to add a Staff Software Engineer, Traffic to expand our... ...communication, traffic management, routing, and observability—building the control planes... ...one of our offices in New York and excited to work in-...PlatformWork at officeLocal area$196k - $240k
...Please note this is for New York, NY, United States. You... ...forward-thinking Engineering Manager passionate about building a world-class platform through a world-class... ...and modern software engineering, delivering... ...practices including observability, incident response,...PlatformFull timeLocal areaWorldwide$160k - $240k
...Senior Software Engineer - AI Inference Location New York Business Area Engineering and CTO Ref... ...Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting... ...improve model deployment, observability, and production performance...PlatformTemporary workFor contractorsWork experience placement$160k - $240k
...Senior Software Engineer - Vault Location New York Business Area Engineering... ...green-field platform for communications... ...advancing a spec-driven, AI-assisted software... ..., product managers and partner teams.... ...automated testing, CI/CD, observability, and modern...PlatformTemporary workFor contractorsWork experience placement$160k - $240k
...Senior Software Engineer - Connectivity Gateway Location: New York Business Area: Engineering... ...Requirements AI may be the brain... ...-protocol proxy platform that powers... ...scale performance, observability, resiliency, and... ..., and systems-management challenges...PlatformTemporary workFor contractors$160k - $240k
...Senior Software Engineer - Cloud Native Compute Infrastructure... ...Location New York Business Area... ...stateful platforms, including: Bloomberg... ...supporting AI training and inference... ...by safely managing OS, firmware, network... ...Enhance system observability through robust monitoring...PlatformTemporary workFor contractorsWork experience placement- ...Python Backend + AI/ML Engineer specializing in Agentic... ...onsite basis in New York or Atlanta, via... ...of professional software engineering... ...with Agentic AI in NY / GA via Racedog... ...intelligent automation platforms. Your daily... ...performance, token management, cost efficiency,...PlatformPermanent employmentFull timeContract workImmediate start
$160k - $240k
...Senior Software Engineer - Media API Platform Location New York Business Area Engineering and CTO... ...authorization, rate limiting, token management and job management.... ..., daily test reports, and observability tooling—including AI-assisted skills that track...PlatformTemporary workFor contractorsWork experience placementWorldwideNight shift$110k - $155k
...leadership, and innovative platforms. We are seeking a... ..., launch new content channels, and... ...capabilities—such as AI-assisted content, AEO... ...and AEO (Answer Engine Optimization) to maximize... ...building and managing content strategies... ...level roles. City* New York State* New York Job...PlatformFixed term contractWork at officeShift work- ...At Future Secure AI, we're building something genuinely new — and we're looking for people... ...Atlas, our proprietary platform for building and testing... ...and tooling that support engineering and the wider organization... ..., you’ll operate and manage these systems to the standard...PlatformPermanent employmentContract workFor contractorsInterim roleWork at officeFlexible hours3 days per week
$196.3k - $249k
...customer growth. As software development... ...value of its platform to modern engineering, product, and... ...shapes how new products... ...Product Marketing Manager, you will own... ..., NC, or New York, NY. What this... .... You're AI-curious -... ...instrumentation, observability, developer...PlatformWork at officeRemote workFlexible hours$220k - $405k
...Member of Technical Staff (Software Engineer, Enterprise Adoption) for its New York, NY office. This full-time... ...and applied AI, focused on making the... ...into core product and platform improvements. Collaborate... ...context engineering, and evals — along with strong intuition...PlatformFull timeWork at office$140k - $295k
...Product Manager – Data and Platform Tools – Bloomberg Connects Location New York Business Area Engineering and CTO Ref # 10054238 Description & Requirements Bloomberg... ..., computer vision, and generative AI capabilities — plus the agentic core...PlatformTemporary workFor contractorsWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Manager, AI Observability & Evals Platform (New York, NY). Be the first to apply!
- software product owner New York, NY
- software quality assurance New York, NY
- entry level software sales New York, NY
- mid-level software developer New York, NY
- software technical writer New York, NY
- id software New York, NY
- software trainer New York, NY
- software sales New York, NY
- mobile software developer New York, NY
- software asset management analyst New York, NY



