Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineering Manager, AI Observability & Evals Platform (Boston)

$220k - $270k
Full-time

LangChain

About Us

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.

About the Team

The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.

 

About the role

We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You’ll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.

 

What you'll do

  • Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability

  • Strengthen LangChain’s engineering culture through mentorship, high-quality code, and technical excellence

  • Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform

  • Partner with product and design teams to define scope, sequence, and success criteria for key initiatives

  • Maintain a high bar for technical excellence while making sure the team moves with urgency and focus

  • Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript

  • Engage directly with customers to understand their needs and translate them into actionable product improvements

 

What you'll bring

  • Experience managing or tech-leading teams delivering complex full-stack products

  • Strong technical background in Go/Python and React/Typescript

  • Solid understanding of databases (Postgres, Redis and ClickHouse)

  • Proven ability to design high throughput data-intensive systems

  • Bias towards shipping quickly and learning from customers

  • Strong communication skills—able to collaborate with internal stakeholders and engage directly with customers

  • Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms

 

Annual salary range: $220,000- $270,000

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.

We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Manager, AI Observability & Evals Platform (Boston) in Boston, MA vacancy
  • $198.25k - $237.5k

     ...InformationJob TitleAI Engineering Lead, Evals and Systems...  ...Full-TimeLocation(s)Boston, Chicago, London,...  ...of applied AI.You will work inside...  ...product team, building software that helps the...  ..., and the platform compounds in value...  ...that evaluation and observability infrastructure is... 
    Platform
    Full time
    Contract work
    Local area
    Immediate start

    Bain & Company

    Boston, MA
    1 day ago
  • $160k - $220k

     ...the leader in AI-native frontline...  ..., no-code platform, powered by embedded...  ...of Built In Boston’s “Best Places...  ...and people management skills, years...  ...about mentoring engineers and helping them...  ...experience in software engineering,...  ...standards: testing, observability, and AI-driven... 
    Platform
    Temporary work
    Work at office
    Local area
    Flexible hours
    3 days per week

    Tulip Interface

    Somerville, MA
    2 days ago
  • $165k - $235k

     ...Nordic Semiconductor's Device Management and Observability platform for teams building...  ...developers trying our product and engineering leaders making a purchase...  ...or IoT hardware and software landscape is a plus, but...  ...details ~ Location: Boston, United States Please... 
    Platform
    Flexible hours

    Nordic Semi

    Boston, MA
    2 days ago
  • $180k - $240k

     ...foundation for agent engineering in the real...  ...-ready AI agents that teams...  ...to also offer a platform for building, evaluating...  ...LangSmith (Observability, Evaluation,...  ...based onsite in Boston, MA. We are looking...  ...and evals platform. You will...  ...engineers, product managers, and product designers... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    more than 2 months ago
  • $195k - $242.5k

     ...Global IT Software Engineer Senior Director & Tech...  ...Area Lead - Legal - Boston, United States of...  ...leading-edge management consulting along...  ...we apply agentic AI, data, and automation...  ...alignment across platforms, teams, and stakeholders...  ...and AI-quality observability and health... 
    Platform
    Contract work
    Temporary work
    Work at office
    Local area

    Boston Consulting Group

    Boston, MA
    14 hours ago
  •  ...through intelligent, data-driven performance management platforms.Accenture's SAP practice helps clients...  ...Cloud, SAP Datasphere, SAP Business AI, and other SAP technologies. With deep...  ...such as for a disability or religious observance, please call us toll free at 1 (877) 88... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  •  ...communities. Visit us at .You Are:As a Manager within Accenture's SAP...  ...'s modern data and analytics platform — including SAP Datasphere,...  ...with Databricks-powered AI/ML pipelines and business content...  ...for a disability or religious observance, please call us toll free at... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $120k - $202.5k

     ...the strategy, engineering, modernization...  ...Cash Investment Management. This role...  ...resilient, scalable platforms for liquidity...  ...orders.Apply AI and machine...  ...cybersecurity, observability, and production...  ...progressive software engineering and...  ...SummaryLocation: Boston, Massachusetts... 
    Platform
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Boston, MA
    14 hours ago
  •  ...unleashing the power of AI to create value at...  ...assets and platforms, and deep ecosystem...  ...are:An AI Native Engineer with a minimum of...  ...harnesses, and lifecycle observability.AI Platform...  ...experience with end-to-end software engineering and...  ...layers to manage multi-provider pipelines... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $160k - $180k

     ...leading the way. Our software brings the physical...  ...our Cloud Native SaaS platforms and cloud...  ...closely with Product Engineering, Product Management, SRE/Platform, and GRC...  ...strategy and across AI, SaaS, cloud, and product...  ...here."SummaryLocation: Boston, MA, USAType: Full... 
    Platform
    Full time
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    PTC

    Boston, MA
    1 day ago
  • $235.75k - $282.5k

     ...company, and engineering work at the frontier...  ...of applied AI. You will...  ...team, building software that helps the...  ..., and the platform compounds in value...  ...and state management, and the interface...  ...– building evals to measure output...  ...and observability for the Agentic... 
    Platform
    Full time
    Local area
    Immediate start

    Bain & Company

    Boston, MA
    4 days ago
  • $175k - $240k

     ...foundation for agent engineering in the real world,...  ...production-ready AI agents that teams...  ...to also offer a platform for building, evaluating...  ...LangSmith (Observability, Evaluation, Deployment...  ...5 days/week in Boston, MAWe're looking for...  ...of experience in software engineering... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    more than 2 months ago
  • $185k - $235k

     ...intersection in tech right now: AI and customer...  ...’re looking for an Engineering Manager/Technical Lead to help...  ...AGI’s Voice Agent platform.Maven Voice enables enterprise...  ...with a team of software engineers building...  ...historyEstablish strong observability and debugging... 
    Platform
    Work at office
    Home office

    Maven AGI

    Boston, MA
    4 days ago
  • $170k - $230k

     ...We are currently seeking an Engineering Functional Lead(FL) to join...  ...architectures (cloud-native, APIs, SaaS platforms, AI/ML, Generative AI where...  ...approach to client management. Across Investor Services and...  ...or local law.SummaryLocation: Boston; Jersey CityType: Full time
    Platform
    Full time
    Local area

    Brown Brothers Harriman

    Boston, MA
    14 hours ago
  •  ...unleashing the power of AI to create value at...  ...proprietary assets and platforms, deep process and industry...  ..., Supply Chain and Engineering, and Talent, with advanced...  ...Engineering, Endpoint Management, Mobile Technologies,...  ...or religious observance, please call us toll free... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $176.6k - $239k

    AWS Applied AI Solutions (AAIS) is building toward...  ...Technical Account Managers (TAM) support our customers...  ...work with appropriate engineers and service teams to see...  ...broadly adopted cloud platform. We pioneered cloud computing...  ...0 USD annuallyUSA, MA, Boston - 153,600.00 - 207,800.... 
    Platform
    Work experience placement
    Local area
    Flexible hours

    AmazonWebServices

    Boston, MA
    3 days ago
  •  ...Cloud About the Company Developing software foundation for next-generation accelerated computing platform for large-scale AI infrastructure. Industry Information...  ...search of a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a... 
    Platform

    Confidential

    Boston, MA
    2 days ago
  • $174.6k - $235k

     ...team makes sure Cisco's cloud platforms have the compute, storage and...  ...from sales, product and engineering into confirmed supply with our...  ...maintenance windows on track while managing cloud spend responsibly. We'...  ...is timing: we're bringing AI-powered forecasting into how... 
    Platform
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    CISCO Systems

    Boston, MA
    2 days ago
  • $134.5k - $265.1k

     ...Deloitte is seeking a Lead Managed Services Engineer II to design, automate, and...  ...you will apply Google Cloud Platform (GCP), Terraform,...  ...intelligence and machine learning (AI/ML) teams to support evolving...  ..., alerting, logging, observability, high availability, and disaster... 
    Platform
    Work at office
    Local area
    Visa sponsorship
    Night shift
    1 day per week

    Deloitte

    Boston, MA
    3 days ago
  •  ...live to see what this platform can do. Since we were...  ...senior Data Cloud and AI Architect within Accenture...  ...delivery teams, and manage technical risk across...  ...in Computer Science, Engineering, or equivalent (minimum...  ...disability or religious observance, please call us toll... 
    Platform
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $134.5k - $265.1k

     ...Deloitte is seeking an AI Cloud Security Engineer, Manager to lead the design, implementation...  ...(AI)-enabled products, platforms, and cloud environments....  ...AI Zero Trust, secure AI software development, cloud...  ...RAG, model integrations, observability, and automated testingLeading... 
    Platform
    Work experience placement
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    4 days ago
  •  ...seeking an experienced Project Manager to lead a strategic proof-of-...  ...standardized AWS-based cloud platform.This role will partner...  ...assigned Data, Technology and Engineering (DTE) technical lead to jointly...  ...resourcing aligned to research AI strategy Prepare program for... 
    Platform
    Flexible hours

    Zifo

    Boston, MA
    2 days ago
  • $180k - $220k

     ...hands-on role with an AI-native mindset. There...  ...You'll lead through the platform, redesigning how we...  ...product and corporate engineering teams build on. You'll...  ...audit trails, secrets management, environment separation...  ...running. Build the observability layer. Logging, metrics... 
    Platform

    Convene Hospitality Group

    Boston, MA
    21 days ago
  • $134.5k - $265.1k

     ...advanced analytics, Generative AI, transformative technologies,...  ...operators, creatives, designers, engineers, and architects. Our team...  ...technology, creativity, and ongoing managed services to solve the biggest...  ...on the applicable Salesforce platform best practicesCommunicate... 
    Platform
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    1 day ago
  • $255k

     ...Workplace Solutions - Boston, United States of...  ...leading-edge management consulting along...  ...an intelligent, AI-enabled employee...  ...closely with Product, Engineering, Operations and...  ...collaboration platforms, meeting technologies...  ...reliability, observability, performance and... 
    Platform
    Work experience placement
    Work at office
    Local area

    Boston Consulting Group

    Boston, MA
    14 hours ago
  • $140k - $191k

    Boston, MAHybridFull Time$150k - $190kJob Description...  ...seeking an Agentic AI Engineer (Insurance & Agentic...  ...will work across software engineering,...  ...with model APIs and managed AI platforms such as Amazon Bedrock...  ...building monitoring, observability, and cost management... 
    Platform
    Full time
    Temporary work
    Flexible hours

    Motion Recruitment

    Boston, MA
    1 day ago
  • $140k - $190k

    Boston, MAHybridFull Time$140k - $190k Job Description...  ...seeking an Agentic AI Engineer to design, build,...  ...strong Python software engineering skills with...  ...major model APIs or managed AI platforms such as Amazon Bedrock...  ...Implement observability, audit logging, monitoring... 
    Platform
    Full time
    Temporary work
    Flexible hours
    3 days per week

    Motion Recruitment

    Boston, MA
    3 days ago
  • $174k - $215k

     ...the intelligent platform for travel and spend management. Built to...  ...in London and Boston. We combine innovation...  ...is growing its engineering footprint in...  ...looking for a Staff Software Engineer to...  ...experience leading observability and reliability...  ...looks like.AI-driven development... 
    Platform
    Summer work
    Work at office
    Immediate start
    Worldwide
    Relocation
    Relocation package
    3 days per week

    Perk

    Boston, MA
    3 days ago
  • $60 - $75 per hour

    Boston, MAHybridContract$60/hr - $7...  ...Senior Analytics Engineer to help drive...  ..., and AI capabilities....  ...of data and AI platforms. You will collaborate...  ...with software engineering best...  ...and stakeholder management skills Desired...  ...monitoring, lineage, observability, and... 
    Platform
    Full time
    Temporary work
    Flexible hours

    Motion Recruitment

    Boston, MA
    3 days ago
  • $143k - $243k

     ...for all.Role SummaryLead one to two software engineering teams in the Medication Management zone, with responsibility for both...  .... This hybrid role, based in Boston, MA, is an opportunity to shape product...  ...performance Champion and apply AI tools and AI-assisted workflows to... 
    Full time
    Temporary work
    Work at office

    athenahealth

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Manager, AI Observability & Evals Platform (Boston). Be the first to apply!