Software Engineering Manager, AI Observability & Evals Platform (Boston)
$220k - $270kLangChain
About Us
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
About the Team
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
About the role
We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You’ll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.
What you'll do
Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
Strengthen LangChain’s engineering culture through mentorship, high-quality code, and technical excellence
Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
Engage directly with customers to understand their needs and translate them into actionable product improvements
What you'll bring
Experience managing or tech-leading teams delivering complex full-stack products
Strong technical background in Go/Python and React/Typescript
Solid understanding of databases (Postgres, Redis and ClickHouse)
Proven ability to design high throughput data-intensive systems
Bias towards shipping quickly and learning from customers
Strong communication skills—able to collaborate with internal stakeholders and engage directly with customers
Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
Annual salary range: $220,000- $270,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
Benefits
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
$198.25k - $237.5k
...InformationJob TitleAI Engineering Lead, Evals and Systems... ...Full-TimeLocation(s)Boston, Chicago, London,... ...of applied AI.You will work inside... ...product team, building software that helps the... ..., and the platform compounds in value... ...that evaluation and observability infrastructure is...PlatformFull timeContract workLocal areaImmediate start$160k - $220k
...the leader in AI-native frontline... ..., no-code platform, powered by embedded... ...of Built In Boston’s “Best Places... ...and people management skills, years... ...about mentoring engineers and helping them... ...experience in software engineering,... ...standards: testing, observability, and AI-driven...PlatformTemporary workWork at officeLocal areaFlexible hours3 days per week$165k - $235k
...Nordic Semiconductor's Device Management and Observability platform for teams building... ...developers trying our product and engineering leaders making a purchase... ...or IoT hardware and software landscape is a plus, but... ...details ~ Location: Boston, United States Please...PlatformFlexible hours$180k - $240k
...foundation for agent engineering in the real... ...-ready AI agents that teams... ...to also offer a platform for building, evaluating... ...LangSmith (Observability, Evaluation,... ...based onsite in Boston, MA. We are looking... ...and evals platform. You will... ...engineers, product managers, and product designers...PlatformWork at officeFlexible hours$195k - $242.5k
...Global IT Software Engineer Senior Director & Tech... ...Area Lead - Legal - Boston, United States of... ...leading-edge management consulting along... ...we apply agentic AI, data, and automation... ...alignment across platforms, teams, and stakeholders... ...and AI-quality observability and health...PlatformContract workTemporary workWork at officeLocal area- ...through intelligent, data-driven performance management platforms.Accenture's SAP practice helps clients... ...Cloud, SAP Datasphere, SAP Business AI, and other SAP technologies. With deep... ...such as for a disability or religious observance, please call us toll free at 1 (877) 88...PlatformWork experience placementLive inWork at officeLocal area
- ...communities. Visit us at .You Are:As a Manager within Accenture's SAP... ...'s modern data and analytics platform — including SAP Datasphere,... ...with Databricks-powered AI/ML pipelines and business content... ...for a disability or religious observance, please call us toll free at...PlatformWork experience placementLive inWork at officeLocal area
$120k - $202.5k
...the strategy, engineering, modernization... ...Cash Investment Management. This role... ...resilient, scalable platforms for liquidity... ...orders.Apply AI and machine... ...cybersecurity, observability, and production... ...progressive software engineering and... ...SummaryLocation: Boston, Massachusetts...PlatformFull timeTemporary workFlexible hours- ...unleashing the power of AI to create value at... ...assets and platforms, and deep ecosystem... ...are:An AI Native Engineer with a minimum of... ...harnesses, and lifecycle observability.AI Platform... ...experience with end-to-end software engineering and... ...layers to manage multi-provider pipelines...PlatformWork experience placementLive inWork at officeLocal area
$160k - $180k
...leading the way. Our software brings the physical... ...our Cloud Native SaaS platforms and cloud... ...closely with Product Engineering, Product Management, SRE/Platform, and GRC... ...strategy and across AI, SaaS, cloud, and product... ...here."SummaryLocation: Boston, MA, USAType: Full...PlatformFull timeWork at officeLocal areaImmediate startVisa sponsorshipFlexible hours$235.75k - $282.5k
...company, and engineering work at the frontier... ...of applied AI. You will... ...team, building software that helps the... ..., and the platform compounds in value... ...and state management, and the interface... ...– building evals to measure output... ...and observability for the Agentic...PlatformFull timeLocal areaImmediate start$175k - $240k
...foundation for agent engineering in the real world,... ...production-ready AI agents that teams... ...to also offer a platform for building, evaluating... ...LangSmith (Observability, Evaluation, Deployment... ...5 days/week in Boston, MAWe're looking for... ...of experience in software engineering...PlatformWork at officeFlexible hours$185k - $235k
...intersection in tech right now: AI and customer... ...’re looking for an Engineering Manager/Technical Lead to help... ...AGI’s Voice Agent platform.Maven Voice enables enterprise... ...with a team of software engineers building... ...historyEstablish strong observability and debugging...PlatformWork at officeHome office$170k - $230k
...We are currently seeking an Engineering Functional Lead(FL) to join... ...architectures (cloud-native, APIs, SaaS platforms, AI/ML, Generative AI where... ...approach to client management. Across Investor Services and... ...or local law.SummaryLocation: Boston; Jersey CityType: Full timePlatformFull timeLocal area- ...unleashing the power of AI to create value at... ...proprietary assets and platforms, deep process and industry... ..., Supply Chain and Engineering, and Talent, with advanced... ...Engineering, Endpoint Management, Mobile Technologies,... ...or religious observance, please call us toll free...PlatformWork experience placementLive inWork at officeLocal area
$176.6k - $239k
AWS Applied AI Solutions (AAIS) is building toward... ...Technical Account Managers (TAM) support our customers... ...work with appropriate engineers and service teams to see... ...broadly adopted cloud platform. We pioneered cloud computing... ...0 USD annuallyUSA, MA, Boston - 153,600.00 - 207,800....PlatformWork experience placementLocal areaFlexible hours- ...Cloud About the Company Developing software foundation for next-generation accelerated computing platform for large-scale AI infrastructure. Industry Information... ...search of a Head of GPU Cloud to spearhead the engineering team dedicated to the development of a...Platform
$174.6k - $235k
...team makes sure Cisco's cloud platforms have the compute, storage and... ...from sales, product and engineering into confirmed supply with our... ...maintenance windows on track while managing cloud spend responsibly. We'... ...is timing: we're bringing AI-powered forecasting into how...PlatformFull timeTemporary workLocal areaWorldwideFlexible hours$134.5k - $265.1k
...Deloitte is seeking a Lead Managed Services Engineer II to design, automate, and... ...you will apply Google Cloud Platform (GCP), Terraform,... ...intelligence and machine learning (AI/ML) teams to support evolving... ..., alerting, logging, observability, high availability, and disaster...PlatformWork at officeLocal areaVisa sponsorshipNight shift1 day per week- ...live to see what this platform can do. Since we were... ...senior Data Cloud and AI Architect within Accenture... ...delivery teams, and manage technical risk across... ...in Computer Science, Engineering, or equivalent (minimum... ...disability or religious observance, please call us toll...PlatformWork experience placementLive inWork at officeLocal area
$134.5k - $265.1k
...Deloitte is seeking an AI Cloud Security Engineer, Manager to lead the design, implementation... ...(AI)-enabled products, platforms, and cloud environments.... ...AI Zero Trust, secure AI software development, cloud... ...RAG, model integrations, observability, and automated testingLeading...PlatformWork experience placementLocal areaVisa sponsorship- ...seeking an experienced Project Manager to lead a strategic proof-of-... ...standardized AWS-based cloud platform.This role will partner... ...assigned Data, Technology and Engineering (DTE) technical lead to jointly... ...resourcing aligned to research AI strategy Prepare program for...PlatformFlexible hours
$180k - $220k
...hands-on role with an AI-native mindset. There... ...You'll lead through the platform, redesigning how we... ...product and corporate engineering teams build on. You'll... ...audit trails, secrets management, environment separation... ...running. Build the observability layer. Logging, metrics...Platform$134.5k - $265.1k
...advanced analytics, Generative AI, transformative technologies,... ...operators, creatives, designers, engineers, and architects. Our team... ...technology, creativity, and ongoing managed services to solve the biggest... ...on the applicable Salesforce platform best practicesCommunicate...PlatformLocal areaVisa sponsorship$255k
...Workplace Solutions - Boston, United States of... ...leading-edge management consulting along... ...an intelligent, AI-enabled employee... ...closely with Product, Engineering, Operations and... ...collaboration platforms, meeting technologies... ...reliability, observability, performance and...PlatformWork experience placementWork at officeLocal area$140k - $191k
Boston, MAHybridFull Time$150k - $190kJob Description... ...seeking an Agentic AI Engineer (Insurance & Agentic... ...will work across software engineering,... ...with model APIs and managed AI platforms such as Amazon Bedrock... ...building monitoring, observability, and cost management...PlatformFull timeTemporary workFlexible hours$140k - $190k
Boston, MAHybridFull Time$140k - $190k Job Description... ...seeking an Agentic AI Engineer to design, build,... ...strong Python software engineering skills with... ...major model APIs or managed AI platforms such as Amazon Bedrock... ...Implement observability, audit logging, monitoring...PlatformFull timeTemporary workFlexible hours3 days per week$174k - $215k
...the intelligent platform for travel and spend management. Built to... ...in London and Boston. We combine innovation... ...is growing its engineering footprint in... ...looking for a Staff Software Engineer to... ...experience leading observability and reliability... ...looks like.AI-driven development...PlatformSummer workWork at officeImmediate startWorldwideRelocationRelocation package3 days per week$60 - $75 per hour
Boston, MAHybridContract$60/hr - $7... ...Senior Analytics Engineer to help drive... ..., and AI capabilities.... ...of data and AI platforms. You will collaborate... ...with software engineering best... ...and stakeholder management skills Desired... ...monitoring, lineage, observability, and...PlatformFull timeTemporary workFlexible hours$143k - $243k
...for all.Role SummaryLead one to two software engineering teams in the Medication Management zone, with responsibility for both... .... This hybrid role, based in Boston, MA, is an opportunity to shape product... ...performance Champion and apply AI tools and AI-assisted workflows to...Full timeTemporary workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Manager, AI Observability & Evals Platform (Boston). Be the first to apply!
- software engineer - cloud services Boston, MA
- software technical support engineer Boston, MA
- remote software sales Boston, MA
- software sales representative Boston, MA
- software quality assurance Boston, MA
- software qa Boston, MA
- entry level software sales Boston, MA
- software sales Boston, MA
- software sales executive Boston, MA
- government software Boston, MA


