Lead AI Observability & Evaluation Platform Engineer

$230k - $270k

LangChain

LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience in backend and fullstack engineering, knowledge in Python, Go, TypeScript, and a focus on operational excellence is essential. The role includes a competitive salary range of $230,000 - $270,000, along with benefits such as medical coverage and flexible vacation. #J-18808-Ljbffr

Apply

Vacancy posted 12 hours ago

Similar jobs that could be interesting for youBased on the Lead AI Observability & Evaluation Platform Engineer in Boston, MA vacancy

AI Evaluation Expert — Remote Quality & Insight Lead
YO IT Consulting is hiring an AI Evaluation Specialist to work remotely. You'll leverage your expertise to train next-generation AI systems... ...candidate with exceptional reading comprehension and strong observational skills. Responsibilities include identifying inconsistencies...
Suggested
Remote job
YO IT Consulting
Boston, MA
3 days ago
Principal Software Engineer, AI Observability & Evals Platform
$230k - $270k
...foundation for agent engineering in the real world,... ...to production-ready AI agents that teams can... ...grown to also offer a platform for building, evaluating, deploying, and... ...s core platform for observability, evaluation, and production... ...for a Principal/Lead level Software Engineer...
Suggested
Work at office
Flexible hours
LangChain
Boston, MA
12 hours ago
FullStack Engineer, AI Observability & Evals Platform (LangSmith)
$145k - $180k
...the foundation for agent engineering in the real world, helping... ...to production-ready AI agents that teams can rely... ...have grown to also offer a platform for building, evaluating, deploying, and operating... ...platform includes LangSmith (Observability, Evaluation, Deployment,...
Suggested
Work at office
Flexible hours
LangChain
Cambridge, MA
1 day ago
Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)
$175k - $225k
...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA,... ...backend systems that power LangChain's observability and evals platform. You will work on the core services... ...allow developers to monitor and evaluate their AI applications at scale. While the focus...
Suggested
Work at office
Flexible hours
LangChain
Cambridge, MA
2 days ago
Research Lead - AI Cyber Testing & Evaluation
$146.2k - $261.4k
...Position Description RAND's Center on AI, Security, and Technology (CAST),... ...and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the...
Suggested
Fixed term contract
Work experience placement
Remote work
Work from home
RAND
Boston, MA
2 days ago
Principal Front-End Engineer: Lead UI for AI Evaluation
$225k - $325k
...Meridian Labs in Boston is seeking a Principal Front-End Engineer to lead the development of interfaces for evaluating large language models. This role requires 10+ years of experience, with a strong foundation in TypeScript and React, alongside technical leadership skills...
Meridian Labs
Boston, MA
12 hours ago
Senior AI Platform Engineer
...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA /... ...multi-tenant deployment of AI agents. Evaluate new agentic AI, LLM, and... ...Zanzibar-style). Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus...
Ongoing contract
Casual work
Flexible hours
SS&C Technologies Holdings
Boston, MA
3 days ago
AI Observability Engineer for Evals Platform
$145k - $180k
...LangChain is seeking a Fullstack Engineer to enhance the LangSmith platform, focusing on AI observability products. You will collaborate with developers, internal stakeholders, and enterprise customers to build new features while ensuring high engineering standards. The...
LangChain
Cambridge, MA
13 hours ago
Principal Database Platform Engineer
$153k - $186.3k
...delivers solutions through leading-edge management... ...Do Join our Data Platform Engineering Portfolio, a global platform... ...into a data-driven, AI-enabled enterprise.... ...principles including observability, performance, and... ...Continuous Improvement Evaluate new technologies and...
Work at office
Local area
Boston Consulting Group
Boston, MA
3 days ago
Senior Fullstack Engineer, AI Observability & Evals Platform
$175k - $240k
...Senior Fullstack Engineer In person 5 days/week in San Francisco... ...product LangSmith, an observability and evals platform. In this role, you'll have... ...What You Will Do Lead the technical architecture... ...~ Bonus: Experience with AI/LLM-powered applications, developer...
Work at office
Flexible hours
LangChain
Cambridge, MA
2 days ago
Lead Mobile Platform Engineer
$160k - $220k
...Country United States Job Description Lead Mobile Platform Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-... ...Stand up production‑grade observability (Prometheus, Grafana, centralized... ...new H‑1B petitions. Deliberate AI evaluates candidates based on merit, qualifications...
Permanent employment
Full time
Work experience placement
H1b
Relocation
Sleeping nights
Flexible hours
Deliberate Solutions, Inc.
Boston, MA
13 hours ago
DevOps/Observability Engineer
...Quantiphi is an award-winning, AI-First global digital engineering company that helps the world’s leading Fortune 1000 organizations... ...other leading technology platforms, and our work has been recognized... ...LinkedIn PageRole: DevOps/Observability EngineerExperience Level: 8+...
Remote work
Worldwide
Quantiphi
Boston, MA
2 days ago
Principal Platform Data Engineer, SAP
$174.8k - $236.6k
...procurement. As Principal Platform Data Engineer, SAP, you will own... ...by analytics, AI/ML, and Snowflake Cortex... ...enterprise SAP data SME - leading architecture reviews,... ...strategy, evaluating emerging capabilities... ...Experience with data observability platforms (Monte Carlo...
Full time
Temporary work
Local area
Flexible hours
2 days per week
Alnylam
Cambridge, MA
1 day ago
Senior Full-Stack Engineer AI Agents & Cloud Lead
...Responsibilities Lead technical delivery... ...decomposition, and day-to-day engineering decisions. Own end... ...build, and deploy AI agents that... ..., monitoring, and evaluation to ensure agent... ...Collaborate with platform and DevOps partners... ...to improve CI/CD, observability, and deployment...
Aperio Talent Solutions
Boston, MA
1 day ago
Senior Software Engineer, Conversational Platform
$75 - $80 per hour
...Senior Software Engineer, Conversational Platform Location: United... ...and conversational AI, focused on delivering... ...What You'll Do Lead technical... ...issues Define observability, operational readiness... ...Experience with testing or evaluation approaches for LLM-enabled...
Hourly pay
Contract work
Temporary work
Remote work
Skill Corp
Boston, MA
3 days ago
Platform Engineer (ci/cd & Kubernetes Focus) Software
$92.5k - $139k
...Platform Engineer (ci/cd & Kubernetes Focus) Own and optimize the CI/CD platform and Kubernetes... ...new approaches, technologies, (including AI related capabilities) to allow your... ...in cloud environments. Experience with observability tools such as Prometheus, ELK and Grafana...
Full time
Work at office
3 days per week
jobs.frontdoordefense.com - Jobboard
Boston, MA
13 hours ago
Senior Platform Engineer
$165k - $185k
...This is a Senior Platform Engineer role focused on designing, building, and operating scalable,... ...in Python Support integration of modern AI/ML capabilities What You Need… Strong AWS... ...Solid Python skills Experience with observability/monitoring tools Strong experience working...
Huxley
Boston, MA
13 hours ago
Senior Cybersecurity Platform Engineer
...automating, and maintaining security platforms that support enterprise... ...experience blended with platform engineering capabilities to mature the AI Security platform/tools. What you... ...and enable real-time monitoring for observability. • Partner with incident response...
Immediate start
Remote work
Flexible hours
Ford Motor Company
Boston, MA
5 days ago
Cloud HPC Platform Engineer: Observability & Pipelines
...for architecture and development of a compute platform for HPC workloads. This role emphasizes improving observability and requires expertise in designing large-scale... ...distributed systems, contributing to high-quality solutions and leading design discussions. #J-18808-Ljbffr...
Quant Blueprint LLC
Boston, MA
12 hours ago
Senior Platform Engineer
...As a Senior Platform Engineer , you’ll be at the heart of our infrastructure - designing, building... ...the core platform that powers our AI-driven security products. You’ll collaborate... ...to streamline deployment, CI/CD, observability, and performance optimization. Drive initiatives...
Seven AI
Boston, MA
12 hours ago
Senior Platform Software Engineer
$180k - $250k
...rapidly developed humanoid platform now running in real... ...Senior Platform Software Engineer at Humanoid, you will... ...fidelity robotic controls and AI development. You will... ...fault‑tolerant system. Lead Cross-Functional... ...multiple domains. Test & Evaluate Systems: Integrate new...
Work at office
Thehumanoid
Boston, MA
1 day ago
Senior Software Engineer, Platform
$182k - $222k
...Management (CTEM). The HackerOne Platform unites agentic AI solutions with the... ...accountability. Senior Software Engineer, Platform Location:... ..., RAG services, and observability systems. Operate with... ...Agility . Use metrics, evaluation data, and telemetry to...
Apprenticeship
Work at office
Local area
Remote work
Flexible hours
Shift work
1 day per week
HackerOne
Boston, MA
3 days ago
Senior Platform Engineer
...Description Job Description Senior Platform/Infrastructure Engineer Location: Fully remote (HQ... ...platforms that power a real-time learning AI at a seed-stage startup. The role... ...growing customer demand. Refine observability: logs, traces, metrics, dashboards,...
Remote work
ICONSTAFF
Cambridge, MA
29 days ago
Platform Engineering Manager
...The reliable delivery across engineering.The organization is seeking a Senior Manager of Platform Engineering to lead a mission-critical team... ...infrastructure, and a growing set of AI-driven initiatives. This... ...Kubernetes, AWS, CI/CD, observability, and automation.Identify...
Work at office
Remote work
Flexible hours
Night shift
Huxley
Boston, MA
1 day ago
Engineering Manager, AI Platforms
$201k - $282k
...through our Seamless Platform, we connect design... ...access to market leading medical and... ...Summary Suffolk’s AI Studio is seeking a hands‑on Engineering Manager to lead the... ...fallback strategies, and evaluation frameworks Review... ...Drive adoption of observability and monitoring...
Temporary work
For contractors
Work at office
Suffolk
Boston, MA
1 day ago
Director of Platform Engineering
$200k - $240k
...Job Description: Director, Platform Engineering Location: Boston, MA (Hybrid... ...execution behind technology evaluation, selection, implementation,... ...technologies - including AI - to enhance engineering workflows... .... If you're energized by leading high-performing teams,...
Summer work
Work at office
Immediate start
Worldwide
Overseas
Grand Circle
Boston, MA
2 days ago
Senior Platform Engineer
$175k - $275k
...Description Job Description Senior Platform Engineer Title: Senior or Staff Platform Engineer... ...GPU infrastructure that powers modern AI. Our team designs and operates large-... ...large-scale AI infrastructure reliable, observable, and secure. If you thrive at the...
Ongoing contract
Local area
Remote work
Cybercoders
Boston, MA
2 days ago
Lead Platform Engineer
...TetraScience is the Scientific Data and AI company. We are catalyzing the... ...sponsorship for this position. The Role As a Lead Platform Engineer, you will play a critical role in... ...demand infrastructure allocation Enhance observability and monitoring to ensure reliability,...
Immediate start
Remote work
Flexible hours
TetraScience
Boston, MA
11 days ago
Staff / Senior Software Engineer, Platform Teams
...creative entertainment platform, where the entire... ...and the leader in AI music. We are backed by leading investors including... ...Senior Software Engineers to work on one of the... ...practices, frameworks, and evaluation systems for how... ..., and easy to observe Build and operate distributed...
Full time
Work at office
Local area
SUNO
Boston, MA
13 hours ago
Manager, Engineering - (Guidewire PolicyCenter Platform)
...Engineering Manager: Guidewire PolicyCenter Platform We deliver our customers peace of... ...0 company, we are leading a digital disruption... .... Coaches and evaluates performance and quality... ...CI/CD pipelines, observability, secure-by-default... .... Supports AI-native workflows on...
Work at office
Shift work
Liberty Mutual Insurance Group
Boston, MA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Observability & Evaluation Platform Engineer. Be the first to apply!