Lead Software Engineer, AI Observability and Evaluations

$230k - $270k

LangChain

Langchain is seeking a Principal/Lead Software Engineer in Boston to drive technical direction and build across the full stack. Candidates should have 10+ years of experience in backend or fullstack engineering, strong programming skills in Python and Go, and experience mentoring engineers. The salary range is $230,000 - $270,000, along with various benefits including medical, dental, and flexible vacation. #J-18808-Ljbffr

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Lead Software Engineer, AI Observability and Evaluations in Boston, MA vacancy

Lead Software Engineer
$175k - $200k
...Test Kitchen is looking for a Lead Software Engineer to join our Retention Zone... ...the charge on bringing AI into our subscription products... ...AI engineering practices - evaluation frameworks, prompt... ...management, fine-tuning approaches, observability, and responsible AI...
Suggested
Full time
America's Test Kitchen
Boston, MA
5 days ago
Senior Lead AI Software Engineer
...Senior Lead AI Software Engineer At Klaviyo, we value the unique backgrounds, experiences and... ...agentic workflows, RAG pipelines, and evaluation harnesses — as a core part of your day... ..., incident response, security, observability, and cost, and continuously evolve them...
Suggested
Immediate start
Venturefizz Product Management Community
Boston, MA
2 days ago
Lead AI/ML Software Engineer
$180k - $230k
...agencies with cutting-edge AI/ML and data solutions... ...operators and engineers to rapidly build, deploy... ...for an experienced Lead AI/ML Software Engineer to help shape... ...[R]AIMS platform, evaluating tradeoffs across performance... ...fault tolerance, and observability ~ Strong hands-on...
Suggested
Live in
Remote work
Raft
Boston, MA
5 days ago
Lead Software Engineer / DevOps
...Lead Software Engineer / DevOps This client is looking for a Lead Software/DevOps Engineer to join... ...knowledge and hands-on experience with AI development tools, including GitHub Copilot... ...(Java & Python) ~10% Monitoring and Observing Daily Responsibilities ~70%...
Suggested
Full time
Contract work
Temporary work
Flexible hours
Motion Recruitment
Boston, MA
1 day ago
Lead Software Engineer
$118.98k - $195.47k
...As a Lead Software Engineer, you will develop and execute the key technology components of the Enterprise... ...patterns, platform engineering, and observability Ensure compliance with security,... ...use artificial intelligence tools ("AI Tools) to automate the sorting and...
Suggested
Full time
Visa sponsorship
Work visa
Flexible hours
3 days per week
Guardian Life
Boston, MA
3 days ago
Tech Lead — ASR / TTS / Speech LLM (IC + Mentor)
...technology company building an AI-enabled nursing... ...partners with leading health systems and virtual... ...‑tuning → deployment Evaluate and benchmark open‑source... ...strategies Mentor engineers on data curation, fine... ...production readiness, observability, and health metrics Desired...
Remote work
OutcomesAI
Boston, MA
3 days ago
Lead Software Engineer - Wealth R&D, VP
$110k - $188.75k
...experiences. You will work with engineers and use cases across the full... ...prototyping and solution evaluation, and ensures the proposed technical... ...with a firm understanding of software development and a keen... ...of application engineering, AI-enabled capabilities, and human...
Temporary work
Flexible hours
State Street Corporation
Boston, MA
4 days ago
Senior Lead Software Engineer - Developer Infrastructure Boston, MA
$216k - $324k
...Senior Lead Software Engineer - Developer Infrastructure At Klaviyo, we value the unique backgrounds... ..., Quality Tools & Testing and AI Enablement to ensure a cohesive infrastructure... ...technologies and industry trends, evaluating new tools and practices to identify how...
Klaviyo
Boston, MA
5 days ago
Tech Lead/Manager, Software Engineering
$101.9k - $163k
...that help learners achieve their goals and lead a choice-filled life. Our culture... ...please see What you'll do here: As the Software Engineering Manager, you will lead a team dedicated... ...will define and implement an innovative, AI-first roadmap ensuring content quality and...
Work experience placement
Local area
Remote work
Worldwide
Cengage Group
Boston, MA
2 days ago
Sr. Lead AI Engineer
$216k - $324k
...destiny. Job Title: Sr. Lead AI Engineer Location: Boston, MA... ..., we believe the future of software isn't just better productivity... ...AI models (LLMs, tools, evaluators, retrieval systems), with clear contracts, SLOs, and observability so other teams can depend on...
Local area
Klaviyo
Boston, MA
3 days ago
Lead People Systems Engineer
$140k - $210k
...Klaviyo is building an AI-first company—and that starts... .... We're looking for a Lead People Technology Engineer to be the first dedicated... ...Prompt engineering and evaluation LLM system design and orchestration... ..., testing, security, and observability of AI systems Enable AI...
Shift work
Klaviyo
Boston, MA
20 days ago
Lead Machine Learning Engineer
$197.3k - $225.1k
...Lead Machine Learning Engineer At Capital One, we are changing banking... ...and reliable AI-powered systems. Our... ...deploy, and support AI software components utilizing... ...models, including model evaluation and experimentation,... ..., governance, observability and agentic AI. Fine...
Full time
Part time
Internship
H1b
Local area
Flexible hours
Capital One Financial Corp
Cambridge, MA
2 days ago
Technical Lead - Software Developer, Data Foundry
$151.5k - $244.2k
...within DTP that enables AI‑native drug discovery... ...and scientific software), Methods4Insight (analytical... .... Implement model observability: drift detection, performance... ..., Biology, Biomedical Engineering, or related STEM field... ...’s Initiative for Leading at Lilly (WILL), enAble...
Full time
Flexible hours
Eli Lilly
Boston, MA
20 hours ago
Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview... ...test, deploy, and support AI software components including... ...similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack...
Full time
Part time
Local area
Capital One Financial Corp
Cambridge, MA
4 days ago
Lead AI Engineer (AI Foundations)
$197.3k - $225.1k
...Lead AI Engineer (AI Foundations) Overview At Capital One, we are creating responsible... ...test, deploy, and support AI software components including... ...similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack...
Full time
Part time
Local area
Capital One National Association
Cambridge, MA
4 days ago
Tech Lead, Data & Inference Engineer
...Tech Lead, Data & Inference Engineer Massachusetts, Massachusetts, United States... ...specialized vertical in Applied AI, Machine Learning, and... ...control, caching and evaluation loops. Work across teams... ...experience with IaC, CI/CD, and observability. ~ Exposure to...
Full time
Catalyst Labs, LLC
Boston, MA
1 day ago
Lead AI Engineer
$150k - $180k
...focused on accelerating AI adoption and usage, the AI Engineer will design and deploy AI... ..., and response evaluation techniques Workflow &... ...Cloud Orchestration & Observability Implement serverless... ...Requirements ~5+ years of software or ML engineering experience...
Work at office
Remote work
Relocation
2 days per week
Dynatrace
Boston, MA
7 days ago
eServices Software Development Manager
$151k - $198k
...Development and will lead the design,... ...mentoring high-performing engineering teams. This role... ...cutting-edge software solutions. Responsibilities... ...in code quality, observability, CI/CD automation,... .... Monitor and evaluate project progress... ...deploy and manage AI models at scale....
Temporary work
Plymouth Rock Assurance
Boston, MA
3 days ago
Software Development Manager
$110.1k - $264.1k
...looking for a hands-on engineering manager to lead the Authorization... ...The work spans policy evaluation, role- and attribute... ...secure, reliable, observable, and easy for application... ...high-quality software on predictable schedules... ...care. And with AI embedded across our...
Temporary work
Flexible hours
Oracle
Boston, MA
4 days ago
Senior Lead Network Engineer II
...Description Senior Lead Network Engineer II Employment Type... ...team focused on the evaluation, enhancement, and maintenance... ...related hardware & software. The project's... ...- Paid Time Off and Observance of State/Federal Holidays... ...intelligence (AI) tools to support parts...
Full time
Local area
Monday to Friday
Flexible hours
Contact Government Services, LLC
Boston, MA
14 days ago
Lead, AI Engineering
$203.5k
...personally. About Bain AI, Insights & Solutions... ...design, architecture and engineering, and client... ...needed, including building evaluation approaches, working with... ...Build evaluation and observability for GenAI and agentic... ...technical stakeholders; lead working sessions, present...
Full time
Temporary work
Apprenticeship
Work at office
Local area
Work from home
Home office
3 days per week
Bain & Company
Boston, MA
3 days ago
Lead Research Software Engineer, Portable AI Performance Engineering
$102.35k
...Lead Research Software Engineer, Portable AI Performance Engineering Job Number: 25560 Functional Area: Information Technology Department: MA Green... ...groups and leading computer industry collaborators to evaluate, adapt, and enhance the portable performance of...
Full time
Temporary work
Work experience placement
Remote work
Visa sponsorship
Massachusetts Institute of Technology
Cambridge, MA
1 day ago
Senior Lead Software Engineer, Back End (Finance Tech)
$229.9k - $262.4k
Senior Lead Software Engineer, Back End (Finance Tech) Do you love building and pioneering in the technology... ...from time to time, be asked to code or evaluate code Collaborate with digital product... ...Experience leveraging interactive AI tooling to accelerate productivity, utilizing...
Full time
Part time
Internship
Local area
Capital One
Cambridge, MA
18 hours ago
Lead Mobile Platform Engineer
$160k - $220k
...Lead Mobile Platform Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About... ...understand that in clinical software, reliability isn't a... ...up production-grade observability (Prometheus, Grafana, centralized... .... Deliberate AI evaluates candidates based on...
Permanent employment
Full time
H1b
Relocation
Sleeping nights
Flexible hours
Deliberate AI
Boston, MA
2 days ago
Technical Lead Supply Chain Management and Resilience
$78.9k - $123.3k
...Noblis is looking to hire a Technical Lead for Supply Chain Management and... ...risk management methodologies, evaluate legacy technology compatibility with AI-enabled capabilities, and evaluate... ...Supply Chain Management, Industrial Engineering, Business Analytics, Operations Research...
Full time
Contract work
Part time
Local area
Remote work
Noblis
Boston, MA
5 days ago
Technical Lead (ML Operations)
$150k - $215k
...We are seeking a senior engineer to operate as a Technical Lead on the WHOOP MLOps team.... ...closely with Data Science, AI, and Engineering teams to... ...practices for architecture, observability, and operational... ...Degree in Computer Science, Software Engineering, or a related...
Full time
Work at office
Relocation
WHOOP
Boston, MA
5 days ago
Technical Lead, Data Solutions
...Job Description Job Description Lead Engineer, Enterprise Data Exchange & Agentic Analytics... ...Our client is building foundational AI, data, and platform capabilities that enable... ...and enterprise-scale execution Evaluate emerging technologies across analytics,...
NxT Level
Boston, MA
10 days ago
Lead Director, Software Development Engineering
$144.2k - $288.4k
...community at a time. Our Analytics Engineering team within the Data &... ...organization is seeking a Lead Director, Software Development Engineering. We... ...direct, support, and evaluate data, software, and ML engineers... ...data, data science, and AI/ML can drive clinical and healthcare...
Hourly pay
Full time
Temporary work
Work experience placement
Local area
Hispanic Alliance for Career Enhancement
Wellesley, MA
4 days ago
Lead Technical Engagement Leader
$87k - $178.1k
...will mitigate solution risks and issues and lead client meetings and events. You will... ...client requirements. ~ Proven ability to evaluate client readiness, gather requirements, and... ...innovations to life-saving care. And with AI embedded across our products and services,...
Contract work
Temporary work
Local area
Flexible hours
Oracle Defunct
Boston, MA
2 days ago
Tech Lead
...fixing that. We’re building the AI operating system for federal... ...; we ship secure, reliable software that moves real programs... ...Role I’m hiring a Software Engineering Lead to help me (the CTO) improve... ...performance, stability, and observability. Raise the team’s ceiling: Mentor...
Full time
Relocation
Relocation package
Pryzm
Boston, MA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Software Engineer, AI Observability and Evaluations. Be the first to apply!