Lead AI Observability & Evaluation Platform Engineer
$230k - $270kLangChain
LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience in backend and fullstack engineering, knowledge in Python, Go, TypeScript, and a focus on operational excellence is essential. The role includes a competitive salary range of $230,000 - $270,000, along with benefits such as medical coverage and flexible vacation. #J-18808-Ljbffr LangChain
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead AI Observability & Evaluation Platform Engineer in Boston, MA vacancy
- YO IT Consulting is hiring an AI Evaluation Specialist to work remotely. You'll leverage your expertise to train next-generation AI systems... ...candidate with exceptional reading comprehension and strong observational skills. Responsibilities include identifying inconsistencies...SuggestedRemote job
$230k - $270k
...foundation for agent engineering in the real world,... ...to production-ready AI agents that teams can... ...grown to also offer a platform for building, evaluating, deploying, and... ...includes LangSmith (Observability, Evaluation, Deployment... ...looking for a Principal/Lead level Software...SuggestedWork at officeFlexible hoursLangChain, Inc
Boston, MA4 days ago$175k - $225k
...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA,... ...backend systems that power LangChain's observability and evals platform. You will work on the core services... ...allow developers to monitor and evaluate their AI applications at scale. While the focus...SuggestedWork at officeFlexible hoursLangChain
Boston, MA4 days ago$175k - $240k
...Frontend Engineer At LangChain, our mission is to make intelligent... ...to production-ready AI agents that teams can rely... ...grown to also offer a platform for building, evaluating, deploying, and operating... ...platform includes LangSmith (Observability, Evaluation, Deployment, Fleet...SuggestedWork at officeFlexible hoursLangChain
Cambridge, MA3 days ago$146.2k - $261.4k
...Research Lead - AI Cyber Testing & Evaluation RAND's Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER)... ...leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate...SuggestedWork experience placementRemote workWork from homeEmployment Opportunities Inc
Boston, MA4 days ago$145.6k - $209.3k
...workforce operating platform. Helping people... ...Platform Software Engineer in Enterprise Solutions... ...(ESE) org to lead the architecture and... .... Implement observability, monitoring, and logging... ...and people-first AI, our ability to... ...opportunity employer. We evaluate qualified...Local areaUKG
Boston, MA4 days ago- ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA /... ...multi-tenant deployment of AI agents. Evaluate new agentic AI, LLM, and... ...Zanzibar-style). Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus...Casual workFlexible hours
SS&C Technologies Holdings
Boston, MA4 days ago $153k - $186.3k
...Data Platform Engineering Portfolio Boston Consulting Group... ...delivers solutions through leading-edge management... ...into a data-driven, AI-enabled enterprise. Our... ...principles including observability, performance, and incident... ...Improvement Evaluate new technologies and...Work at officeLocal areaBoston Consulting Group
Boston, MA3 days ago$186.07k - $225k
...emerging onchain platform — and with it, the... ...Learning Platform Engineer to join our Machine... ...Build tooling to observe the quality of data... ...systems. ~ You lead by example through... ...responsibly use generative AI tools and copilots... ...you to carefully evaluate how your skills...Local areaCoinbase
Boston, MA1 day ago$145k - $180k
...Fullstack Engineer We're looking for a Fullstack Engineer to work on LangSmith, our commercial AI observability and evals platform product. In this role, you'll have the opportunity to build new features and functionality for the platform while working close enterprise...Work at officeFlexible hoursLangChain
Cambridge, MA3 days ago$140k - $180k
...OVERVIEW KKR is a leading global investment firm that... ...The ADAPT (AI, Data, and Platform Technologies) Engineering team is integral to KKR'... ...-latency, reliable, and observable data flows. ~ Extend... ...across the team. ~ Evaluate emerging technologies and...Local areaKKR
Boston, MA3 days ago$160k - $220k
...Lead Mobile Platform Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're... ...interfaces Stand up production-grade observability (Prometheus, Grafana, centralized... ...H-1B petitions. Deliberate AI evaluates candidates based on merit,...Permanent employmentFull timeH1bRelocationSleeping nightsFlexible hoursDeliberate AI
Boston, MA4 days ago$174.8k - $236.6k
...procurement. As Principal Platform Data Engineer, SAP, you will own... ...by analytics, AI/ML, and Snowflake Cortex... ...enterprise SAP data SME - leading architecture reviews,... ...strategy, evaluating emerging capabilities... ...Experience with data observability platforms (Monte Carlo...Full timeTemporary workLocal areaFlexible hours2 days per weekAlnylam
Cambridge, MA2 days ago$225k - $325k
Meridian Labs in Boston is seeking a Principal Front-End Engineer to lead the development of interfaces for evaluating large language models. This role requires 10+ years of experience, with a strong foundation in TypeScript and React, alongside technical leadership skills...- ...Description Job Description Senior Platform/Infrastructure Engineer Location: Fully remote (HQ... ...platforms that power a real-time learning AI at a seed-stage startup. The role... ...growing customer demand. Refine observability: logs, traces, metrics, dashboards,...Remote work
ICONSTAFF
Cambridge, MA4 days ago - ...automating, and maintaining security platforms that support enterprise... ...experience blended with platform engineering capabilities to mature the AI Security platform/tools. What you... ...and enable real-time monitoring for observability. • Partner with incident response...Immediate startRemote workFlexible hours
Ford Motor Company
Boston, MA4 days ago - ...The reliable delivery across engineering.The organization is seeking a Senior Manager of Platform Engineering to lead a mission-critical team... ...infrastructure, and a growing set of AI-driven initiatives. This... ...Kubernetes, AWS, CI/CD, observability, and automation.Identify...Work at officeRemote workFlexible hoursNight shift
Huxley
Boston, MA2 days ago - ...TetraScience is the Scientific Data and AI company. We are catalyzing the... ...sponsorship for this position.The RoleAs a Lead Platform Engineer, you will play a critical role in evolving... ...infrastructure allocationEnhance observability and monitoring to ensure reliability,...Immediate startRemote work
TetraScience
Boston, MA2 days ago - ...Engineering Manager: Guidewire PolicyCenter Platform We deliver our customers peace of... ...0 company, we are leading a digital disruption... .... Coaches and evaluates performance and quality... ...CI/CD pipelines, observability, secure-by-default... .... Supports AI-native workflows on...Work at officeShift work
Liberty Mutual Insurance Group
Boston, MA4 days ago - ...Responsibilities Lead technical delivery... ...decomposition, and day-to-day engineering decisions. Own... ...build, and deploy AI agents that... ..., monitoring, and evaluation to ensure agent... ...Collaborate with platform and DevOps partners... ...to improve CI/CD, observability, and deployment practices...
$200k - $325k
...Job Description We are building an AI Engineering function to enable productivity and... ...and business teams. As a Senior AI Platform Engineer, you will design and own the... ...agentic platforms, developer tooling, and observability. This is a financial services...Work at officeLocal areaArrowstreet Capital
Boston, MA2 days ago$314.8k - $359.3k
...Sr. Distinguished AI Engineer (Agentic AI Platform) Overview: At Capital One, we... ...teams to deliver our industry leading capabilities with... ...agentic workflows : you will evaluate agentic frameworks such LangGraph... ...engineers spin up secure, observable agentic workflows in under...Full timePart timeWork at officeLocal areaCapital One
Cambridge, MA1 day ago$180k - $250k
...rapidly developed humanoid platform now running in real... ...Senior Platform Software Engineer at Humanoid, you will... ...fidelity robotic controls and AI development. You will... ...‑tolerant system. Lead Cross-Functional... ...multiple domains. Test & Evaluate Systems: Integrate new...Work at office$165k - $185k
This is a Senior Platform Engineer role focused on designing, building, and operating scalable,... ...Python Support integration of modern AI/ML capabilities What You Need… Strong... ...Solid Python skills Experience with observability/monitoring tools Strong experience working...$121.5k - $145.5k
...seasoned Sr. Software Engineer in the North America Mobility... ...role will sit in the Platform team that focuses on building AI Platform to support... ...systems designs, lead design decisions, and... ...efficiency. Implement evaluation frameworks, observability, and guardrails to ensure...Remote workFlexible hoursWEX
Boston, MA2 days ago$92.5k - $139k
Platform Engineer (ci/cd & Kubernetes Focus) Own and optimize the CI/CD platform and Kubernetes... ...new approaches, technologies, (including AI related capabilities) to allow your... ...in cloud environments. Experience with observability tools such as Prometheus, ELK and Grafana...Full timeWork at office3 days per week- As a Senior Platform Engineer , you’ll be at the heart of our infrastructure - designing, building... ...the core platform that powers our AI-driven security products. You’ll collaborate... ...to streamline deployment, CI/CD, observability, and performance optimization. Drive initiatives...
$99.6k - $223.4k
...generation of cloud-native EHR platforms that directly improve... ...re looking for senior engineers with deep Java... ...infrastructure, and applied AI to deliver intelligent... ...AIOps capabilities Lead system design for... ..., reliability, and observability Stay hands-on with...Full timeTemporary workRemote workFlexible hoursOracle
Boston, MA1 day ago$123k - $163.5k
Motional AD Inc. is looking for a Software Engineer/DevOps to design and maintain the cloud infrastructure for an autonomous vehicle... ...and Python. Join a collaborative environment focused on observability, performance, and security improvements. Salary ranges from $...Remote job$229.9k - $262.4k
...Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems... ...inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack of Open...Full timePart timeLocal areaCapital One
Cambridge, MA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Observability & Evaluation Platform Engineer. Be the first to apply!
Related searches