Lead AI Observability & Evaluation Platform Engineer
$230k - $270kLangChain
LangChain is looking for a Principal/Lead Software Engineer to join the LangSmith team in Cambridge, MA. This role involves technical direction across backend and frontend, while setting engineering standards and mentoring fellow engineers. Ideal candidates will have over 10 years of backend or full-stack experience, strong proficiency in Python and Go, along with a proven mentoring track record. Compensation ranges from $230,000 to $270,000, with competitive benefits including medical and a 401(k). #J-18808-Ljbffr LangChain
$230k - $270k
LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience...SuggestedFlexible hours$230k - $270k
...LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to... ...the Role We’re looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive...SuggestedWork at officeFlexible hours$145k - $180k
...the foundation for agent engineering in the real world, helping... ...to production-ready AI agents that teams can rely... ...have grown to also offer a platform for building, evaluating, deploying, and operating... ...platform includes LangSmith (Observability, Evaluation, Deployment,...SuggestedWork at officeFlexible hours$177k - $278.08k
...director level, to identify, evaluate, and advance external... ...opportunities in AI, automation, data, and... ...sciences, and digital platforms to assess... ...emerging capabilities, leading technical diligence, and... ...Science, Bioinformatics, Engineering, Computational Biology...SuggestedMinimum wageTemporary workWork at officeLocal area2 days per week3 days per week- Datadog is seeking an Analyst Relations Principal to lead and scale our global Analyst Relations program. In this role, you will engage with industry analysts across observability and AI, translating technical capabilities into compelling narratives while partnering with...Suggested
$124.74k - $254.5k
...training facility, and leading market tools, we... ...Lead Specialist, AI Solution... ...enterprise data platforms to meet regulatory... ...shape roadmaps, evaluate emerging technologies... ...state management, observability, and interoperable... ...and offshore engineering teams to foster a...Full timeH1bLocal area- ...AI Platform Engineer HED is hiring an AI Platform Engineer to build durable, production-grade... ..., logging and auditability, evaluation, cost controls, and guardrails. This... ...validation at data boundaries. Implement observability across the AI lifecycle (structured logs...Work at officeWork from home
$140k - $180k
...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA /... ...multi-tenant deployment of AI agents. Evaluate new agentic AI, LLM, and... ...Zanzibar-style). Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus...Ongoing contractCasual workFlexible hours$295k - $345k
...for trusted trade. Our AI‑powered product... ...the Senior Director of Platform Engineering, you will own the foundation... ...we ship. You will lead a multidisciplinary... ...error budgets, owns observability, drives toil reduction... ...testing strategies, evaluation and guardrails, and the...Temporary workLocal areaImmediate startRemote workFlexible hours$225k - $325k
Meridian Labs in Boston is seeking a Principal Front-End Engineer to lead the development of interfaces for evaluating large language models. This role requires 10+ years of experience, with a strong foundation in TypeScript and React, alongside technical leadership skills...$145k - $180k
LangChain is seeking a Fullstack Engineer to enhance the LangSmith platform, focusing on AI observability products. You will collaborate with developers, internal stakeholders, and enterprise customers to build new features while ensuring high engineering standards. The...$160k - $220k
...Country United States Job Description Lead Mobile Platform Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-... ...Stand up production‑grade observability (Prometheus, Grafana, centralized... ...new H‑1B petitions. Deliberate AI evaluates candidates based on merit, qualifications...Permanent employmentFull timeWork experience placementH1bRelocationSleeping nightsFlexible hours- ...automating, and maintaining security platforms that support enterprise... ...experience blended with platform engineering capabilities to mature the AI Security platform/tools. What you... ...and enable real-time monitoring for observability. • Partner with incident response...Immediate startRemote workFlexible hours
$129k - $193.5k
...Senior Platform Engineer Recorded Future is seeking a skilled and motivated Senior Platform... ...new approaches, technologies, (including AI related capabilities) to allow your team... ...cloud environments. Experience with observability tools such as Prometheus, ELK and...Full timeWorldwide$180k - $250k
...rapidly developed humanoid platform now running in real... ...Senior Platform Software Engineer at Humanoid, you will... ...fidelity robotic controls and AI development. You will... ...fault‑tolerant system. Lead Cross-Functional... ...multiple domains. Test & Evaluate Systems: Integrate new...Work at office- ...The reliable delivery across engineering. The organization is seeking a Senior Manager of Platform Engineering to lead a mission‑critical team... ...infrastructure, and a growing set of AI‑driven initiatives. This... ...Kubernetes, AWS, CI/CD, observability, and automation. Identify...Work at officeRemote workFlexible hoursNight shift
- ...As a Senior Platform Engineer , you'll be at the heart of our infrastructure - designing, building... ...the core platform that powers our AI-driven security products. You'll collaborate... ...to streamline deployment, CI/CD, observability, and performance optimization. Drive...
- ...Axiomatic AI is building a new class of AI systems... ...stakes scientific and engineering workflows. Our mission... ...Overview As a Senior Platform Engineer at Axiomatic,... ...development. You Will Lead deployment strategies... ...Build comprehensive observability systems: monitoring, metrics...
$200k - $240k
...Job Description: Director, Platform Engineering Location: Boston, MA (Hybrid... ...execution behind technology evaluation, selection, implementation,... ...emerging technologies — including AI — to enhance engineering... ...innovation. If you're energized by leading high-performing teams,...Summer workWork at officeImmediate startWorldwideOverseas$170k - $205k
...the company | Principal Platform Engineer | Boston, MA | ONSITE (hybrid) | $170k–$205k | company... ...the company builds FDA-cleared AI software that analyzes cardiac CT scans... ...platform: AWS, containers, Terraform, CI/CD, observability, and the self-service tooling that lets...- ...TetraScience is the Scientific Data and AI company. We are catalyzing the... ...for this position. The Role As a Lead Platform Engineer, you will play a critical role in evolving... ...infrastructure allocation Enhance observability and monitoring to ensure reliability,...Immediate startRemote workFlexible hours
$200k - $325k
...Job Description We are building an AI Engineering function to enable productivity and... ...and business teams. As a Senior AI Platform Engineer, you will design and own the... ...agentic platforms, developer tooling, and observability. This is a financial services...Work at officeLocal area- ...for architecture and development of a compute platform for HPC workloads. This role emphasizes improving observability and requires expertise in designing large-scale... ...systems, contributing to high-quality solutions and leading design discussions. #J-18808-Ljbffr Quant...
- Title: Storage Platform Engineer Contract Length: 6 Months ASAP Start Day Rate: Inside IR35 Hybrid... ...on making storage platforms reliable, observable, and easier to operate. It includes... ...support operations and system insight. Use AI-based tooling to assist with monitoring...Contract workImmediate start
- Dormont Manufacturing Co is seeking engineers for their Boston office to design and implement runtime primitives for their AI platform. The role requires expertise in distributed... ...with flexibility for remote candidates evaluated on a case-by-case basis. #J-18808-Ljbffr...Work at officeRemote work
- Axiomatic-AI Inc. is seeking a Senior Platform Engineer in Boston to lead the deployment and operational excellence of our AI platform. The role emphasizes infrastructure... ...include deployment strategy, building observability systems, and ensuring compliance with security protocols...
- ...AI Platform Engineer | AI Platform Engineering Full-Time Hybrid Onsite (3 days/week in office)... ...Level Objective definitions, implement observability instrumentation, participate in... ...stable ethical business with industry leading pay and benefits. MassMutual is an equal...Full timeWork at office3 days per week
$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible... ..., similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack of Open Source...Full timePart timeLocal area$110k - $130k
...DevOps Engineer Pickle Robot is on the hunt for a DevOps... ...to help scale the platform that powers our fleet of... ...integration to GCP. ~ Strong observability fundamentals — metrics... ..." ~ Knows how to ask AI the right questions and can critically evaluate the outputs. ~...Work at officeRemote work3 days per week- ...cloud analytics and data platform for AI. By delivering... ...beyond automation — they observe, reason, adapt, and... ...As a member of our AI engineering team, you’ll play a critical... ...to observability and evaluation layers that ensure... ...Engineer to lead innovation in the Agentic...Permanent employmentFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AI Observability & Evaluation Platform Engineer. Be the first to apply!
- ai developer Cambridge, MA
- machine learning ai engineer Cambridge, MA
- ai ml engineer Cambridge, MA
- ai engineer Cambridge, MA
- senior ai engineer Cambridge, MA
- platform developer Cambridge, MA
- senior platform engineer Cambridge, MA
- platform engineer Cambridge, MA
- platform manager Cambridge, MA
- digital platform specialist Cambridge, MA


