Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AI Observability & Evaluation Platform Engineer

$230k - $270k

LangChain

LangChain is looking for a Principal/Lead Software Engineer to join the LangSmith team in Cambridge, MA. This role involves technical direction across backend and frontend, while setting engineering standards and mentoring fellow engineers. Ideal candidates will have over 10 years of backend or full-stack experience, strong proficiency in Python and Go, along with a proven mentoring track record. Compensation ranges from $230,000 to $270,000, with competitive benefits including medical and a 401(k). #J-18808-Ljbffr LangChain

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead AI Observability & Evaluation Platform Engineer in Cambridge, MA vacancy
  • $230k - $270k

    LangChain is seeking a Principal/Lead Software Engineer based in Boston to drive the technical direction of their core platform. You will lead architectural decisions, mentor engineers, and ensure system reliability across their full stack. With 10+ years of experience... 
    Suggested
    Flexible hours

    LangChain

    Boston, MA
    5 days ago
  • $230k - $270k

     ...LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to...  ...the Role We’re looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive... 
    Suggested
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    5 days ago
  • $145k - $180k

     ...the foundation for agent engineering in the real world, helping...  ...to production-ready AI agents that teams can rely...  ...have grown to also offer a platform for building, evaluating, deploying, and operating...  ...platform includes LangSmith (Observability, Evaluation, Deployment,... 
    Suggested
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    5 days ago
  • $177k - $278.08k

     ...director level, to identify, evaluate, and advance external...  ...opportunities in AI, automation, data, and...  ...sciences, and digital platforms to assess...  ...emerging capabilities, leading technical diligence, and...  ...Science, Bioinformatics, Engineering, Computational Biology... 
    Suggested
    Minimum wage
    Temporary work
    Work at office
    Local area
    2 days per week
    3 days per week

    Initial Therapeutics, Inc.

    Cambridge, MA
    3 days ago
  • Datadog is seeking an Analyst Relations Principal to lead and scale our global Analyst Relations program. In this role, you will engage with industry analysts across observability and AI, translating technical capabilities into compelling narratives while partnering with... 
    Suggested

    Datadog

    Boston, MA
    1 day ago
  • $124.74k - $254.5k

     ...training facility, and leading market tools, we...  ...Lead Specialist, AI Solution...  ...enterprise data platforms to meet regulatory...  ...shape roadmaps, evaluate emerging technologies...  ...state management, observability, and interoperable...  ...and offshore engineering teams to foster a... 
    Full time
    H1b
    Local area

    KPMG

    Boston, MA
    4 days ago
  •  ...Senior AI Platform Engineer Locations: San Francisco, CA / Jacksonville, FL / Boston, MA /...  ...multi-tenant deployment of AI agents. Evaluate new agentic AI, LLM, and...  ...Zanzibar-style). Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus... 
    Ongoing contract
    Casual work
    Flexible hours

    Blue Prism Group

    Boston, MA
    4 days ago
  •  ...AI Platform Engineer HED is hiring an AI Platform Engineer to build durable, production-grade...  ..., logging and auditability, evaluation, cost controls, and guardrails. This...  ...validation at data boundaries. Implement observability across the AI lifecycle (structured logs... 
    Work at office
    Work from home

    HED

    Boston, MA
    3 days ago
  • $295k - $345k

     ...for trusted trade. Our AI‑powered product...  ...the Senior Director of Platform Engineering, you will own the foundation...  ...we ship. You will lead a multidisciplinary...  ...error budgets, owns observability, drives toil reduction...  ...testing strategies, evaluation and guardrails, and the... 
    Temporary work
    Local area
    Immediate start
    Remote work
    Flexible hours

    53 Stations

    Boston, MA
    2 days ago
  • $225k - $325k

    Meridian Labs in Boston is seeking a Principal Front-End Engineer to lead the development of interfaces for evaluating large language models. This role requires 10+ years of experience, with a strong foundation in TypeScript and React, alongside technical leadership skills... 

    Meridian Labs

    Boston, MA
    5 days ago
  • $145k - $180k

    LangChain is seeking a Fullstack Engineer to enhance the LangSmith platform, focusing on AI observability products. You will collaborate with developers, internal stakeholders, and enterprise customers to build new features while ensuring high engineering standards. The... 

    LangChain

    Cambridge, MA
    5 days ago
  • $160k - $220k

     ...Country United States Job Description Lead Mobile Platform Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-...  ...Stand up production‑grade observability (Prometheus, Grafana, centralized...  ...new H‑1B petitions. Deliberate AI evaluates candidates based on merit, qualifications... 
    Permanent employment
    Full time
    Work experience placement
    H1b
    Relocation
    Sleeping nights
    Flexible hours

    Deliberate Solutions, Inc.

    Boston, MA
    5 days ago
  •  ...automating, and maintaining security platforms that support enterprise...  ...experience blended with platform engineering capabilities to mature the AI Security platform/tools. What you...  ...and enable real-time monitoring for observability. • Partner with incident response... 
    Immediate start
    Remote work
    Flexible hours

    Ford Motor Company

    Boston, MA
    3 days ago
  • $129k - $193.5k

     ...Senior Platform Engineer Recorded Future is seeking a skilled and motivated Senior Platform...  ...new approaches, technologies, (including AI related capabilities) to allow your team...  ...cloud environments. Experience with observability tools such as Prometheus, ELK and... 
    Full time
    Worldwide

    Venturefizz Product Management Community

    Somerville, MA
    1 day ago
  • $180k - $250k

     ...rapidly developed humanoid platform now running in real...  ...Senior Platform Software Engineer at Humanoid, you will...  ...fidelity robotic controls and AI development. You will...  ...fault‑tolerant system. Lead Cross-Functional...  ...multiple domains. Test & Evaluate Systems: Integrate new... 
    Work at office

    Thehumanoid

    Boston, MA
    2 days ago
  •  ...The reliable delivery across engineering. The organization is seeking a Senior Manager of Platform Engineering to lead a mission‑critical team...  ...infrastructure, and a growing set of AI‑driven initiatives. This...  ...Kubernetes, AWS, CI/CD, observability, and automation. Identify... 
    Work at office
    Remote work
    Flexible hours
    Night shift

    Huxley

    Boston, MA
    2 days ago
  •  ...Axiomatic AI is building a new class of AI systems...  ...stakes scientific and engineering workflows. Our mission...  ...Overview As a Senior Platform Engineer at Axiomatic,...  ...development. You Will Lead deployment strategies...  ...Build comprehensive observability systems: monitoring, metrics... 

    Axiomatic_AI

    Boston, MA
    1 day ago
  •  ...As a Senior Platform Engineer , you'll be at the heart of our infrastructure - designing, building...  ...the core platform that powers our AI-driven security products. You'll collaborate...  ...to streamline deployment, CI/CD, observability, and performance optimization. Drive... 

    SevenAI

    Boston, MA
    1 day ago
  • $200k - $240k

     ...Job Description: Director, Platform Engineering Location: Boston, MA (Hybrid...  ...execution behind technology evaluation, selection, implementation,...  ...emerging technologies — including AI — to enhance engineering...  ...innovation. If you're energized by leading high-performing teams,... 
    Summer work
    Work at office
    Immediate start
    Worldwide
    Overseas

    Grand Circle

    Boston, MA
    2 days ago
  • $170k - $205k

     ...the company | Principal Platform Engineer | Boston, MA | ONSITE (hybrid) | $170k–$205k | company...  ...the company builds FDA-cleared AI software that analyzes cardiac CT scans...  ...platform: AWS, containers, Terraform, CI/CD, observability, and the self-service tooling that lets... 

    United States Digital Space LLC

    Boston, MA
    5 days ago
  •  ...TetraScience is the Scientific Data and AI company. We are catalyzing the...  ...for this position. The Role As a Lead Platform Engineer, you will play a critical role in evolving...  ...infrastructure allocation Enhance observability and monitoring to ensure reliability,... 
    Immediate start
    Remote work
    Flexible hours

    TetraScience

    Boston, MA
    2 days ago
  • $200k - $325k

     ...Job Description We are building an AI Engineering function to enable productivity and...  ...and business teams. As a Senior AI Platform Engineer, you will design and own the...  ...agentic platforms, developer tooling, and observability. This is a financial services... 
    Work at office
    Local area

    Arrowstreet Capital

    Boston, MA
    1 day ago
  • Dormont Manufacturing Co is seeking engineers for their Boston office to design and implement runtime primitives for their AI platform. The role requires expertise in distributed...  ...with flexibility for remote candidates evaluated on a case-by-case basis. #J-18808-Ljbffr... 
    Work at office
    Remote work

    Dormont Manufacturing Company

    Boston, MA
    1 day ago
  •  ...for architecture and development of a compute platform for HPC workloads. This role emphasizes improving observability and requires expertise in designing large-scale...  ...systems, contributing to high-quality solutions and leading design discussions. #J-18808-Ljbffr Quant... 

    Quant Blueprint LLC

    Boston, MA
    2 days ago
  • Title: Storage Platform Engineer Contract Length: 6 Months ASAP Start Day Rate: Inside IR35 Hybrid...  ...on making storage platforms reliable, observable, and easier to operate. It includes...  ...support operations and system insight. Use AI-based tooling to assist with monitoring... 
    Contract work
    Immediate start

    La-Fosse-1

    Cambridge, MA
    5 days ago
  • Axiomatic-AI Inc. is seeking a Senior Platform Engineer in Boston to lead the deployment and operational excellence of our AI platform. The role emphasizes infrastructure...  ...include deployment strategy, building observability systems, and ensuring compliance with security protocols... 

    Axiomatic-AI Inc.

    Boston, MA
    1 day ago
  •  ...AI Platform Engineer | AI Platform Engineering Full-Time Hybrid Onsite (3 days/week in office)...  ...Level Objective definitions, implement observability instrumentation, participate in...  ...stable ethical business with industry leading pay and benefits. MassMutual is an equal... 
    Full time
    Work at office
    3 days per week

    MassMutual

    Boston, MA
    1 day ago
  • $197.3k - $225.1k

     ...Overview Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) At Capital One, we are creating responsible and reliable...  ..., similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack of Open... 
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    5 days ago
  •  ...cloud analytics and data platform for AI. By delivering...  ...beyond automation — they observe, reason, adapt, and...  ...As a member of our AI engineering team, you’ll play a critical...  ...to observability and evaluation layers that ensure...  ...Engineer to lead innovation in the Agentic... 
    Permanent employment
    Flexible hours

    Teradata Corporation (SE)

    Boston, MA
    5 days ago
  • $110k - $130k

     ...DevOps Engineer Pickle Robot is on the hunt for a DevOps...  ...to help scale the platform that powers our fleet of...  ...integration to GCP. ~ Strong observability fundamentals — metrics...  ..." ~ Knows how to ask AI the right questions and can critically evaluate the outputs. ~... 
    Work at office
    Remote work
    3 days per week

    Pickle Robot Company

    Charlestown, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AI Observability & Evaluation Platform Engineer. Be the first to apply!