Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer, AI Observability & Evals Platform

$230k - $270k

LangChain

About Us At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world. Today, LangChain, LangGraph, LangSmith, and Fleet are used by teams shipping real AI products across startups and large enterprises. Millions of developers trust LangChain to power AI teams at companies like Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500. About the Team The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, they own this end-to-end. If you want to help define what great AI observability looks like at production scale, this is where that work gets done. About the Role We're looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive the technical direction of the platform. You'll build across the full stack from backend services and APIs to frontend product surfaces, and you'll play a central role in shaping how we build: setting engineering standards, mentoring engineers across the team, and making architectural decisions that hold up as we scale. If you're energized by both hands-on engineering and the multiplier effect of leveling up those around you, this role is built for that. Location: This role can be based in our Boston, San Francisco, or NYC office. What You'll Do Drive Technical Direction Lead architectural decisions across our Go, Python, and TypeScript stack, ensuring systems are performant, maintainable, and built to scale Work across the full stack, owning features end-to-end from backend services and APIs through to frontend product experiences Drive tracing, monitoring, and evaluation workflows at scale, with a focus on reliability and query performance across high-volume data Help shape the product roadmap by partnering closely with product and design — not just executing on it Raise the Bar for the Team Set engineering standards for the team: define patterns, lead code reviews, and establish the foundations others build on Mentor and grow engineers at all levels through code review, design feedback, pairing, and ongoing technical guidance Drive projects from ambiguity to delivery while maintaining high engineering standards and aggressive timelines Own Reliability and Quality Troubleshoot and resolve production issues with a root-cause mindset, and implement durable fixes Ensure system reliability through strong testing, monitoring, and alerting practices Create and maintain technical documentation, including system design docs and API references What You'll Bring 10+ years of professional experience in backend or fullstack engineering on highly complex, production systems Strong programming skills across multiple parts of the stack: backend (Python and/or Go) and frontend (TypeScript, React, or similar) Demonstrated experience making and owning architectural decisions, including tradeoffs around data systems, APIs, and service reliability Experience with high-throughput or mission-critical systems, and a proven ability to optimize for performance and reliability Depth in operationalizing technical work — you've taken systems from prototype to production and kept them running well at scale Demonstrated track record of mentoring engineers and raising the technical quality of a team, not just the codebase Strong communication skills and comfort operating cross-functionally with product, design, and engineering leadership Customer centricity and an ownership mentality — you care how the product lands, not just how the code reads You exemplify our operating principles Nice to Have Experience with database systems (Postgres, Redis, ClickHouse) and cloud platforms (AWS, GCP, or Azure) Familiarity with observability tooling, evaluation frameworks, or AI/LLM infrastructure Salary Range : $230,000 - $270,000 Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations. Benefits Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more. #J-18808-Ljbffr

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, AI Observability & Evals Platform in Boston, MA vacancy
  • $230k - $270k

     ...Principal/Lead Level Software Engineer The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, they own this end-to-end.... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Boston, MA
    4 days ago
  • $175k - $225k

     ...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA, New...  ...backend systems that power LangChain's observability and evals platform. You will work on the core services...  ...developers to monitor and evaluate their AI applications at scale. While the... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Boston, MA
    2 days ago
  • $175k - $240k

     ...Senior Fullstack Engineer In person 5 days/week in San Francisco...  ...product LangSmith, an observability and evals platform. In this role, you'll have...  ...~5+ years of experience in software engineering working on complex...  ...~ Bonus: Experience with AI/LLM-powered applications, developer... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    2 days ago
  • $145k - $180k

     ...foundation for agent engineering in the real world,...  ...production-ready AI agents that teams...  ...to also offer a platform for building, evaluating...  ...LangSmith (Observability, Evaluation, Deployment...  ...observability and evals platform product....  ...of experience in software engineering... 
    Platform
    Work at office
    Flexible hours

    LangChain

    Cambridge, MA
    1 day ago
  • $99.6k - $223.4k

     ...generation of cloud-native EHR platforms. This is a hands-on, high-...  ...infrastructure, and applied AI-designing intelligent,...  ...scalability, reliability, and observability. Stay hands-on with coding...  ...production delivery. Drive engineering excellence through code reviews... 
    Platform
    Full time
    Temporary work
    Remote work
    Flexible hours

    Oracle

    Boston, MA
    2 days ago
  • $145k - $180k

     ...LangChain is seeking a Fullstack Engineer to enhance the LangSmith platform, focusing on AI observability products. You will collaborate with developers, internal stakeholders...  .... The ideal candidate has over 2 years of software engineering experience, strong skills in Go or... 
    Platform

    LangChain

    Cambridge, MA
    15 hours ago
  • $96.8k - $251.6k

     ...Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level,...  ...-grade agentic AI platforms, autonomous workflows, scalable...  ...reliable, secure, observable, and cost-aware AI platform...  ...systems, including offline evals, online experiments, golden... 
    Platform
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    4 days ago
  • $248k - $372k

     ...Principal Engineer, Enterprise Scalability At Klaviyo, we value the unique...  ...tenant readiness. You’ll drive platform‑wide architectural change,...  ...customer outcomes. Integrate AI into scale and resiliency...  ...with explicit guardrails and observability. Cross‑org influence: You align... 
    Platform

    Klaviyo

    Boston, MA
    15 hours ago
  •  ...Principal Software Engineer, Team Lead ABCorp is seeking a Principal Software...  ...shape scalable, secure cloud platforms that power financial...  ...platforms designed for scale, observability, and measurable impact....  ...Native fluency with modern AI-accelerated engineering practices... 
    Platform
    Visa sponsorship

    ABCorp

    Boston, MA
    3 days ago
  •  ...Principal Software Engineer, Tech Lead - Client Experience Platform ABCorp has been a trusted force in security and innovation...  ...Ensure system reliability, observability, and security in a regulated financial...  ...rigor. Leverage modern AI-assisted engineering practices... 
    Platform
    Worldwide

    ABCorp

    Boston, MA
    3 days ago
  •  ...Sr. Principal Software Engineer At Zelis, we Get Stuff Done. So, let's get to...  ...providers and consumers across our platform of solutions. Zelis sees...  ...for operational readiness, observability, and system ownership....  ...tracing). Experience using AI-assisted tools to enhance... 
    Platform
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Zelis

    Boston, MA
    2 days ago
  •  ...Overview DataRobot delivers AI that maximizes impact and...  ...minimizes business risk. As a Principal Software Engineer, you will be responsible...  ...You will build resilient, observable, and low‑intervention infrastructure...  ...cross‑functionally with platform engineers, cloud... 
    Platform
    Local area
    Flexible hours

    DataRobot

    Boston, MA
    3 days ago
  • $160k - $190k

    Vestmark is building the AI-native future of...  ...We are looking for a Principal Engineer who thinks in systems...  ...define how AI-native software gets built at scale....  ...processes, maintain observability, and control inference...  ...grade software systems: platforms and frameworks that... 
    Platform
    Work experience placement

    Vestmark

    Boston, MA
    2 days ago
  • $212k - $286k

     ...Principal Software Engineer Paperless Parts is a SaaS startup helping manufacturers...  ...industry with a SaaS platform that empowers the next generation...  ...are robust, scalable, and AI-ready. This role is a...  ...establish a culture of deep observability and operational maturity,... 
    Platform
    Full time
    Work at office
    Immediate start
    Remote work

    Venturefizz Product Management Community

    Boston, MA
    3 days ago
  • $168k - $210k

     ...Principal Software Development Engineer, Ads Intelligence At CarGurus, our mission is...  ...technical direction for our platform that will deliver complex...  ...quality, testability, observability, and operational excellence...  ...technologies, including AI/ML capabilities, to enhance... 
    Platform
    Flexible hours

    Venturefizz Product Management Community

    Boston, MA
    2 days ago
  • $96.8k - $251.6k

     ...for demanding media, creative, AI, and high-performance...  ...the cloud while improving the engineering systems, operational practices...  ...GPU enablement, and related platform dependencies. Drive Batch/...  ...operational posture through observability, runbooks, incident-prevention... 
    Platform
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    1 day ago
  • $254k - $336k

     ...Principal Software Engineer, Cryptography Anduril Industries is a defense technology...  ...powered by Lattice OS, an AI-powered operating system...  .... Team Overview The Platform Security Engineering (PSE)...  ...security of our candidates. We've observed a rise in sophisticated... 
    Platform
    Full time
    Work experience placement
    Immediate start

    anduril

    Boston, MA
    2 days ago
  • $167.2k - $209k

     ...Principal Software Engineer, Mobile Cambridge Mobile Telematics is looking for...  ...: Actively uses AI coding tools in development...  ...maintaining SDKs or mobile platforms consumed by external developers...  ...Experience with mobile observability practices, including... 
    Platform
    Temporary work
    Work from home
    Flexible hours

    Softbank Investment Advisers

    Cambridge, MA
    2 days ago
  • $144.2k - $288.4k

     ...POSITION SUMMARY As a Principal Software Engineer, you will define and drive the...  ...scalable, production-grade platforms. You will establish clear...  ...fundamentals such as testing, observability, and CI/CD are embedded...  ...designing or integrating AI or generative AI solutions... 
    Platform
    Hourly pay
    Full time
    Temporary work
    Local area

    Stryker

    Boston, MA
    15 hours ago
  • $99.6k - $234.6k

     ...Summary Oracle Health Platform Engineering builds and operates shared...  ...delivery at scale. We are an AI-first engineering...  ...operability. We are seeking a Principal Software Developer (IC4) to lead design...  ..., deployment patterns, observability). • Mentor engineers... 
    Platform
    Temporary work
    Visa sponsorship
    Flexible hours

    Oracle

    Boston, MA
    5 days ago
  •  ...Description: DataRobot delivers AI that maximizes impact and...  ...business risk. Our platform and applications integrate...  ...and in the future. As a Principal Software Engineer, you'll be responsible for...  ...systems that are resilient, observable, and require minimal intervention... 
    Platform
    Local area
    Worldwide
    Flexible hours

    DataRobot

    Boston, MA
    1 day ago
  • $99.6k - $223.4k

     ...building usable, reliable software that helps engineering and operations teams reason...  ...Drive development of core platform capabilities, including...  ...correctness, traceability, observability, and operational efficiency...  ...life-saving care. And with AI embedded across our... 
    Platform
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    5 days ago
  • $136.1k - $219.6k

     ...insurance industry. We are the platform upon which modern insurance...  ...over time. TITLE : Principal Software Engineer - GenAI WHAT YOU'LL...  ...and execution of advanced AI-powered solutions across multiple...  ...-level capabilities for observability, evaluation, auditability,... 
    Platform
    Work experience placement
    Work at office
    Work from home
    Visa sponsorship
    Flexible hours

    Duck Creek Technologies

    Boston, MA
    2 days ago
  • $99.6k - $223.4k

     ...Oracle is seeking an experienced Software Engineer to join a highly skilled...  ...building modern cloud and AI-enabled enterprise solutions...  ...secure, scalable AI frameworks, platforms, and developer tools that...  ...scalability, resiliency, security, observability, and operational readiness.... 
    Platform
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    2 days ago
  •  ...Principal Full Stack Software Engineer, Investments Technology (Public Markets) Liberty Mutual...  ...throughput trading and market data platforms for Global Liquid Markets....  ...including CI/CD, automated testing, observability, and responsible use of AI across the SDLC to improve... 
    Platform
    Work at office
    Local area
    2 days per week
    3 days per week

    Venturefizz Product Management Community

    Boston, MA
    3 days ago
  • $266.2k - $425.9k

     ...the Role We’re seeking a Principal Software Engineer to play a pivotal role in shaping...  ..., and applied AI. As a Principal Engineer,...  ...scale: Drive decisions around observability, correctness, privacy, and...  ...is an AI-powered customer platform with all the software, integrations... 
    Platform
    Live out
    Work at office
    Remote work

    HubSpot

    Cambridge, MA
    1 day ago
  • $167.2k - $209k

     ...Principal Software Engineer, Backend CMT is looking for a Principal Backend Software Engineer...  ..., CI/CD reliability, and system observability to ensure our platform remains performant and resilient...  ...,000 crashes worldwide. We build AI to solve some of the most difficult... 
    Platform
    Temporary work
    Summer work
    Work from home
    Worldwide
    Flexible hours

    Cambridge Mobile Telematics

    Cambridge, MA
    4 days ago
  • $145.4k - $242.5k

     ...Job Description Summary As a Principal AI Software Engineer, you will drive technical vision and...  ...tenant, high-availability systems with observability. Establish AI cost management,...  ...Expert-level experience with cloud platforms (AWS, GCP, or Azure) and advanced containerization... 
    Platform
    Contract work
    Work at office
    Relocation package

    GE Vernova

    Cambridge, MA
    2 days ago
  • $204k - $348k

     ...Sr Principal/ Principal Software Engineer, AI Lab Execution System Cambridge, MA USA; San Francisco, CA USA...  ...next-generation AI-driven scientific platform. In this role, you will serve...  ...for high availability, low latency, observability, fault tolerance, and operational... 
    Platform
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    1 day ago
  • $200.6k - $250.4k

     ...as-a-Service (DaaS) platform. At the core of this...  ...technical leadership-engineers who can see across...  ...years to come. As a Principal Staff Software Engineer, you will play...  ...for analytics, AI, and customer-facing...  ...modeling, lineage, observability, and access control... 
    Platform
    Flexible hours

    WEX

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer, AI Observability & Evals Platform. Be the first to apply!