Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principle Software Engineer, AI Observability & Evals Platform

$230k - $270k
Full-time

LangChain

About Us

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, LangChain, LangGraph, LangSmith, and Fleet are used by teams shipping real AI products across startups and large enterprises. Millions of developers trust LangChain to power AI teams at companies like Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500.

About the Team

The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, they own this end-to-end. If you want to help define what great AI observability looks like at production scale, this is where that work gets done.

About the Role

We're looking for a Principal/Lead level Software Engineer to join the LangSmith team and help drive the technical direction of the platform. You'll build across the full stack from backend services and APIs to frontend product surfaces, and you'll play a central role in shaping how we build: setting engineering standards, mentoring engineers across the team, and making architectural decisions that hold up as we scale. If you're energized by both hands-on engineering and the multiplier effect of leveling up those around you, this role is built for that.

Location: This role can be based in our Boston, San Francisco, or NYC office.

What You'll Do

Drive Technical Direction

  • Lead architectural decisions across our Go, Python, and TypeScript stack, ensuring systems are performant, maintainable, and built to scale

  • Work across the full stack, owning features end-to-end from backend services and APIs through to frontend product experiences

  • Drive tracing, monitoring, and evaluation workflows at scale, with a focus on reliability and query performance across high-volume data

  • Help shape the product roadmap by partnering closely with product and design — not just executing on it

Raise the Bar for the Team

  • Set engineering standards for the team: define patterns, lead code reviews, and establish the foundations others build on

  • Mentor and grow engineers at all levels through code review, design feedback, pairing, and ongoing technical guidance

  • Drive projects from ambiguity to delivery while maintaining high engineering standards and aggressive timelines

Own Reliability and Quality

  • Troubleshoot and resolve production issues with a root-cause mindset, and implement durable fixes

  • Ensure system reliability through strong testing, monitoring, and alerting practices

  • Create and maintain technical documentation, including system design docs and API references

What You'll Bring

  • 10+ years of professional experience in backend or fullstack engineering on highly complex, production systems

  • Strong programming skills across multiple parts of the stack: backend (Python and/or Go) and frontend (TypeScript, React, or similar)

  • Demonstrated experience making and owning architectural decisions, including tradeoffs around data systems, APIs, and service reliability

  • Experience with high-throughput or mission-critical systems, and a proven ability to optimize for performance and reliability

  • Depth in operationalizing technical work — you've taken systems from prototype to production and kept them running well at scale

  • Demonstrated track record of mentoring engineers and raising the technical quality of a team, not just the codebase

  • Strong communication skills and comfort operating cross-functionally with product, design, and engineering leadership

  • Customer centricity and an ownership mentality — you care how the product lands, not just how the code reads

  • You exemplify our operating principles

Nice to Have

  • Experience with database systems (Postgres, Redis, ClickHouse) and cloud platforms (AWS, GCP, or Azure)

  • Familiarity with observability tooling, evaluation frameworks, or AI/LLM infrastructure

Salary Range : $230,000 - $270,000

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principle Software Engineer, AI Observability & Evals Platform in Remote vacancy
  •  ...new era, we seek AI-native thinkers across...  ...work gets done. Observe by Snowflake is an...  ...observability platform built on the Snowflake...  ...AI Data Cloud and engineered for scale. We...  ...We are hiring a Software Engineer, AI Products...  ..., and evaluation (evals) pipelines in production... 
    Platform
    Full time

    Snowflake

    Remote
    1 day ago
  •  ...a Site Reliability Engineer on the Observability Team, your focus will...  ...observability tooling — the platform, automation, and...  ...Engineering (SRE) principles (SLOs, error budgets...  ...systems. ~Strong software development skills...  ...Proficiency in using AI tools thoughtfully,... 
    Platform
    Full time

    Glia

    Remote
    4 days ago
  • $133.65k - $220.68k

     ...Job Summary The RedHat Observability Service team is looking for a Senior Software Engineer to join us in the USA....  ...Proactively leverage AI technologies to streamline...  ...awareness of Cloud Platforms. Ability to analyze...  ...functionality. Awareness of Agile principles and frameworks and... 
    Platform
    Permanent employment
    Full time
    Flexible hours

    Dormont Manufacturing Company

    Boston, MA
    2 days ago
  • $133.65k - $220.68k

     ...Job Summary The Red Hat Observability Service team is looking for a Senior Software Engineer to join us in the USA....  ...Proactively leverage AI technologies to...  ...or OpenShift 4. Cloud Platforms: Understanding and awareness...  ...understanding of Agile principles and frameworks and... 
    Platform
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat

    Raleigh, NC
    3 days ago
  • $175k - $240k

     ...build the foundation for agent engineering in the real world, helping...  ...prototypes to production-ready AI agents that teams can rely on...  ...have grown to also offer a platform for building, evaluating, deploying...  ...product for LLM application observability, testing, and debugging.... 
    Platform
    Full time
    Work at office
    Flexible hours

    LangChain

    Remote
    1 day ago
  • $133.65k - $220.68k

    Job Summary The Red Hat Observability Service team is looking for a Senior Software Engineer to join us in the USA....  ...Proactively leverage AI technologies to...  ...or OpenShift 4. Cloud Platforms: Understanding and awareness...  ...of Agile principles and frameworks and their... 
    Platform
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Red Hat, Inc.

    Raleigh, NC
    1 day ago
  •  ...enterprise. To usher in this new era, we seek AI-native thinkers across every function...  ...the future of how work gets done. Observe by Snowflake is an AI-powered observability platform built on the Snowflake AI Data Cloud and engineered for scale. We ingest and store logs,... 
    Platform
    Full time

    Snowflake

    Remote
    1 day ago
  •  ...Abnormal AI is looking for...  ...Senior Backend Engineer to join the App...  ...centric data and platform services that every...  ...product-minded, principle-first engineer...  ...LMS, improve our observability and on-call...  ...provider APIs, evals, model routing,...  ...years of backend software engineering experience... 
    Platform
    Full time
    Remote work

    Abnormal Company

    Remote
    1 day ago
  • $185k - $210k

     ...CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering...  ...About the role The Observability department plays a...  ...seeking senior observability engineers with specializations in...  ...years of experience in a software or infrastructure... 
    Platform
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    Coreweave

    Washington DC
    1 day ago
  • $109k - $145k

     ...The Essential Cloud for AI™. Built for pioneers...  ...CoreWeave delivers a platform of technology, tools,...  ...What You'll Do: The Observability team builds and...  ...enables both internal engineers and customers to monitor...  ...About the role: As a Software Engineer on the Observability... 
    Platform
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    Coreweave

    New York, NY
    1 day ago
  • $200k - $280k

    Role Description Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle...  ...the fastest LLM inference engine with state-of-the-art AI cloud...  ...AI platform. The storage and observability team is crucial for designing,... 
    Platform
    Full time
    Remote work

    Together AI

    Remote
    4 days ago
  • $187k - $235k

     ...Description The Sr. Software Engineer II - AI will lead the build...  ...experiences and the shared AI platform infrastructure that...  ...systems ~The evals and MLOps layer that...  ..., guardrails, and observability ~Write LLM...  ...of software design principles, automated testing,... 
    Platform
    Full time
    Work experience placement

    iHerb

    Remote
    4 days ago
  • $100k - $170.5k

     ...forward-thinking Lead Product Engineer to drive innovation in its AI-powered Observability platform. This role sits at the intersection...  ..., observability, and software development, with a strong focus...  ...incorporating AI and automation as core principles. ~Collaborate with... 
    Platform
    Full time
    Work from home

    Allstate

    Remote
    2 days ago
  •  ...About the Role We are seeking a Software Engineer, Security Observability to join our Security team. In this role...  ...of data systems to ensure high platform availability Collaborate closely...  .... About OpenAI OpenAI is an AI research and deployment company dedicated... 
    Platform
    Full time
    Remote work
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...is developing an AI-native marketplace...  ...across the platform. Engineers here treat AI as...  ...framing → data → evals → iteration → deployment...  ...team as a Software Engineer. The engineering...  ..., or LLM observability tooling. Experience...  ...into clarity. First-principles thinking and genuine... 
    Platform
    Full time
    For contractors
    Work at office
    Relocation

    Syndesus, Inc.

    New York, NY
    1 day ago
  •  ...Senior Software Engineer Location: Fully remote...  ...AWS, Databricks, AI/LLM-powered enterprise...  ...experience with AWS Cloud Platform and large-scale...  ...AI, OpenAI Evals, or similar for monitoring, observability, and governance...  ...of Atomic Design principles for scalable component... 
    Platform
    Contract work
    Remote work

    3B Staffing LLC

    Oregon City, OR
    21 hours ago
  •  ...hardware, installing software, or changing a line of...  ...normalized" problem and the AI-native curiosity to...  ...Summary Workers Observability (WOBS) Team provides a...  ...Cloudflare Developer platform. These tools increasingly...  ....  The Systems Engineer role is a full-stack position... 
    Platform
    Full time
    Local area

    Cloudflare

    Remote
    1 day ago
  •  ...of innovative GIS software products in...  ...utilities, and system observability. In this role, you...  ...insights through AI, and bring real-...  ...software development engineer, you’ll...  ...tablet, and mobile platforms ~ Proven experience...  ...end architecture principles, and applying best... 
    Platform
    Full time

    Esri

    Remote
    1 day ago
  • $226k - $306k

     ...Viber, Mixpanel's AI-first digital...  ...-leading platform that combines product...  ...production and evals, given the...  ...skills library. AI Engine: Services that...  ...driven Senior Software Engineer to join...  ...error handling. Observability & MLOps: Ensure...  ...as our guiding principles for the impact... 
    Platform
    Contract work
    Remote work

    Mixpanel-1

    San Francisco, CA
    1 day ago
  •  ...build and orchestrate AI workforces. Our AI...  ...worldwide. Our platform is battle-tested in the...  ...for a talented Backend Software Engineer to join our team....  ...reliability, performance, and observability Work on real-time...  .... Our Operating Principles Extreme... 
    Platform
    Full time
    Worldwide
    Shift work

    HappyRobot

    Remote
    1 day ago
  •  ...automation with cutting-edge AI technology. Backed by...  ...a high-impact engineering group to bring AI-powered...  ...integrations across platforms like SAP, Salesforce,...  ...system reliability and observability. Collaborate with DevOps...  ..., and scalability principles. ~ Strong debugging,... 
    Platform
    Full time

    Tessera Labs

    Remote
    1 day ago
  •  ...the modern data platform for accounting and...  ..., workflows, and AI together to help...  ..., analytics, and observability layer for their financial...  ...on the job. Engineers spend time...  ...think from first principles about how to solve...  ...of experience in software engineering... 
    Platform
    Full time
    Contract work

    Numeric

    Remote
    1 day ago
  •  ...the world come to our platform to find creative...  ...Possible. At Pinterest, AI isn't just a feature...  ...for a Backend Engineer to help design, build...  ...guarantees Improve system observability, reliability, and...  .../Java Strong software engineering principles and practices... 
    Platform
    Remote job
    Full time
    Contract work
    Work at office
    Relocation
    Relocation package
    Flexible hours

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...functional group spanning engineering, product,...  ...an experienced Software Engineer to build...  ...and enforcement platforms, review tooling,...  ...ecosystem from first principles. This role is...  ...through testing, observability, auditability, privacy...  ...OpenAI is an AI research and... 
    Platform
    Full time
    Relocation package

    OpenAI

    Remote
    1 day ago
  •  ...Join the engineering teams that bring OpenAI’...  ...the benefits of AI, while ensuring that...  ...teams, including software engineers,...  ...and maintain the platform for CPU/storage,...  ...Infrastructure as Code (IaC) principles to automate...  ...Experience with observability tools such as DataDog... 
    Platform
    Full time
    Work experience placement
    Relocation package

    OpenAI

    Remote
    1 day ago
  •  ...configurable identity platform built for businesses in...  ...important — than ever, with AI enabling fraudsters to...  ...ll be one of the first engineers on a team with a clear,...  ...can configure, observe, and extend without filing...  ...practice, not just in principle. Change safety and governance... 
    Platform
    Full time
    For contractors
    Internship

    Persona

    United States
    1 day ago
  •  ...Beacon Software is a permanent capital holding...  ...Deployed Software Engineer, New Verticals...  ...build a technology platform that reshapes a $1...  ...industry with frontier AI. You will join a...  ...actions. Run evals: Offline/online eval...  .../cost; build observability and incident playbooks... 
    Platform
    Permanent employment
    Full time

    Beacon Software

    San Francisco, CA
    1 day ago
  •  ...one B2B post-sales support platform powered by conversational...  ...several extremely talented software engineers across the stack. In...  ...platforms that power Pylon's AI features - prompt...  ..., and more! Improve LLM observability - AI evals (online and offline), scorers... 
    Platform
    Full time
    Work at office
    Relocation

    Pylon

    San Francisco, CA
    1 day ago
  •  ...the Team OpenAI’s Platform and Infrastructure Engineering organization advances...  ...to drive impactful AI research, corporate...  ...the Role As a Software Engineer: Internal...  ...align with Zero Trust principles, RBAC expectations,...  ...monitoring, observability, and incident readiness... 
    Platform
    Full time
    Remote work
    Relocation package

    OpenAI

    San Francisco, CA
    1 day ago
  • $110k - $145k

     ...Software Engineer - Backend Services Truveta is the world...  ...health provider led data platform with a vision of...  ...deployment, debugging, observability, reliability, and...  ...application, data, and AI-enabled workflows, helping...  ...and security-first principles to create backend... 
    Platform
    Full time
    For contractors
    H1b
    Visa sponsorship
    Work visa
    Flexible hours

    Truveta

    Remote
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principle Software Engineer, AI Observability & Evals Platform. Be the first to apply!