Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA)

$200k - $250k

LangChain, Inc

About Us

At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.

With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we're at a stage where we're continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.

Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.

About the Team

The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.

About the role

We're looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You'll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.

What you'll do
  • Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
  • Strengthen LangChain's engineering culture through mentorship, high-quality code, and technical excellence
  • Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
  • Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
  • Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
  • Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
  • Engage directly with customers to understand their needs and translate them into actionable product improvements
What you'll bring
  • Experience managing or tech-leading teams delivering complex full-stack products
  • Strong technical background in Go/Python and React/Typescript
  • Solid understanding of databases (Postgres, Redis and ClickHouse)
  • Proven ability to design high throughput data-intensive systems
  • Bias towards shipping quickly and learning from customers
  • Strong communication skills-able to collaborate with internal stakeholders and engage directly with customers
  • Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
  • Annual salary range: $200,000- $250,000

Compensation Philosophy:

We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.

Benefits

Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA) in San Francisco, CA vacancy
  • $200k - $250k

     ...Engineering Manager We're looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You'll define the technical direction,...  ...developers build and deploy trustworthy AI systems with confidence.... 
    Platform
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    17 hours ago
  • $227k - $341k

    Amplitude is the leading AI analytics platform, helping over 4,700 customers...  ...a query. Our in‑house OLAP engine, Nova , processes trillions...  ...looking for an Engineering Manager to lead the Query team through...  ...will work for Amplitude in San Francisco Bay Area of California:... 
    Platform
    Work at office
    Worldwide
    Home office
    Flexible hours

    Amplitude

    San Francisco, CA
    3 days ago
  • $200k - $230k

     ...With teams in Denver, San Francisco, and New York, we’re...  ...Rewards philosophy . Staff Observability Engineer Gusto’s Reliability...  ..., online people platform that helps small businesses...  ...expert HR, and team management tools. Today, Gusto...  .... Build AI-native capabilities to... 
    Platform
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...Founding Backend Engineer, On-site — San Francisco, CA Location:...  ...seed stage AI company is building...  ...enterprise software. The team is developing the platform, infrastructure...  ...orchestration, state management, and recovery....  ...reliability, observability, and performance... 
    Platform
    Work at office
    Immediate start

    Connect Staffing and Consulting

    San Francisco, CA
    17 hours ago
  • $145k - $195k

    Platform Engineer - Reliability & Scale at LangChain - San Francisco, CA About LangChain At LangChain, our...  ...-critical AI applications across...  ...test, run, and manage agents at scale...  ...our customers’ AI observability and LangGraph app...  ...Strong hands-on software engineering skills... 
    Platform

    Victrays

    San Francisco, CA
    4 days ago
  • $147.6k - $274k

     ...Machine Learning Engineer - Infra San Francisco, CA The Opportunity...  ...and Early Development AI Drug Development (gRED...  ...experience building scalable software and infrastructure,...  ..., deploying, and managing infrastructure on...  ...-scale ML model platforms and tools. Deep understanding... 
    Platform
    Relocation package

    ESR Healthcare

    San Francisco, CA
    4 days ago
  •  ...AI Prompt and Agent Engineer - San Francisco, CA Schedule: In office, five days per week Work Authorization:...  ...A rapidly scaling AI operations platform supporting more than one thousand...  ...understanding of LLM behavior, context management, and evaluation techniques.... 
    Platform
    Work at office

    Connect Staffing

    San Francisco, CA
    6 days ago
  • $200k - $300k

     ...Senior Software Engineer - San Francisco, CA (onsite) A fast growing AI platform supporting more than one thousand physical locations and tens of millions of calls every year is expanding its engineering team. The company is scaling from millions of calls to billions... 
    Platform
    Remote work
    Relocation package

    Connect Staffing and Consulting

    San Francisco, CA
    1 day ago
  • $200k - $250k

     ...Founding Machine Learning Engineer -  On-site - San Francisco, CA Location: San Francisco...  ...A well-funded seed-stage AI company is building advanced...  ...inside real enterprise software. The team is developing multimodal...  ..., and contribute to a platform with national-level impact... 
    Platform
    Work at office
    Immediate start

    Connect Staffing

    San Francisco, CA
    17 hours ago
  •  ...Developer Location: - San Francisco, CA 94103. We are...  ...technologies. The role also leverages AI-assisted development ("vibe...  ...for web and mobile platforms. Utilize AI-assisted...  ...design tools. Deploy and manage applications in Microsoft Azure... 
    Platform

    E-Solutions

    San Francisco, CA
    1 day ago
  • $174k - $290k

     ...first time ever, you can manage and automate every...  ...90 seconds. Based in San Francisco, CA, Rippling has raised $...  ...The Rippling Developer Platform team is responsible for...  ...customers are Rippling's engineers. Hundreds of them,...  ...surface of the product. AI coding tools are... 
    Platform
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • $280k - $350k

     ...Department About Arize AI is rapidly transforming...  ...the leading AI & Agent Engineering observability and evaluation platform , empowering AI engineers...  ...to be based in San Francisco, CA. What you bring to the...  ...Have 3+ years of sales management experience, with a track... 
    Platform
    Remote job
    Full time
    Contract work
    For contractors
    Work experience placement
    For subcontractor
    Work at office
    Work from home

    Arize AI, Inc

    San Francisco, CA
    1 day ago
  • $180k - $315k

     ...billing, and emerging AI-driven experiences. As a Staff Software Engineer on the Payroll...  ...layers, and platform capabilities that...  ...correctness and observability, and thrives in environments...  ..., and lifecycle management across upstream...  ...USD per year (US San Francisco Bay Area) #J-188... 
    Platform
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  •  ...first time ever, you can manage and automate every...  ...90 seconds. Based in San Francisco, CA, Rippling has raised $...  ...addresses. About the role The AI & Data Cloud Account...  ...and underlying data platform, as companies look to...  ...with Solutions Engineers (SEs), Professional Services... 
    Platform
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  • $140k - $175k

    AI is rapidly transforming the world. As...  ...AI & Agent Engineering observability and evaluation platform , empowering AI engineers...  ...an AI Solutions Manager, you’ll partner with...  ...the most complex software ever deployed in production...  ...York City and the San Francisco Bay Area, as an... 
    Platform
    Work experience placement
    Remote work
    Work from home

    Arize AI, Inc

    San Francisco, CA
    1 day ago
  • Research Engineer, Virtual Collaborator at Anthropic - San Francisco, CA | New York City, NY | Seattle, WA About Anthropic Anthropic...  ..., interpretable, and steerable AI systems. We want AI to be safe...  ...and scaling our data creation platform for generating high-quality, open... 
    Platform
    Work at office
    Visa sponsorship
    Flexible hours

    Victrays

    San Francisco, CA
    4 days ago
  • $68k - $84k

     ...Executive, Devs.ai, North America About...  ...commerce platform to sell any product...  ...change how AI and software gets created and...  ...founder and General Manager of the business unit...  ...team, and Sales Engineering to identify...  ...Sales Location San Francisco, CA, US #J-18808-Ljbffr... 
    Platform
    Contract work
    Worldwide
    Shift work

    AppDirect, Inc

    San Francisco, CA
    1 day ago
  • $320k - $405k

     ...interpretable, and steerable AI systems. We want...  ...researchers, engineers, policy experts,...  ...Have 5+ years of software engineering...  ...developer-facing platforms Background in...  ...building monitoring or observability systems...  ...headquartered in San Francisco. We offer competitive... 
    Platform
    Work at office
    Visa sponsorship
    Flexible hours
    San Francisco, CA
    more than 2 months ago
  • $100k - $175k

     ...AI is rapidly transforming the world. As generative AI reshapes industries...  ...AI is the leading AI & Agent Engineering observability and evaluation platform , empowering AI engineers to...  ...requires candidates to be based in the San Francisco Bay area, though there isn't an... 
    Platform
    Contract work
    For contractors
    Work experience placement
    For subcontractor
    Work at office
    Local area
    Remote work
    Work from home
    Afternoon shift

    Arize AI, Inc

    San Francisco, CA
    4 days ago
  • $184k - $259.44k

    Software Engineer, Frontier AI Infrastructure San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC Ready to Apply? Join...  ...vendors and customers to debug platform issues, negotiate capacity/...  ...is appropriate and necessary to manage applicants’ needs, provide our... 
    Platform
    Full time
    Work at office
    3 days per week

    Scale AI, Inc.

    San Francisco, CA
    1 day ago
  •  ...enterprise sustainability platform. Companies like...  ...Martens use Watershed to manage climate and ESG data,...  ...We have offices in San Francisco, New York, Denver,...  ...scale a world-class engineering team, and we’re hiring...  ...database architecture, observability, reliability & SLOs,... 
    Platform
    Work at office
    Remote work

    Watershed

    San Francisco, CA
    2 days ago
  • $210k - $285k

     ...Senior Full Stack Engineer | San Francisco, CA | Avg $210K–$285K +...  ...A rapidly growing AI technology company is...  ...and customer-facing platforms. This role offers...  ...years of professional software engineering experience...  ...complex frontend state management systems Strong... 
    Platform

    Direct Line Workforce Solutions

    San Francisco, CA
    3 days ago
  • $181k - $271k

     ...Machine Learning Engineer - design and...  ...business. Location: San Francisco Bay Area (in‑...  ...product and platform stakeholders to...  ..., scalability, observability, and low‑latency...  ...closely with AI/ML engineers and...  ...data scientists, software engineers, product managers, and business... 
    Platform
    Full time
    Work at office
    Flexible hours
    3 days per week

    GoFundMe

    San Francisco, CA
    4 days ago
  • $145.35k - $253.23k

     ...currently seeking a Manager, SAP S4 Public...  ...and AI driven analytics...  ...SAP and non SAP platforms using SAP BTP and...  ...Systems, Data Engineering, or a related field...  ...holidays to be observed during the year...  ...city outside of CA: California...  ...Ordinance, and San Francisco Fair Chance Ordinance... 
    Platform
    H1b
    Local area

    KPMG

    San Francisco, CA
    4 days ago
  • $145k - $190k

     ...Software Engineering Manager – Backend Location: San Francisco, CA, United States Location Type: On-site Salary...  ...reliable, long-lived platforms that serve homeowners...  ..., reliability, observability, performance, and cloud...  ...experience. USE OF AI TOOLS As a technology... 
    Platform
    For contractors
    Remote work

    Q-Cells

    San Francisco, CA
    1 day ago
  • $220k - $260k

     ...Staff Software Engineer, Agentic Data Plane San Francisco, CA (Hybrid) Redpanda is pioneering the Agentic...  ...) - a new category in AI infrastructure that...  ...with Cloud, Core, and Platform engineering, as well as...  ...Make resilience and observability integral to the systems... 
    Platform
    Work at office

    Redpanda Data

    San Francisco, CA
    1 day ago
  • $175k - $225k

     ...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA, New York....  ...that power LangChain's observability and evals platform. You will work on the...  ...monitor and evaluate their AI applications at scale...  ...engineers, product managers, and product... 
    Platform
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    17 hours ago
  •  ...Machine Learning Engineer (Operations) South San Francisco CA Machine Learning Engineer (Operations...  ...experience in creating, managing, and deploying ML models...  ...models in generative AI applications....  ...integrating external systems or platforms, such as Veeva Promomat (... 
    Platform
    3 days per week

    ESR Healthcare

    South San Francisco, CA
    4 days ago
  •  ...opportunity for Lead Data Engineer position if...  ...350 Mission Street,, San Francisco,CA,USA,94105 Duration...  ...data engineering, BI platforms, and large-scale data...  ...~8-10 years of software development and data...  ...organized, and capable of managing multiple priorities... 
    Platform

    Saxon Global

    San Francisco, CA
    1 day ago
  • $175k - $240k

     ...Senior Fullstack Engineer In person 5 days/week in San Francisco We're looking for a Senior...  ...LangSmith, an observability and evals platform. In this role, you'll...  ...years of experience in software engineering working on...  ...Bonus: Experience with AI/LLM-powered... 
    Platform
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA). Be the first to apply!