Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA)
$200k - $250kLangChain, Inc
About Us At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we're at a stage where we're continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world. Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater. About the Team The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done. About the role We're looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You'll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence. What you'll do
Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations. Benefits Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
- Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
- Strengthen LangChain's engineering culture through mentorship, high-quality code, and technical excellence
- Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
- Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
- Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
- Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
- Engage directly with customers to understand their needs and translate them into actionable product improvements
- Experience managing or tech-leading teams delivering complex full-stack products
- Strong technical background in Go/Python and React/Typescript
- Solid understanding of databases (Postgres, Redis and ClickHouse)
- Proven ability to design high throughput data-intensive systems
- Bias towards shipping quickly and learning from customers
- Strong communication skills-able to collaborate with internal stakeholders and engage directly with customers
- Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
- Annual salary range: $200,000- $250,000
Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. Actual compensation and offerings will vary based on role, level, and location. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations. Benefits Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA) in San Francisco, CA vacancy
$200k - $250k
...Engineering Manager We're looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You'll define the technical direction,... ...developers build and deploy trustworthy AI systems with confidence....PlatformWork at officeFlexible hours$227k - $341k
Amplitude is the leading AI analytics platform, helping over 4,700 customers... ...a query. Our in‑house OLAP engine, Nova , processes trillions... ...looking for an Engineering Manager to lead the Query team through... ...will work for Amplitude in San Francisco Bay Area of California:...PlatformWork at officeWorldwideHome officeFlexible hours$200k - $230k
...With teams in Denver, San Francisco, and New York, we’re... ...Rewards philosophy . Staff Observability Engineer Gusto’s Reliability... ..., online people platform that helps small businesses... ...expert HR, and team management tools. Today, Gusto... .... Build AI-native capabilities to...PlatformWork at officeLocal areaRemote work2 days per week3 days per week$200k - $250k
...Founding Backend Engineer, On-site — San Francisco, CA Location:... ...seed stage AI company is building... ...enterprise software. The team is developing the platform, infrastructure... ...orchestration, state management, and recovery.... ...reliability, observability, and performance...PlatformWork at officeImmediate start$145k - $195k
Platform Engineer - Reliability & Scale at LangChain - San Francisco, CA About LangChain At LangChain, our... ...-critical AI applications across... ...test, run, and manage agents at scale... ...our customers’ AI observability and LangGraph app... ...Strong hands-on software engineering skills...Platform$147.6k - $274k
...Machine Learning Engineer - Infra San Francisco, CA The Opportunity... ...and Early Development AI Drug Development (gRED... ...experience building scalable software and infrastructure,... ..., deploying, and managing infrastructure on... ...-scale ML model platforms and tools. Deep understanding...PlatformRelocation package- ...AI Prompt and Agent Engineer - San Francisco, CA Schedule: In office, five days per week Work Authorization:... ...A rapidly scaling AI operations platform supporting more than one thousand... ...understanding of LLM behavior, context management, and evaluation techniques....PlatformWork at office
$200k - $300k
...Senior Software Engineer - San Francisco, CA (onsite) A fast growing AI platform supporting more than one thousand physical locations and tens of millions of calls every year is expanding its engineering team. The company is scaling from millions of calls to billions...PlatformRemote workRelocation package$200k - $250k
...Founding Machine Learning Engineer - On-site - San Francisco, CA Location: San Francisco... ...A well-funded seed-stage AI company is building advanced... ...inside real enterprise software. The team is developing multimodal... ..., and contribute to a platform with national-level impact...PlatformWork at officeImmediate start- ...Developer Location: - San Francisco, CA 94103. We are... ...technologies. The role also leverages AI-assisted development ("vibe... ...for web and mobile platforms. Utilize AI-assisted... ...design tools. Deploy and manage applications in Microsoft Azure...Platform
$174k - $290k
...first time ever, you can manage and automate every... ...90 seconds. Based in San Francisco, CA, Rippling has raised $... ...The Rippling Developer Platform team is responsible for... ...customers are Rippling's engineers. Hundreds of them,... ...surface of the product. AI coding tools are...PlatformWork at office3 days per week$280k - $350k
...Department About Arize AI is rapidly transforming... ...the leading AI & Agent Engineering observability and evaluation platform , empowering AI engineers... ...to be based in San Francisco, CA. What you bring to the... ...Have 3+ years of sales management experience, with a track...PlatformRemote jobFull timeContract workFor contractorsWork experience placementFor subcontractorWork at officeWork from home$180k - $315k
...billing, and emerging AI-driven experiences. As a Staff Software Engineer on the Payroll... ...layers, and platform capabilities that... ...correctness and observability, and thrives in environments... ..., and lifecycle management across upstream... ...USD per year (US San Francisco Bay Area) #J-188...PlatformWork at office3 days per week- ...first time ever, you can manage and automate every... ...90 seconds. Based in San Francisco, CA, Rippling has raised $... ...addresses. About the role The AI & Data Cloud Account... ...and underlying data platform, as companies look to... ...with Solutions Engineers (SEs), Professional Services...PlatformWork at office3 days per week
$140k - $175k
AI is rapidly transforming the world. As... ...AI & Agent Engineering observability and evaluation platform , empowering AI engineers... ...an AI Solutions Manager, you’ll partner with... ...the most complex software ever deployed in production... ...York City and the San Francisco Bay Area, as an...PlatformWork experience placementRemote workWork from home- Research Engineer, Virtual Collaborator at Anthropic - San Francisco, CA | New York City, NY | Seattle, WA About Anthropic Anthropic... ..., interpretable, and steerable AI systems. We want AI to be safe... ...and scaling our data creation platform for generating high-quality, open...PlatformWork at officeVisa sponsorshipFlexible hours
$68k - $84k
...Executive, Devs.ai, North America About... ...commerce platform to sell any product... ...change how AI and software gets created and... ...founder and General Manager of the business unit... ...team, and Sales Engineering to identify... ...Sales Location San Francisco, CA, US #J-18808-Ljbffr...PlatformContract workWorldwideShift work$320k - $405k
...interpretable, and steerable AI systems. We want... ...researchers, engineers, policy experts,... ...Have 5+ years of software engineering... ...developer-facing platforms Background in... ...building monitoring or observability systems... ...headquartered in San Francisco. We offer competitive...PlatformWork at officeVisa sponsorshipFlexible hours$100k - $175k
...AI is rapidly transforming the world. As generative AI reshapes industries... ...AI is the leading AI & Agent Engineering observability and evaluation platform , empowering AI engineers to... ...requires candidates to be based in the San Francisco Bay area, though there isn't an...PlatformContract workFor contractorsWork experience placementFor subcontractorWork at officeLocal areaRemote workWork from homeAfternoon shift$184k - $259.44k
Software Engineer, Frontier AI Infrastructure San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC Ready to Apply? Join... ...vendors and customers to debug platform issues, negotiate capacity/... ...is appropriate and necessary to manage applicants’ needs, provide our...PlatformFull timeWork at office3 days per week- ...enterprise sustainability platform. Companies like... ...Martens use Watershed to manage climate and ESG data,... ...We have offices in San Francisco, New York, Denver,... ...scale a world-class engineering team, and we’re hiring... ...database architecture, observability, reliability & SLOs,...PlatformWork at officeRemote work
$210k - $285k
...Senior Full Stack Engineer | San Francisco, CA | Avg $210K–$285K +... ...A rapidly growing AI technology company is... ...and customer-facing platforms. This role offers... ...years of professional software engineering experience... ...complex frontend state management systems Strong...Platform$181k - $271k
...Machine Learning Engineer - design and... ...business. Location: San Francisco Bay Area (in‑... ...product and platform stakeholders to... ..., scalability, observability, and low‑latency... ...closely with AI/ML engineers and... ...data scientists, software engineers, product managers, and business...PlatformFull timeWork at officeFlexible hours3 days per week$145.35k - $253.23k
...currently seeking a Manager, SAP S4 Public... ...and AI driven analytics... ...SAP and non SAP platforms using SAP BTP and... ...Systems, Data Engineering, or a related field... ...holidays to be observed during the year... ...city outside of CA: California... ...Ordinance, and San Francisco Fair Chance Ordinance...PlatformH1bLocal area$145k - $190k
...Software Engineering Manager – Backend Location: San Francisco, CA, United States Location Type: On-site Salary... ...reliable, long-lived platforms that serve homeowners... ..., reliability, observability, performance, and cloud... ...experience. USE OF AI TOOLS As a technology...PlatformFor contractorsRemote work$220k - $260k
...Staff Software Engineer, Agentic Data Plane San Francisco, CA (Hybrid) Redpanda is pioneering the Agentic... ...) - a new category in AI infrastructure that... ...with Cloud, Core, and Platform engineering, as well as... ...Make resilience and observability integral to the systems...PlatformWork at office$175k - $225k
...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA, New York.... ...that power LangChain's observability and evals platform. You will work on the... ...monitor and evaluate their AI applications at scale... ...engineers, product managers, and product...PlatformWork at officeFlexible hours- ...Machine Learning Engineer (Operations) South San Francisco CA Machine Learning Engineer (Operations... ...experience in creating, managing, and deploying ML models... ...models in generative AI applications.... ...integrating external systems or platforms, such as Veeva Promomat (...Platform3 days per week
- ...opportunity for Lead Data Engineer position if... ...350 Mission Street,, San Francisco,CA,USA,94105 Duration... ...data engineering, BI platforms, and large-scale data... ...~8-10 years of software development and data... ...organized, and capable of managing multiple priorities...Platform
$175k - $240k
...Senior Fullstack Engineer In person 5 days/week in San Francisco We're looking for a Senior... ...LangSmith, an observability and evals platform. In this role, you'll... ...years of experience in software engineering working on... ...Bonus: Experience with AI/LLM-powered...PlatformWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA). Be the first to apply!
Related searches
- software product owner San Francisco, CA
- id software San Francisco, CA
- software quality assurance San Francisco, CA
- software technical writer San Francisco, CA
- mid-level software developer San Francisco, CA
- software sales San Francisco, CA
- internship software San Francisco, CA
- remote software sales San Francisco, CA
- embedded software San Francisco, CA
- software asset management analyst San Francisco, CA


