Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Solutions Architect - LLM Observability

Doist

Overview The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre‑ and post‑sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real‑world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long‑term customer success. Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large‑scale LLM‑powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments. What You’ll Do Serve as the in‑house subject matter expert for Datadog’s LLM Observability product Partner with Field teams to provide hands‑on technical and architectural guidance to enterprise customers adopting LLM Observability Create high‑impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community Build proofs of concept and small‑scale deployments to validate solutions and reproduce real‑world customer environments Act as a trusted advisor to Product Management by delivering actionable feedback informed by real‑world field experience Who You Are You bring a strong software engineering foundation, with hands‑on experience building and operating LLM‑powered applications in production environments, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation details You are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates You have experience with languages such as Python and/or JavaScript/TypeScript You are comfortable operating in rapidly evolving, ambiguous technical domains You build deep context across teams and translate it into reusable, scalable solutions You take ownership from problem definition through implementation and measurable outcomes You are highly detail‑oriented, particularly when working on architectures and customer‑facing technical assets You bring strong listening and consultative skills and are experienced supporting customers in high‑pressure, complex situations Able to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time BonusPoints Successful track record with 5+ years of experience working as an Architect or Consultant Experience using Datadog and/or other observability tools in an SRE or DevOps capacity Experience with LLM application evaluation and testing frameworks Benefits and Growth Best‑in‑breed onboarding Generous global benefits Intra‑departmental mentor and buddy program for in‑house networking New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing An inclusive company culture, able to join Community Guilds and Inclusion Talks Healthcare, dental, parental planning, and mental health benefits 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan Equal Opportunity at Datadog Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. #J-18808-Ljbffr Doist

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Solutions Architect - LLM Observability in San Francisco, CA vacancy
  • $151.5k - $222k

    The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog....  ...long-term customer success. Datadog’s LLM Observability product enables organizations to...  ...cost management. As a Product Solutions Architect, you will partner closely with Datadog... 
    Suggested
    Work at office

    Datadog

    San Francisco, CA
    4 days ago
  • $151.5k - $222k

    A SaaS company in San Francisco is seeking a Product Solutions Architect to lead implementation of their LLM Observability product. You'll collaborate with customers to design architectures and drive product adoption through technical guidance. The ideal candidate has a... 
    Suggested

    Datadog

    San Francisco, CA
    1 day ago
  • ClickHouse is seeking a Langfuse Solutions Architect to enhance AI observability for engineering teams. In this role, you will lead technical evaluations,...  ...to the ClickHouse + Langfuse platform, advocate for product improvements, and build relationships in the AI community... 
    Suggested
    Remote job

    ClickHouse

    San Francisco, CA
    14 hours ago
  • Product Solutions Architecture (PSA) Team The Product Solutions Architecture (PSA) team acts as...  ...applications. As a Product Solutions Architect, you will partner closely with Datadog...  ...Experience using Datadog and/or other observability tools with Product Analytics or Feature... 
    Suggested
    Work at office
    Shift work

    Doist

    San Francisco, CA
    1 day ago
  •  ...operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M...  ...engineers turn to to ship AI products. THE ROLE As a Solution Architect (AI/LLM Inference) at Baseten you will partner closely with Sales... 
    Suggested
    Flexible hours

    Baseten

    San Francisco, CA
    3 days ago
  •  ...seeking a Mid-Senior Level Engineer for a full-time role focused on LLM applications in San Francisco. You'll engage with companies, delivering technical demos and collaborating closely to refine product features. The ideal candidate has 3+ years of experience in... 
    Full time

    Reval Recruiting

    San Francisco, CA
    14 hours ago
  • $300k

    Datadog is looking for a customer-focused Distinguished Architect to join their Product Solutions Architecture team. This role involves influencing key decision...  ...systems and is deeply knowledgeable about the AI/LLM ecosystem. Datadog offers a hybrid workplace and a competitive... 

    Datadog

    San Francisco, CA
    14 hours ago
  • $125k - $165k

    About the Role We’re looking for a Product and Solutions Marketing Manager to help drive go-to-market...  ...giving organizations the security, observability, and API extensibility they need to deploy...  ...SaaS platforms. Familiarity with the LLM, agent, or AI application development... 
    Work at office
    Flexible hours
    Shift work

    Langchain

    San Francisco, CA
    2 days ago
  • $176k - $301k

     ..., v0, and AI SDK, we create products that help builders move from...  ...next. About the Role: As a Solution Architect in the Field Engineering team...  ...Web Vitals, Lighthouse, and observability data to drive continuous...  ...security fundamentals, ideally AI/LLM powered applications and... 
    Work from home
    Worldwide
    Flexible hours

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  • $200k - $250k

     ...Senior Solutions Architect, Commercial - SF United States - Remote Opportunity...  ...their use of Temporal in production. The nature of our business...  ...systems (reliability, observability, and fault tolerance) Proven...  ...in agentic workflows and LLM orchestration Strong... 
    Remote work
    Work from home
    Home office

    Temporal Technologies

    San Francisco, CA
    2 days ago
  • $143k - $210k

     ...networking through orchestration, observability, and the broader AI tooling...  ...with Sales, Support, Product, and Engineering to deliver...  ...CoreWeave. We hire technical, AI Solution Architects who want to operate the full...  ...models, including modern LLM architectures Experience designing... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Somi AI

    San Francisco, CA
    2 days ago
  • Job Summary To define SAP S/4 Hana PP solution architecture for complex business requirements and established standards in line with the...  ...ensure knowledge up-gradation and work with new and emerging products/technologies. To drive innovation by exploring and recommending... 

    HCLTech

    San Francisco, CA
    14 hours ago
  • $200k - $300k

     ...Deployed Engineer (FDE) - AI & Solutions Join us at Zendesk, where...  ...that ambition by building products rooted in AI, automation,...  ...into robust integrations, architect LLM‑powered workflows, and collaborate...  ...platforms. Background in observability and operationalization of... 

    Zendesk

    San Francisco, CA
    14 hours ago
  • Baseten is seeking a Solution Architect (AI/LLM Inference) to work closely with Sales and customers in San Francisco. This role involves translating business needs into technical solutions, conducting demos, and managing POCs. Ideal candidates will possess a strong AI/... 

    Baseten

    San Francisco, CA
    3 days ago
  • A dynamic tech startup is seeking a Solutions Architect to help customers implement and scale AI solutions. In this role, you will collaborate...  ...with a strong technical background in Python and AI/ML products. Join us to play a critical role where you will influence product... 

    LiteLLM

    San Francisco, CA
    3 days ago
  • $185k - $251k

     ...CIA) team is hiring a Senior Product Architect, Internal Tools (f/m/d) to...  ...efforts to identify high‑leverage solutions, then determine which ideas...  ..., data flows, resilience, observability, and robust internal user...  ...Practical experience with AI and LLM‑based workflows,... 
    Full time
    Work at office
    Worldwide

    Contentful Inc

    San Francisco, CA
    4 days ago
  • New Relic seeks a Partner Solution Consultant to lead partner engagements and provide technical enablement. In this role, you'll develop...  ...workshops, while ensuring partners achieve success with observability solutions. The ideal candidate has over 5 years of experience... 

    New Relic

    San Francisco, CA
    14 hours ago
  • Harrison Clarke is seeking an AI Agent Engineer to design and build production-grade AI agents for enterprise workflows. This role focuses on...  ...environments. The ideal candidate will have experience with LLM-powered systems, strong knowledge of agent architecture, and... 

    Harrison Clarke

    San Francisco, CA
    14 hours ago
  •  ...Y Combinator, etc.) and we believe in product‑led growth, where we build something awesome...  ...landscape. The Role: As an Airbyte Solutions Architect, you will have a unique opportunity to...  ...customers. Advise customers on integrating LLM‑based tooling into their existing data... 
    Local area
    Immediate start
    3 days per week

    Airbyte

    San Francisco, CA
    4 days ago
  •  ...FuriosaAI is looking for a Solutions Architect to bring the full potential of our powerful RNGD chips...  ...the primary technical authority in AI/LLM model deployments. From running POCs to...  ...from US customers back to Seoul HQ product and engineering teams Qualifications 2–... 

    FuriosaAI, Inc.

    San Francisco, CA
    2 days ago
  • $135k - $180k

     ...functions, input tables with LLM enrichment, MCP integration,...  ...native agent patterns. You can architect Sigma agents and warehouse...  ...to maintain. About the role Solution Architects are the senior technical...  ...partner closely with Sales, Product, Engineering, and Support.... 
    Full time
    Work at office
    Flexible hours
    Weekend work

    Sigma Computing

    San Francisco, CA
    14 hours ago
  • Dynatrace LLC is seeking a Pre-Sales Solutions Architect in San Francisco, CA, to serve as a technical...  ...joint solutions and influencing product strategy. The ideal candidate should have...  ...in cloud-native architectures and observability. Dynatrace fosters innovation with a flexible... 
    Flexible hours

    Dynatrace LLC

    San Francisco, CA
    1 day ago
  • $160k - $180k

    Job Summary The Solutions Architect - Strategic Projects is a skilled individual contributor embedded...  ...‑to‑end test plans for complex, multi‑product implementations; evaluate...  ...contribute improvements based on field observations. Serve as a reliable escalation resource... 
    Work at office
    Local area
    Flexible hours

    OpenGov

    San Francisco, CA
    14 hours ago
  •  ...Meet DeepL DeepL is a global AI product and research company focused...  ...building secure, intelligent solutions to complex business problems....  .... As a Solution Architect on our global solution consulting...  ...and speech-to-speech systems, LLM-based conversational AI, WebSocket... 
    Work at office
    Worldwide
    Flexible hours

    DeepL

    San Francisco, CA
    14 hours ago
  • $150k - $175k

    Solutions Architect (AI Infrastructure) - San Francisco, CA Salary: USD 150,000-USD 175,000 per annum...  ...growing AI startup at the heart of the LLM ecosystem. The team is building a...  ...‑world insights directly back into the product roadmap. You’ll operate as the bridge between... 

    Rise Technical Recruitment Limited

    San Francisco, CA
    14 hours ago
  •  ...The Opportunity Liquid AI is building a solutions architecture function from scratch. You will...  ...and new-experience use cases Co-own the product-field feedback loop: document friction...  ...model serving frameworks (vLLM, TensorRT-LLM, llama.cpp), and hardware-aware optimization... 

    Liquid AI

    San Francisco, CA
    14 hours ago
  • $171k - $215k

     ...beyond our screens. About The Role As a Solutions Architect at Niantic Spatial, you’ll own...  ...platforms. You’ll partner closely with Product Management so customer requirements shape...  ...stacks, enterprise integration patterns, observability, and device constraints. Define... 
    Work at office
    Remote work
    3 days per week

    Niantic Spatial, Inc.

    San Francisco, CA
    14 hours ago
  •  ...). About the Role We're looking for a Solutions Architect to collaborate with our key customers,...  ...successfully deploy and scale LiteLLM in production. You'll work directly with customers...  ...businesses—our customers run ALL their LLM calls through LiteLLM. You enjoy the autonomy... 

    LiteLLM

    San Francisco, CA
    3 days ago
  • $300k - $405k

    As the leader of the Solutions Architects team at Anthropic, you will drive the adoption of frontier AI by developing bespoke LLM solutions for top enterprises. You’ll leverage your technical...  ...team member achieve success, high productivity, and career growth, and represent... 
    Work at office
    Home office
    Visa sponsorship
    Relocation package

    Anthropic

    San Francisco, CA
    14 hours ago
  • $125.9k - $231.1k

     ...better working world. Microsoft 365 AI Solution Architect (Manager) EY advises clients to...  ...IEC 42001, NIST AI RMF, EU AI Act, OWASP LLM Top 10. Ideally, you’ll also have...  ...minimum of 18 days of vacation plus twelve observed holidays and 10 personal care days, and... 
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Solutions Architect - LLM Observability. Be the first to apply!