Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Solutions Architect - LLM Observability

$151.5k - $222k

Datadog

The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre- and post-sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real-world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long-term customer success. Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large-scale LLM-powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Serve as the in-house subject matter expert for Datadog’s LLM Observability product Partner with Field teams to provide hands‑on technical and architectural guidance to enterprise customers adopting LLM Observability Create high‑impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community Build proofs of concept and small‑scale deployments to validate solutions and reproduce real‑world customer environments Act as a trusted advisor to Product Management by delivering actionable feedback informed by real‑world field experience Who You Are: You bring a strong software engineering foundation, with hands‑on experience building and operating LLM‑powered applications in production environments, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation details You are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates You have experience with languages such as Python and/or JavaScript/TypeScript You are comfortable operating in rapidly evolving, ambiguous technical domains You build deep context across teams and translate it into reusable, scalable solutions You take ownership from problem definition through implementation and measurable outcomes You are highly detail‑oriented, particularly when working on architectures and customer‑facing technical assets You bring strong listening and consultative skills and are experienced supporting customers in high‑pressure, complex situations Able to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time Bonus Points: Successful track record with 5+ years experience working as an Architect or Consultant Experience using Datadog and/or other observability tools in an SRE or DevOps capacity Experience with LLM application evaluation and testing frameworks Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: Best‑in‑breed onboarding Generous global benefits Intra‑departmental mentor and buddy program for in‑house networking New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing An inclusive company culture, able to join our Community Guilds and Inclusion Talks Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan. The reasonably estimated yearly salary for this role at Datadog is: $151,500—$222,000 USD About Datadog: Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people‑first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog: Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines: Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines. #J-18808-Ljbffr Datadog

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Product Solutions Architect - LLM Observability in San Francisco, CA vacancy
  • $185k - $246k

    The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog....  ...long-term customer success.Datadog’s LLM Observability product enables organizations to monitor...  ...management. As a Product Solutions Architect, you will partner closely with... 
    Suggested
    Work at office

    Datadog

    San Francisco, CA
    1 day ago
  • $151.5k - $222k

    A SaaS company in San Francisco is seeking a Product Solutions Architect to lead implementation of their LLM Observability product. You'll collaborate with customers to design architectures and drive product adoption through technical guidance. The ideal candidate has a... 
    Suggested

    Datadog

    San Francisco, CA
    2 days ago
  • $190k - $340k

     ..., v0, and AI SDK, we create products that help builders move from...  ...About the Role: As a Solution Architect in the Field Engineering team...  ...Web Vitals, Lighthouse, and observability data to drive continuous improvement...  ...fundamentals, ideally AI/LLM powered applications and... 
    Suggested
    Work from home
    Worldwide
    Flexible hours

    Vercel

    San Francisco, CA
    1 day ago
  • $182k - $242k

     ...networking through orchestration, observability, and the broader AI tooling...  ...with Sales, Support, Product, and Engineering to deliver...  ...CoreWeave. We hire technical, AI Solution Architects who want to operate the full...  ...models, including modern LLM architectures ~ Experience... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    13 days ago
  • $185k - $251k

     ...CIA) team is hiring a Senior Product Architect, Internal Tools (f/m/d) to...  ...efforts to identify high-leverage solutions, then determine which ideas...  ..., data flows, resilience, observability, and robust internal user...  ...HavePractical experience with AI and LLM-based workflows,... 
    Suggested
    Work at office
    Local area
    Worldwide

    Contentful

    San Francisco, CA
    4 days ago
  • $185k - $251k

     ...CIA) team is hiring a Senior Product Architect, Internal Tools (f/m/d) to...  ...efforts to identify high-leverage solutions, then determine which ideas...  ..., data flows, resilience, observability, and robust internal user...  ...Practical experience with AI and LLM-based workflows,... 
    Full time
    Work at office
    Local area
    Worldwide

    Contentful Inc

    San Francisco, CA
    4 days ago
  • $135k - $180k

    Solution ArchitectSigma ComputingThe SA role has evolved. Here’s the...  ...functions, input tables with LLM enrichment, MCP integration,...  ...native agent patterns. You can architect Sigma agents and warehouse...  ...partner closely with Sales, Product, Engineering, and Support. Prospects... 
    Full time
    Work at office
    Weekend work

    Sigma Computing

    San Francisco, CA
    2 days ago
  • $153.6k - $207.8k

     ...unique challenges, then craft innovative solutions that accelerate their success. This...  ...Services (AWS) is seeking a Senior Solutions Architect to join our ISV Team. In this role, you'...  ...as they build and enhance their products on AWS* Participate in deep architectural... 
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    3 days ago
  • $115k - $143k

     ...We're seeking a Solutions Architect that is excited to help guide customers in adopting Pulumi's...  ...decisions and best practices. Deliver product and technical presentations to potential...  ...AI across all of these areas with our LLM-powered Pulumi Copilot to push the boundaries... 
    Full time
    Local area
    Remote work
    Flexible hours

    Pulumi Corporation

    San Francisco, CA
    2 days ago
  •  ...Solutions Architect Liquid AI is building a solutions architecture function from scratch. You...  ...new-experience use cases Co-own the product-field feedback loop: document friction...  ...model serving frameworks (vLLM, TensorRT-LLM, llama.cpp), and hardware-aware... 

    Liquid AI

    San Francisco, CA
    3 days ago
  •  ...in software engineering or solution architecture, with demonstrable...  ...training and serving, and production MLOpsProficiency in modern cloud...  ...of deployment pipelines, observability, performance optimization,...  ...DOAs a Principal AI Solution Architect at McKinsey, you will combine... 
    Apprenticeship
    Immediate start
    Easy work
    Flexible hours

    McKinsey & Company

    San Francisco, CA
    1 day ago
  • $176.6k - $239k

     ...challenges, then craft innovative solutions that accelerate their success...  ..., optimize, and scale their products on AWS — unlocking growth...  ...generative AI architectures: LLM integration patterns, RAG, agentic...  ...certifications: (Solutions Architect Professional, DevOps Engineer... 
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    2 days ago
  • $175k - $233.67k

     ...best-in‑class cybersecurity solutions for our customers; all while...  ...seeking a Principal Solutions Architect to drive the technical depth...  ...assistants, AI‑powered research and productivity tools) to accelerate work...  ...agentic AI architectures, LLM integrations, or Amazon Bedrock... 
    H1b
    Local area
    Flexible hours

    Embedded Shishya

    San Francisco, CA
    1 day ago
  • $149k - $199k

    We are Datadog's in-house product experts. The technical solutions team enables Datadog's worldwide growth by...  ...and successful.The Partner Solution Architect (PSA) is a Datadog expert who will...  ...or more of the following areas:Observability: Datadog, Splunk, AppD, New Relic... 
    Work at office
    Worldwide

    Datadog

    San Francisco, CA
    2 days ago
  • $176.6k - $239k

     ...platform is headed next? As a Specialist Solutions Architect for Aurora PostgreSQL, you will be...  ...and CTOs to design well architected production architectures that hold up under real...  ...availability & durability, monitoring & observability, maintenance & patching, backup &... 
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    2 days ago
  •  ...platform that turns natural language into production-grade workflows. Our agents don’t just...  .... Role Overview This is our founding Solutions Architect: the first technical seller at Serval...  ...AI frontier, fluent in how agents and LLM‑powered systems get deployed and governed... 

    Serval

    San Francisco, CA
    3 days ago
  • $160k - $180k

     ...is the leader in AI and ERP solutions for local and state governments...  ...trust. Category‑leading products include enterprise asset management...  ...Job Summary: The Solutions Architect - Strategic Projects is a...  ...improvements based on field observations. Serve as a reliable... 
    Contract work
    Work at office
    Local area
    Flexible hours

    OpenGov

    San Francisco, CA
    5 days ago
  • $102 - $107 per hour

     ...hiring! Stefanini is looking for Sr Solution Architect-Remote For quick apply, please...  ...processing errors. Monitor application, production and/or implementation support, both...  ...testing strategies, document observations and coordinate responses. Maintain... 
    Remote work
    Monday to Friday

    Stefanini

    San Francisco, CA
    4 days ago
  • $125.9k - $231.1k

     ...better working world. Microsoft 365 AI Solution Architect (Manager) EY advises clients to...  ...IEC 42001, NIST AI RMF, EU AI Act, OWASP LLM Top 10. Ideally, you’ll also have...  ...minimum of 18 days of vacation plus twelve observed holidays and 10 personal care days, and... 
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    4 days ago
  •  ...Role: Principal NVIDIA AI Factory Solutions Architect Location: Bay Area, CA FTE Only...  ...to architect, co-design, and bring to production end-to-end AI Factory solutions - from...  ...NVMe-oF storage AI Workloads: LLM training/fine-tuning, Agentic AI deployment... 
    Full time

    Acestack

    San Francisco, CA
    1 day ago
  • $151.5k - $346k

     ...ambitious organizations. Using our product-driven, AI-centric approach,...  ...As a Senior Manager in Solution Architecture, you will be at...  ...process. As a Software Architect, you will: ~ Partner with customer...  ...and delivering AI/ML or LLM-based business solutions in production... 
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    5 days ago
  • $190k - $250k

    Perplexity is changing how enterprises adopt AI. We're seeking a Solutions Product Marketer to own GTM strategy for our highest-priority verticals, Finance, Healthcare, Legal, and Consulting. You'll go deep on buying motions, use cases, and competitive dynamics, translating... 
    Local area

    Perplexity AI

    San Francisco, CA
    1 day ago
  • $220k - $280k

    About the team The Solutions Architecture team is responsible for ensuring...  ...industry and drive them to production through strong technical...  ...proficient, business-minded Solutions Architect to help push the frontier of...  ..., and a strong grasp of AI/LLM best practices. Built and/or... 
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    2 days ago
  • $140k

    AI Solution Architect We are seeking an AI Solution Architect to design and deliver production‑ready AI integrations and agent workflows using Gemini Enterprise (Agentspace) and...  ...Gateway, Terraform, CI/CD. Strong knowledge of LLM integrations, RAG pipelines, embeddings,... 
    Work experience placement

    Artha Nexgen

    San Francisco, CA
    1 day ago
  • Overview We are hiring an AI Solutions Architect to design and implement machine learning and LLM solutions for customer projects. The role requires strong skills...  ...implementation, and ensure systems perform reliably in production. You will support integration into customer... 
    Flexible hours

    Terra Quantum AG

    San Francisco, CA
    1 day ago
  • Senior Solution Architect Cloud & Data Platforms Job ID: J53046 Location: San Francisco, CA Duration...  ...layers, data flows, integration, observability, and deployment topology. Cloud...  ..., and code quality. Collaborate with product owners, UX, DevOps, and QA to ensure cohesive... 
    Hourly pay
    Permanent employment
    Contract work
    H1b
    Local area

    MACHINE LEARNING TECHNOLOGIES LLC

    San Francisco, CA
    4 days ago
  •  ...implementation and transition. Design end-to-end solution architectures (logical and physical)...  ..., coordinating across engineering and product to shape compliant, compelling...  ...services, enterprise integration patterns, observability, and device constraints. Define... 

    Jobtailor

    San Francisco, CA
    3 days ago
  • $80k - $120k

     ...have gone from research to agents running production workloads inside real companies, on...  ...consequential problems in technology, and the AI Solutions Architect sits at the sharpest edge of it: your...  ...Genuine curiosity about agentic AI and LLM systems: prompt/tool design, evals,... 
    Contract work

    NinjaTech AI Inc.

    San Francisco, CA
    1 day ago
  • $143k - $210k

     ...networking through orchestration, observability, and the broader AI tooling...  ...with Sales, Support, Product, and Engineering to deliver...  ...CoreWeave. We hire technical, AI Solution Architects who want to operate the full...  ...models, including modern LLM architectures ~ Experience... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    2 days ago
  • $160k - $180k

     ...Siri, Watson, and virtually every human language technology product on the market. Now we’re building an industry-leading knowledge...  ...productivity with unmatched accuracy and speed.As a Solutions Architect at Pryon, you will be at the forefront of translating federal... 
    Full time
    Temporary work
    Remote work

    Pryon

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Solutions Architect - LLM Observability. Be the first to apply!