Product Solutions Architect - LLM Observability
$151.5k - $222kDatadog
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre- and post-sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real-world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long-term customer success. Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large-scale LLM-powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Serve as the in-house subject matter expert for Datadog’s LLM Observability product Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience Who You Are: You bring a strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation details You are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates You have experience with languages such as Python and/or JavaScript/TypeScript You are comfortable operating in rapidly evolving, ambiguous technical domains You build deep context across teams and translate it into reusable, scalable solutions You take ownership from problem definition through implementation and measurable outcomes You are highly detail-oriented, particularly when working on architectures and customer-facing technical assets You bring strong listening and consultative skills and are experienced supporting customers in high-pressure, complex situations Able to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time Bonus Points: Successful track record with 5+ years experience working as an Architect or Consultant Experience using Datadog and/or other observability tools in an SRE or DevOps capacity Experience with LLM application evaluation and testing frameworks Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: Best-in-breed onboarding Generous global benefits Intra-departmental mentor and buddy program for in-house networking New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing An inclusive company culture, able to join our Community Guilds and Inclusion Talks Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan. The reasonably estimated yearly salary for this role at Datadog is:
$151,500—$222,000 USD
About Datadog: Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog: Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines: Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines. #J-18808-Ljbffr Datadog$151.5k - $222k
A SaaS company in San Francisco is seeking a Product Solutions Architect to lead implementation of their LLM Observability product. You'll collaborate with customers to design architectures and drive product adoption through technical guidance. The ideal candidate has a...Suggested$170k - $190k
...developers move from prototypes to production-ready AI agents that teams... ...includes LangSmith (Observability, Evaluation, Deployment, Fleet... ...We're looking for a Solutions Architect to join our Professional Services... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...SuggestedTemporary workWork at officeFlexible hours- ...systems they read from, not just observe them. We started as the... ...context infrastructure for production-grade agents on the same... ...The Role: As an Airbyte Solutions Architect, you will have a unique opportunity... ...customers on integrating LLM-based tooling into their...SuggestedWork at officeLocal areaImmediate startFlexible hours
$176k - $301k
..., v0, and AI SDK, we create products that help builders move from... ...next. About the Role: As a Solution Architect in the Field Engineering team... ...Web Vitals, Lighthouse, and observability data to drive continuous improvement... ...fundamentals, ideally AI/LLM powered applications and...SuggestedWork from homeWorldwideFlexible hours$170k - $190k
...Solutions Architect We're looking for a Solutions Architect to join our... ...design, deploy, and optimize production-grade AI infrastructure and... ..., secrets management), and observability (Prometheus, Grafana,... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...SuggestedTemporary work$180k - $247.5k
Databricks Inc. is looking for a Specialist Solutions Architect (SSA) focused on AI/ML Engineering to guide customers in building production-grade ML applications. You will work closely with Solution Architects to ensure alignment with the Databricks platform and serve...Remote job- Dormont Manufacturing Co is looking for a Solutions Architect in San Francisco. This role involves collaborating with customers to deploy and... ...technical background, particularly with Python and AI products. The position offers an attractive compensation package including...
- Baseten is seeking a Solution Architect (AI/LLM Inference) to work closely with Sales and customers in San Francisco. This role involves translating business needs into technical solutions, conducting demos, and managing POCs. Ideal candidates will possess a strong AI/...
- A dynamic tech startup is seeking a Solutions Architect to help customers implement and scale AI solutions. In this role, you will collaborate... ...with a strong technical background in Python and AI/ML products. Join us to play a critical role where you will influence product...
$143k - $210k
...networking through orchestration, observability, and the broader AI tooling... ...with Sales, Support, Product, and Engineering to deliver... ...CoreWeave. We hire technical, AI Solution Architects who want to operate the full... ...models, including modern LLM architectures Experience designing...Permanent employmentTemporary workCasual workWork at officeFlexible hours- ...job FriendliAI is seeking a Solution Architect to assist enterprises in... ...customers to solve and implement production-grade applications using... ...architectures for LLM and multimodal inference Deploy... ...our platform reliability, observability, and scaling strategies Lead...Temporary workFlexible hours
- ...The Opportunity Liquid AI is building a solutions architecture function from scratch. You will... ...and new-experience use cases Co-own the product-field feedback loop: document friction... ...model serving frameworks (vLLM, TensorRT-LLM, llama.cpp), and hardware-aware optimization...
- ...FuriosaAI is looking for a Solutions Architect to bring the full potential of our powerful RNGD chips... ...the primary technical authority in AI/LLM model deployments. From running POCs to... ...from US customers back to Seoul HQ product and engineering teams Qualifications 2–...
$160k - $180k
...is the leader in AI and ERP solutions for local and state governments... ...trust. Category-leading products include enterprise asset management... ...Summary: The Solutions Architect - Strategic Projects is a... ...improvements based on field observations. Serve as a reliable...Contract workWork at officeLocal areaFlexible hours- ....). About the Role We're looking for a Solutions Architect to collaborate with our key customers,... ...successfully deploy and scale LiteLLM in production. You'll work directly with customers... ...businesses—our customers run ALL their LLM calls through LiteLLM. You enjoy the autonomy...
- ...beyond our screens. About the Role As a Solutions Architect at Niantic Spatial, you’ll own... ...platforms. You’ll partner closely with Product Management so customer requirements shape... ...stacks, enterprise integration patterns, observability, and device constraints. Define...Work at officeRemote work3 days per week
- ...Akron, Cincinnati, Miami Microsoft 365 AI Solution Architect (Manager) EY advises clients to... ...001, NIST AI RMF, EU AI Act, and OWASP LLM Top 10. Desired Additional Qualifications... .... Minimum 18 days vacation plus twelve observed holidays and 10 personal care days. Programs...
- ...Careers Product & Engineering Senior Solution Architect - Hands On San Francisco, CA - Hybrid - Full-Time - Senior Level - Posted May 28, 2026 Join a high-... ...Genesys, NICE, Five9, etc.). Hands-on experience with LLM evaluation frameworks, prompt engineering, or fine-tuning...Full time
- ...js, REST APIs, and GraphQL. Architect single-page applications (SPA... ..., data flows, integration, observability, and deployment topology. Cloud... ...fault-tolerant, and secure solutions using key AWS services: VPC,... ...quality. Collaborate with product owners, UX, DevOps, and QA to...Hourly payPermanent employmentContract workLocal area
- .... From MCP integrations with LLM providers to enterprise marketplace... ...This role combines hands‑on solution building, enterprise customer... ...Gamma into their own products. For every integration Gamma... ...directly with B2B customers Architect integration workflows with enterprise...Work at officeWork from home
$220k - $280k
...About the team The Solutions Architecture team is responsible for ensuring... ...industry and drive them to production through strong technical... ...proficient, business-minded Solutions Architect to help push the frontier of... ..., and a strong grasp of AI/LLM best practices. Built and/or...Work at officeRelocation package$124.74k - $254.5k
...currently seeking a Lead Specialist, AI Solution Architect to join our KPMG Managed Services... ...initiatives through transition into production-ready, operational platforms. Translate... ..., orchestration, state management, observability, and interoperable workflows that...H1bLocal area$175k - $240k
Solutions Architect, Digital Natives (OpenAI OpCo, LLC; San Francisco, CA) Serve as the primary... ...practices for scaling solutions in production. Maintain strong relationships with leadership... ...basics around bastions and VPCs; Observability tooling: Datadog and Humio; and...Remote work$240k - $315k
...at Anthropic, you will be a Pre‑Sales architect focused on becoming a trusted technical... ...‑facing skills to architect innovative LLM solutions that address complex business challenges... ...business. Working closely with our Sales, Product, and Engineering teams, you’ll guide...Visa sponsorship- ...beyond our screens. About the Role As a Solutions Architect for Niantic Spatial’s Public Sector... ...aligned capabilities that scale into production and transition to larger programs of... ..., enterprise integration patterns, observability, and device constraints. Define integration...Work at officeRemote work3 days per week
$103.96k - $142.95k
We’re looking for an AI Agent Solutions Architect for our Datagrid division to lead the design, customization... ...who thrives at the intersection of LLM architecture and customer... ...ecosystems. You’ll work cross-functionally with product, engineering, and customer teams to...Local area$230k - $300k
...and perspectives at AHEAD. AHEAD’s Sr. Observability Solutions Engineers are the technical experts... ...clients, responsible for designing, architecting technical solutions Support the sales... ...team members Possess strong, detailed product/technology/industry knowledge...$172.5k - $260.1k
...lifecycle - manage configuration changes, deploy updates, and debug issues in the production environment without requiring outside engineering support Experience: Built or deployed LLM‑based agentic workflows (not just chatbots) Hands‑on experience with agent orchestration...- EvenUp in San Francisco is seeking a Sr. Product Solutions Manager who will drive the successful onboarding of enterprise customers while managing complex data configurations and reports. This critical role blends program management and customer success, ensuring client...
$180k - $247.5k
As a Specialist Solutions Architect (SSA) - AI/ML Engineering, you will be the trusted technical... ...to guide customers in architecting production-grade ML & AI applications on Databricks... ...structured data, AI evaluation and observability, and monitoring systems Build, scale...Local areaRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Solutions Architect - LLM Observability. Be the first to apply!
- solutions architect San Francisco, CA
- senior cloud solutions architect San Francisco, CA
- aws solution architect San Francisco, CA
- entry level aws solution architect San Francisco, CA
- solution engineering manager San Francisco, CA
- business solutions architect San Francisco, CA
- mobile solution architect San Francisco, CA
- senior solution manager San Francisco, CA
- solution architect contract San Francisco, CA
- senior solutions architect San Francisco, CA

