Product Solutions Architect - LLM Observability
$151.5k - $222kDatadog
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre- and post-sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real-world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long-term customer success. Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large-scale LLM-powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Serve as the in-house subject matter expert for Datadog’s LLM Observability product Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience Who You Are: You bring a strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation details You are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates You have experience with languages such as Python and/or JavaScript/TypeScript You are comfortable operating in rapidly evolving, ambiguous technical domains You build deep context across teams and translate it into reusable, scalable solutions You take ownership from problem definition through implementation and measurable outcomes You are highly detail-oriented, particularly when working on architectures and customer-facing technical assets You bring strong listening and consultative skills and are experienced supporting customers in high-pressure, complex situations Able to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time Bonus Points: Successful track record with 5+ years experience working as an Architect or Consultant Experience using Datadog and/or other observability tools in an SRE or DevOps capacity Experience with LLM application evaluation and testing frameworks Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: Best-in-breed onboarding Generous global benefits Intra-departmental mentor and buddy program for in-house networking New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing An inclusive company culture, able to join our Community Guilds and Inclusion Talks Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan. The reasonably estimated yearly salary for this role at Datadog is:
$151,500—$222,000 USD
About Datadog: Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog: Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines: Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines. #J-18808-Ljbffr Datadog$151.5k - $222k
A SaaS company in San Francisco is seeking a Product Solutions Architect to lead implementation of their LLM Observability product. You'll collaborate with customers to design architectures and drive product adoption through technical guidance. The ideal candidate has a...Suggested$105 - $115 per hour
...Solution Architect (Principal Enterprise Architecture- Product-to-Market) Contract (1 Year + Possible extension) San Francisco, CA or Pleasanton, CA (Onsite... ...Qualifications: Familiarity with Agentic AI or LLM applications in P2M automation or Employees...SuggestedContract work- ...operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M... ...engineers turn to to ship AI products. THE ROLE As a Solution Architect (AI/LLM Inference) at Baseten you will partner closely with Sales...SuggestedFlexible hours
$170k - $190k
...developers move from prototypes to production-ready AI agents that teams... ...includes LangSmith (Observability, Evaluation, Deployment, Fleet... ...We're looking for a Solutions Architect to join our Professional Services... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...SuggestedTemporary workWork at officeFlexible hours$176k - $301k
...Solutions Architect Hybrid - San Francisco, New York City, Austin About... ...v0, and AI SDK, we create products that help builders move... ...Web Vitals, Lighthouse, and observability data to drive continuous improvement... ...fundamentals, ideally AI/LLM powered applications and...SuggestedWork from homeWorldwideFlexible hours$225k - $275k
...analytics, data warehousing, observability, and AI workloads. The... ...Langfuse - the leading open source LLM observability platform -... ...core part of the ClickHouse product stack. Together, ClickHouse... ...We're looking for a Langfuse Solutions Architect who is already embedded in...Local areaRemote workHome officeFlexible hours$170k - $190k
...Solutions Architect We're looking for a Solutions Architect to join our... ...design, deploy, and optimize production-grade AI infrastructure and... ..., secrets management), and observability (Prometheus, Grafana,... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...Temporary work$143k - $210k
...networking through orchestration, observability, and the broader AI tooling... ...with Sales, Support, Product, and Engineering to deliver... ...CoreWeave. We hire technical, AI Solution Architects who want to operate the full... ...models, including modern LLM architectures ~ Experience...Permanent employmentTemporary workCasual workWork at officeFlexible hours- ...Baseten is seeking a Solution Architect (AI/LLM Inference) to work closely with Sales and customers in San Francisco. This role involves translating business needs into technical solutions, conducting demos, and managing POCs. Ideal candidates will possess a strong AI...
- ...AI Solutions Architect - Agentic AI Platforms ROLE OVERVIEW BayOne... ...Knowledge Systems: Architect production-grade RAG pipelines with vector... .... • Traceability & Observability: Instrument agent reasoning... ...least 3 years architecting LLM-based or agentic AI systems...
- ...and ingress/egress for production workloads at massive... ...workloads on top of us — LLM gateways, agent-to-... ...need someone who can architect that layer with them,... ...auth, rate limiting, and observability. Agent-to-agent communication... ...technical role — Solutions Architect, Customer...Remote workWork from homeFlexible hours
$180k - $247.5k
...Databricks Inc. is looking for a Specialist Solutions Architect (SSA) focused on AI/ML Engineering to guide customers in building production-grade ML applications. You will work closely with Solution Architects to ensure alignment with the Databricks platform and serve...Remote work- ...Data Security Solutions Engineer / Architect Cyberhaven is re-imagining data loss prevention (DLP) with its ground-breaking Data Detection and... ...solutions engineer / architect to make an outsized impact on the product, and as a result improve data security for 100s of...
- ...A dynamic tech startup is seeking a Solutions Architect to help customers implement and scale AI solutions. In this role, you will collaborate... ...with a strong technical background in Python and AI/ML products. Join us to play a critical role where you will influence product...
- ...jobr.pro is looking for a Solutions Architect/Sales Engineer in San Francisco. You’ll own the technical sales process for a pioneering AI infrastructure product loved by top engineering teams like Adobe and NASA. In this role, you'll conduct technical demos and support...
$200k - $250k
...Temporal is looking for a Senior Solutions Architect to support our Commercial... ...their use of Temporal in production. The nature of our business... ...systems (reliability, observability, and fault tolerance) Proven... ...cases in agentic workflows and LLM orchestration Strong...Remote workWork from homeHome office$150k - $220k
...focuses on placing the best product managers, software, and hardware... ...to help them hire. Solutions Architect / Sales Engineer Location... ...integrations across 100+ LLM providers including OpenAI,... ...optimize routing, reliability, observability, and deployment architecture...Work at officeRemote work- ...firm in San Francisco seeks a Member of Technical Staff in Applied ML to provide custom ML solutions for enterprise clients. The role involves understanding customer needs, shaping LLM capabilities, and contributing to foundational model improvements. Ideal candidates...Full time
- ...FriendliAI is seeking a Solution Architect to assist enterprises in deploying... ...to solve and implement production-grade applications using our... ...architectures for LLM and multimodal inference... ...our platform reliability, observability, and scaling strategies...Temporary workFlexible hours
$102k - $138k
...Full time Location Type Remote Department Product Compensation US-Remote US-Remote $102,00... ...more at . We’re looking for a Product Solutions Associate to ensure our customers are... ...short-term and long-term disability 10 US observed holidays, and Canadian statutory holidays...Full timeTemporary workWork experience placementLocal areaImmediate startRemote workHome officeFlexible hours- ...Opportunity Liquid AI is building a solutions architecture function from scratch. You will... ...new-experience use cases Co-own the product-field feedback loop: document friction... ...model serving frameworks (vLLM, TensorRT-LLM, llama.cpp), and hardware-aware optimization...
- ...the best job for you. Role: Solution Architect Location: San Francisco, CA Duration... ..., and supporting enterprise-grade SaaS products using the Microsoft stack on Azure.... ...technologies and experience in customizing LLM models. Frontend Development:...Permanent employmentContract workRemote work
$135k - $180k
Solution Architect Sigma Computing The SA role has evolved. Here’s the version we’re hiring for... ...modes, AI functions, input tables with LLM enrichment, MCP integration, and warehouse... .... You will partner closely with Sales, Product, Engineering, and Support. Prospects...Full timeWork at officeFlexible hoursWeekend work$160k - $180k
...is the leader in AI and ERP solutions for local and state governments... ...trust. Category-leading products include enterprise asset management... ...Job Summary: The Solutions Architect - Strategic Projects is a... ...improvements based on field observations. Serve as a reliable...Contract workWork at officeLocal areaFlexible hours- ....). About the Role We're looking for a Solutions Architect to collaborate with our key customers,... ...successfully deploy and scale LiteLLM in production. You'll work directly with customers... ...businesses—our customers run ALL their LLM calls through LiteLLM. You enjoy the autonomy...
- ...Airbyte Solutions Architect Airbyte is the open-source standard for data movement. We've enabled... ...Y Combinator, etc.) and we believe in product-led growth, where we build something awesome... .... Advise customers on integrating LLM-based tooling into their existing data...Local areaImmediate start
$150k - $175k
...Solutions Architect (AI Infrastructure) $150,000 - $175,000 + $50,000 - $75,000 Bonus + Equity... ...growing AI startup at the heart of the LLM ecosystem. The team is building a... ...-world insights directly back into the product roadmap. You'll operate as the bridge...- ...of engineering to automate solutions. You’ll champion customer needs... ...feedback back into our products. This role may be a good fit... ...technical support or solution architecting You have experience working... ...paid time off as well as 10+ observed holidays Parental leave We offer...Work at officeLocal areaVisa sponsorship
- ...Akron, Cincinnati, Miami Microsoft 365 AI Solution Architect (Manager) EY advises clients to... ...001, NIST AI RMF, EU AI Act, and OWASP LLM Top 10. Desired Additional Qualifications... .... Minimum 18 days vacation plus twelve observed holidays and 10 personal care days. Programs...
$125.9k - $231.1k
...better working world. Microsoft 365 AI Solution Architect (Manager) EY advises clients to... ...IEC 42001, NIST AI RMF, EU AI Act, OWASP LLM Top 10. Ideally, you’ll also have... ...minimum of 18 days of vacation plus twelve observed holidays and 10 personal care days, and...Summer holidayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Solutions Architect - LLM Observability. Be the first to apply!
- entry level aws solution architect San Francisco, CA
- solution engineering manager San Francisco, CA
- senior solution manager San Francisco, CA
- senior cloud solutions architect San Francisco, CA
- presales solution architect San Francisco, CA
- mobile solution architect San Francisco, CA
- lead solution architect San Francisco, CA
- solutions architect San Francisco, CA
- principal solution architect San Francisco, CA
- business solutions architect San Francisco, CA


