Product Solutions Architect - LLM Observability
$151.5k - $222kDatadog
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre- and post-sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real-world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long-term customer success. Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large-scale LLM-powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Serve as the in-house subject matter expert for Datadog’s LLM Observability product Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience Who You Are: You bring a strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation details You are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates You have experience with languages such as Python and/or JavaScript/TypeScript You are comfortable operating in rapidly evolving, ambiguous technical domains You build deep context across teams and translate it into reusable, scalable solutions You take ownership from problem definition through implementation and measurable outcomes You are highly detail-oriented, particularly when working on architectures and customer-facing technical assets You bring strong listening and consultative skills and are experienced supporting customers in high-pressure, complex situations Able to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time Bonus Points: Successful track record with 5+ years experience working as an Architect or Consultant Experience using Datadog and/or other observability tools in an SRE or DevOps capacity Experience with LLM application evaluation and testing frameworks Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: Best-in-breed onboarding Generous global benefits Intra-departmental mentor and buddy program for in-house networking New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing An inclusive company culture, able to join our Community Guilds and Inclusion Talks Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan. The reasonably estimated yearly salary for this role at Datadog is:
$151,500—$222,000 USD
About Datadog: Datadog (NASDAQ: DDOG) is a global SaaS business, delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation, cloud migration, and infrastructure monitoring of our customers’ entire technology stacks. Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. Together, we champion professional development, diversity of thought, innovation, and work excellence to empower continuous growth. Join the pack and become part of a collaborative, pragmatic, and thoughtful people-first community where we solve tough problems, take smart risks, and celebrate one another. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog: Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines: Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines. #J-18808-Ljbffr Datadog$151.5k - $222k
A SaaS company in San Francisco is seeking a Product Solutions Architect to lead implementation of their LLM Observability product. You'll collaborate with customers to design architectures and drive product adoption through technical guidance. The ideal candidate has a...Suggested$151.5k - $202k
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs... ...applications. As a Product Solutions Architect, you will partner closely with Datadog... ...Experience using Datadog and/or other observability tools with Product Analytics, or...SuggestedWork at officeShift work$105 - $115 per hour
...Solution Architect (Principal Enterprise Architecture- Product-to-Market) Contract (1 Year + Possible extension) San Francisco, CA or Pleasanton, CA (Onsite... ...Qualifications: Familiarity with Agentic AI or LLM applications in P2M automation or Employees...SuggestedContract work- ...operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M... ...engineers turn to to ship AI products. THE ROLE As a Solution Architect (AI/LLM Inference) at Baseten you will partner closely with Sales...SuggestedFlexible hours
$170k - $190k
...Solutions Architect We're looking for a Solutions Architect to join our... ...design, deploy, and optimize production-grade AI infrastructure and... ..., secrets management), and observability (Prometheus, Grafana,... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...SuggestedTemporary work$225k - $275k
...analytics, data warehousing, observability, and AI workloads. The... ...Langfuse - the leading open source LLM observability platform -... ...core part of the ClickHouse product stack. Together, ClickHouse... ...We're looking for a Langfuse Solutions Architect who is already embedded in...Local areaRemote workHome officeFlexible hours$176k - $301k
...Solutions Architect Hybrid - San Francisco, New York City, Austin About... ...v0, and AI SDK, we create products that help builders move... ...Web Vitals, Lighthouse, and observability data to drive continuous improvement... ...fundamentals, ideally AI/LLM powered applications and...Work from homeWorldwideFlexible hours$170k - $190k
...developers move from prototypes to production-ready AI agents that teams... ...includes LangSmith (Observability, Evaluation, Deployment, Fleet... ...We're looking for a Solutions Architect to join our Professional Services... ...~ Strong experience with LLM frameworks (LangChain, LangGraph...Temporary workWork at officeFlexible hours- A leading SaaS company in San Francisco seeks a Product Solutions Architect to drive product adoption and collaborate with customers. Candidates should have over 5 years of experience in product analytics, feature flagging, and digital experience tooling. This is a hybrid...
- ...and ingress/egress for production workloads at massive... ...workloads on top of us — LLM gateways, agent-to-... ...need someone who can architect that layer with them,... ...auth, rate limiting, and observability. Agent-to-agent communication... ...technical role — Solutions Architect, Customer...Remote workWork from homeFlexible hours
$200k - $250k
...Senior Solutions Architect, Commercial San Francisco, California, United... ...their use of Temporal in production. The nature of our business... ...distributed systems (reliability, observability, and fault tolerance)... ...cases in agentic workflows and LLM orchestration Strong...Full timeTemporary workPart timeRemote workWork from homeHome office- ...AI Solutions Architect - Agentic AI Platforms ROLE OVERVIEW BayOne... ...Knowledge Systems: Architect production-grade RAG pipelines with vector... .... • Traceability & Observability: Instrument agent reasoning... ...least 3 years architecting LLM-based or agentic AI systems...
- ...Data Security Solutions Engineer / Architect Cyberhaven is re-imagining data loss prevention (DLP) with its ground-breaking Data Detection and... ...solutions engineer / architect to make an outsized impact on the product, and as a result improve data security for 100s of...
- ...FriendliAI is seeking a Solution Architect to assist enterprises in deploying... ...to solve and implement production-grade applications using our... ...architectures for LLM and multimodal inference... ...our platform reliability, observability, and scaling strategies...Temporary workFlexible hours
- Baseten is seeking a Solution Architect (AI/LLM Inference) to work closely with Sales and customers in San Francisco. This role involves translating business needs into technical solutions, conducting demos, and managing POCs. Ideal candidates will possess a strong AI/...
- A dynamic tech startup is seeking a Solutions Architect to help customers implement and scale AI solutions. In this role, you will collaborate... ...with a strong technical background in Python and AI/ML products. Join us to play a critical role where you will influence product...
$185k - $251k
...CIA) team is hiring a Senior Product Architect, Internal Tools (f/m/d) to... ...efforts to identify high-leverage solutions, then determine which ideas... ..., data flows, resilience, observability, and robust internal user... ...Practical experience with AI and LLM-based workflows,...Full timeWork at officeLocal areaWorldwide$176.6k - $239k
...collaborating on projects, creating demos, and developing sample code that inspires customers? Join the AWS Product Marketing Demo Engineering team as a Builder Solution Architect! Key job responsibilities Design and implement production-quality technical demonstrations for...Local areaFlexible hours- ...Solution Architect Location: San Francisco, CA Contract to hire Position Position Overview... ..., and supporting enterprise-grade SaaS products using the Microsoft stack on Azure.... ...technologies and experience in customizing LLM models. Frontend Development:...Contract work
$150k - $175k
...Solutions Architect (AI Infrastructure) $150,000 - $175,000 + $50,000 - $75,000 Bonus + Equity... ...growing AI startup at the heart of the LLM ecosystem. The team is building a... ...-world insights directly back into the product roadmap. You'll operate as the bridge...- ...Opportunity Liquid AI is building a solutions architecture function from scratch. You will... ...new-experience use cases Co-own the product-field feedback loop: document friction... ...model serving frameworks (vLLM, TensorRT-LLM, llama.cpp), and hardware-aware optimization...
- ...of engineering to automate solutions. You'll champion customer needs... ...feedback back into our products. This role requires a full-time... ...technical support or solution architecting You have experience... ...paid time off as well as 10+ observed holidays Parental leave...Long term contractFull timeContract workFixed term contractWork at officeLocal areaVisa sponsorshipMonday to FridayShift work
- ...About the Role We're looking for a Solutions Architect to collaborate with our key customers,... ...successfully deploy and scale LiteLLM in production. You'll work directly with customers... ...businesses-our customers run ALL their LLM calls through LiteLLM You enjoy the...
- ...Solution Architect Pleasanton, CA 94588 or San Francisco, CA 94105 – (Onsite) 8:00 AM - 5:0... ...deliver from day one. Skill set of Product to Market in Retail Skills - Merchandising... ...Familiarity with Agentic AI or LLM applications in P2M automation or Employees...Contract work
- ...Airbyte Solutions Architect Airbyte is the open-source standard for data movement. We've enabled... ...Y Combinator, etc.) and we believe in product-led growth, where we build something awesome... .... Advise customers on integrating LLM-based tooling into their existing data...Local areaImmediate start3 days per week
- ...of engineering to automate solutions. You’ll champion customer needs... ...feedback back into our products. This role may be a good fit... ...technical support or solution architecting You have experience working... ...paid time off as well as 10+ observed holidays Parental leave We offer...Work at officeLocal areaVisa sponsorship
- ...Senior AI Solutions Architect We need a senior AI solutions architect with experience in building and deploying LLM powered agents and proven experience in architecting hybrid cloud... ...data & AI solutions for building data products, signals and AI agents for investment...Work at officeRelocation
- ...Sr Solution Architect – Remote • W2 OnlyContact: Sudhanshu Shrivastava – (***) ***-**** / sudhanshu... ...errors.Monitor application, production and/or implementation support, both technical... ...testing strategies, document observations and coordinate responses.Maintain project...Remote work
$150k - $220k
...Solutions Architect/Sales Engineer Our client builds the infrastructure powering how the world... ...and NASA — letting developers route 100+ LLM APIs through a single interface with... ...AEs, with direct access to founders and product. The companies you'll be selling to already...Local area$175k - $240k
...Solutions Architect, Digital Natives (OpenAI OpCo, LLC; San Francisco, CA): Serve as the... ...best practices for scaling solutions in production. Maintain strong relationships with... ...basics around bastions and VPCs; Observability tooling: Datadog and Humio; and...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Solutions Architect - LLM Observability. Be the first to apply!
- solutions architect San Francisco, CA
- entry level aws solution architect San Francisco, CA
- cloud solutions architect San Francisco, CA
- sap solution architect San Francisco, CA
- senior solutions architect San Francisco, CA
- solution architect contract San Francisco, CA
- contact center solution architect San Francisco, CA
- enterprise solution architect San Francisco, CA
- mobile solution architect San Francisco, CA
- business solutions architect San Francisco, CA

