Senior Product Solutions Architect - LLM Observability
$185k - $246kDatadog
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs are domain experts who partner with Field teams on complex customer use cases across pre- and post-sales engagements and scale their impact by producing reusable collateral, including reference architectures, technical guides, and enablement assets. By feeding real-world customer insights back to Datadog Product teams, PSAs help influence product roadmaps while accelerating adoption, usage, and long-term customer success.Datadog’s LLM Observability product enables organizations to monitor, troubleshoot, and optimize large-scale LLM-powered applications with confidence, while meeting requirements around data privacy, compliance, and cost management. As a Product Solutions Architect, you will partner closely with Datadog customers and the LLM Observability product team to design architectures, implement best practices, and drive adoption of LLM observability across customer environments.At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.What You’ll Do:Serve as the in-house subject matter expert for Datadog’s LLM Observability productPartner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM ObservabilityCreate high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer communityBuild proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environmentsAct as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experienceWho You Are: You bring a strong software engineering foundation, with hands-on experience building and operating LLM-powered applications in production environments at a large scale, and are comfortable diving deep into codebases to understand architectural decisions, tradeoffs, and implementation detailsYou are familiar with distributed systems and core observability concepts, such as tracing, metrics, and logging, and can translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templatesExperience with languages such as Python and/or JavaScript/TypeScriptComfortable operating in rapidly evolving, ambiguous technical domainsYou build deep context across teams and translate it into reusable, scalable solutionsYou take ownership from problem definition through implementation and measurable outcomesHighly detail-oriented, particularly when working on architectures and customer-facing technical assetsYou bring strong listening and consultative skills and are experienced supporting customers in high-pressure, complex situationsAble to sit up to 4 hours, traveling to and from client sites Able to travel via auto, train, or air up to 40% of the time Bonus Points:Successful track record with 5+ years experience working as a Solutions Architect or Sales Engineer supporting the AI spaceExperience using Datadog and/or other observability tools in an SRE or DevOps capacityExperience with LLM application evaluation and testing frameworksDatadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.Benefits and Growth: Best-in-breed onboardingGenerous global benefitsIntra-departmental mentor and buddy program for in-house networkingNew hire stock equity (RSUs) and employee stock purchase plan (ESPP)Continuous professional development, product training, and career pathingAn inclusive company culture, able to join our Community Guilds and Inclusion TalksBenefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.The reasonably estimated yearly salary for this role at Datadog is:$185,000—$246,000 USDAbout Datadog: Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center. Equal Opportunity at Datadog:Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines:Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.
$185k - $246k
The Product Solutions Architecture (PSA) team acts as a technical multiplier across Datadog. PSAs... ...response. As a Product Solutions Architect, you will partner closely with Datadog... ...familiar with distributed systems and core observability concepts, such as tracing, metrics,...SeniorWork at office$184k - $287.5k
...is seeking outstanding AI Solutions Architects to assist and support customers... ...architects work across product, engineering, sales, developer... ..., storage, containers, observability, security, power, and data... ...platformsExperience deploying LLM training, fine-tuning, RAG,...SeniorFull timeRemote work$184k - $287.5k
...is seeking outstanding AI Solutions Architects to assist and support customers... ...architects, engineering, product and business teams.... ...technologies, monitoring, and observability solutions for AI deploymentsExcellent... ...the theory and practice of LLM and DL inferenceExcellent...SeniorFull timeRemote work- ...Airbyte Senior Solutions ArchitectAirbyte is the data and action... ...read from, not just observe them.Our mission is... ...Airbyte Senior Solutions Architect, you will have a... ...implement and adopt our products while serving as their... ...customers on integrating LLM-based tooling into their...SeniorLocal areaImmediate startRemote workFlexible hours
- Trackmind is looking for highly experienced Technical Architects, Solution Architects, and AI Tech Leads with strong expertise in Python and Generative AI. The role involves designing and implementing LLM-powered applications utilizing RAG architectures, building AI agents...Senior
- Clay is seeking an Enterprise Product Support Specialist to serve as the primary technical partner for our largest customers, owning end-to-end enterprise cases and delivering measurable outcomes. You will act as a trusted advisor, understand business goals, and tailor...Senior
- Datadog in New York is seeking a Senior Product Manager to own the Journey Monitoring hub, driving end-to-end product lifecycle and cross... ...SREs, engineers, PMs, and business leaders to design an observability layer that auto-discovers journeys, tracks conversions, and...Senior
- Grafana Labs is seeking a Senior Product Manager for Infrastructure Observability (Infra O11y) to lead the vision and strategy for Kubernetes Monitoring and Cloud Provider Observability within Grafana Cloud. You will drive product roadmaps, collaborate with engineering,...SeniorRemote job
$176.5k - $207.5k
Honeycomb.io is looking for a Product Manager to drive core product features for their enterprise customers. In this fully distributed... ..., and comfortable in complex technical spaces related to observability technology. Salary ranges from $176,500 to $207,500 USD based...Senior- Bloomberg’s Engineering AI group is expanding with Senior LLM Research Engineers who will advance NLP and AI-driven customer-facing features... ...vector databases. You will collaborate across teams to build production-grade code, train and fine-tune models, and publish findings...Senior
- Omaze is looking for a Senior Applied AI Scientist to join their highly skilled Tech team. This role focuses... ..., and optimization, combining data science with product engineering. You will work on evaluation frameworks for LLM features and analyze production impact across...Senior
- Bright Vision Technologies is seeking an LLM Engineer for a 100% remote role in the United States... ...for large language models, collaborating with product, design, and engineering teams to deliver production-grade ML solutions. The ideal candidate has a PhD or MS in CS/ML,...SeniorRemote job
$107.5k - $170.1k
...Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the... ...our company?As a SLED Solutions Architect at Elastic you will serve as a technical... ...understanding of the Elastic products and solutions to demonstrate the...SeniorLocal areaWorldwideFlexible hours$126k - $149k
...opportunity to unlock global productivity and sustainability by... ..., and the planet.The Team:Solutions Architects are vital members of our project... ...task mining.The Role:As a Senior Solutions Architect... ...developer tools (Github, observability tools, etc.)Celonis does not...SeniorFull timeWork at officeLocal areaImmediate startRemote workWorldwideFlexible hours- ...mission‑critical operational and banking productivity challenges at the scale of the world’s... ...translating business problems into agentic solutions and workflows. Lead end-to-end delivery... ...equivalent expertise. Have shipped an LLM-powered, autonomous, or agentic system to...SeniorWeekend work
$184k - $287.5k
...world.NVIDIA is seeking an experienced Solutions Architect to be a trusted technical advisor, bridging... ...GenAI, AI, and ML hardware/software to production with the most consequential customers... ...Inference Server, TensorRT, TensorRT-LLM, NVIDIA CUDA-XHands-on expertise with scaled...SeniorFull timeRemote work$97k
...Sr. Product Solutions Architect - Gracenote Full-time Compensation Min: $97,000 Compensation Max: $162,000 At Nielsen, we are passionate about... ...architecture roles. Specific experience designing, deploying, or observing AI agents, MCP architectures, and managing cloud framework...SeniorFull time- ...Senior AI Tech Architect - AI PlatformsLocations: Atlanta | Austin | Boston |... ...for clients with sustained solutions to the most complex and time... ...DesignContribute to the design of AI and LLM-based system architectures... ...into development and production environments.Assist with...SeniorImmediate start
- ...fast, and taking technology — and careers — to the next level. Observe by Snowflake is an AI-powered observability platform built on... ...of the world’s leading data platforms. About the Role As a Senior Product Manager at Observe by Snowflake you will lead a cross‑...Senior
$192k - $240k
...solve hard problems the right way.The Observability Data Platform (ODP) is the... ...routed, and surfaced across every product at planet scale. As a Senior Product Manager for ODP, you will... ...validate product assumptions, and guide solutions from early prototypes through...SeniorWork at office- ...Network Access (ZTNA) solution. AppGate is the only... ...’re looking for an Observability Engineer (Senior/Staff/Principal... ...telemetry that future LLM-based incident analysis... ...for Phase 3. • Architect the Observability Platform... ...Work directly with product, R&D, and marquee...SeniorFor contractorsWorldwide
- ...harness from end to end. ~ Architect the agent runtime, orchestration... ..., hardening guides, and production-readiness documentation.... ...Production experience building LLM agent or multi-agent systems.... ...their journey develop custom solutions for success and growth. We provide...Senior
$154k - $205k
Observability Pipelines is one of Datadog's fastest-growing product lines, helping enterprises optimize telemetry costs, modernize... ...security operations. As the Senior Product Marketing Manager for... ...competitive displacement against solutions such as Cribl and Splunk....Senior$193k - $241k
Principal Product Manager - AI Observability We are a global team of innovators and pioneers dedicated to shaping... ...growth. Experience operating as a senior individual contributor who drives... ...enterprise customers on production AI or LLM systems: tracing, evaluation,...Contract workFor contractorsFor subcontractorWork at officeRemote workFlexible hours- ...financial services firm is seeking a Solutions Architect to lead the modernization and expansion... ...establishing standards for integration and observability, and driving DevOps practices.... ...platforms, and a strong understanding of LLM patterns. This position offers a competitive...Senior
- ...Consulting is seeking an Enterprise AI Solution Architect to design end-to-end AI platforms on Azure, focusing on governance, observability, and scalable deployment. You will lead... ...to translate complex requirements into production-grade architectures and reusable assets...Senior
- ...Dash0 and help us define the future of observability. We are OpenTelemetry-native, building... ...lock-in and meaningless toil. Shape a product that developers love—all with... ...in. The Opportunity As an Enterprise Solutions Architect, you will act as a trusted technical advisor...Remote jobFlexible hours
$192k - $240k
...hard problems the right way. The Observability Data Platform (ODP) is the backbone... ...routed, and surfaced across every product at planet scale. As a Senior Product Manager for ODP, you will... ...validate product assumptions, and guide solutions from early prototypes through...SeniorWork at office- Datadog is seeking an experienced Product Manager in New York, NY to lead innovative product opportunities in database monitoring and optimization. You will have the opportunity to improve customer interactions with databases and collaborate with talented engineering teams...Senior
- JPMorgan Chase & Co. in New York seeks a product leader to own AI use cases end-to-end—from discovery and framing through requirements, delivery, and long‑term reliability. You’ll design, build, and scale agentic systems with data science, engineering, and business partners...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Product Solutions Architect - LLM Observability. Be the first to apply!
- solution engineering manager New York, NY
- solutions marketing manager New York, NY
- security solutions architect New York, NY
- salesforce solution architect New York, NY
- mobile solution architect New York, NY
- chief solutions architect New York, NY
- solution designer New York, NY
- principal solution architect New York, NY
- business solutions manager New York, NY
- senior cloud solutions architect New York, NY



