Staff Product Engineer (Hybrid)

Staff AI Software Engineer - Fiddler AI Mid‑Senior level, Full‑time position based in Palo Alto, CA with an option for 3 days a week on‑site. Company Overview Our Purpose At Fiddler, we build trustworthy and transparent AI solutions to help organizations mitigate the risks of Generative AI and Agents. We enable teams to deploy trustworthy, AI‑observability products that monitor, evaluate, secure, analyze, and improve their AI applications. Founders Krishna Gade (former engineering leader at Facebook, Pinterest, Twitter, Microsoft) and Amit Paka (product leader at Microsoft, Samsung, PayPal). Backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital. Responsibilities Design and build core services and components of a world‑class cloud platform to support enterprises developing predictive models, LLMs, GenAI models and agentic applications. Lead the design and implementation of distributed systems, microservices, and applications that compute, persist, and expose new ML + agentic observability metrics from raw trace data. Spearhead the development of new metrics and evaluation capabilities to meet evolving customer needs around agentic applications, including conversations with customers on discovery and support. Develop in‑house AI agents and GenAI capabilities to augment the Fiddler observability products. Define and evolve operational maturity (reliability, observability, SLOs) of core services, establish best practices, and champion improvements across the team. Build and nurture a world‑class engineering team; actively participate in talent acquisition, interviewing, candidate evaluation, and coaching. Qualifications Master’s or Bachelor’s degree in Computer Science or related field with 7+ years of industry experience and a strong foundation in software development. Experience deploying and working with ML/LLM models in production. Hands‑on experience building and monitoring agentic applications using frameworks like LangChain, Google ADK, Amazon Strands, OpenAI, and integrating MCP servers. Experience with OpenTelemetry, distributed tracing, and LLM‑as‑a‑judge techniques. Strong proficiency in Python and backend technologies such as Postgres, Redis, Kafka, RabbitMQ, Ray, and experience designing, building, and debugging large‑scale systems. Adaptability, ownership, and the ability to thrive in ambiguity and a fast‑paced environment. Deep understanding of distributed systems and troubleshooting production issues. Technical leadership and cross‑functional collaboration skills; ability to guide a small team and deliver high‑quality code. Coaching and mentorship experience to raise the technical bar across the team. Ability to work in the Palo Alto office 3 days a week. Compensation & Benefits Salary: $190,000 – $300,000 plus equity and benefits. The posted range represents the expected salary; additional compensation may be considered based on experience, leveling, location, and job‑related factors. Benefits & Culture We are an early‑stage startup focused on AI observability and safety. Join our dynamic team of builders and thinkers dedicated to solving cutting‑edge challenges. Our culture values continuous learning, collaboration, and making a tangible impact on how AI evolves for humanity. Equal Opportunity Employer Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations to complete interviews or perform job duties, please inform the recruiter at the beginning of the process. Beware of job scam fraud: recruiters use @fiddler.ai email addresses exclusively. We do not conduct interviews via text, instant message, or request sensitive personal information such as bank account or social security numbers. #J-18808-Ljbffr Fiddler AI