Agentic Technical Lead

Role Description

We are looking for an Agentic Technical Lead to own the agentic systems framework — the platform and tooling that enables technical teams across the organization to build, configure, evaluate, and deploy agentic systems for their own use cases. You will architect and ship the infrastructure that makes agentic development self-service and production-safe:

• Configuration interfaces where developers define system prompts and models for each agent component.
• End-to-end evaluation pipelines with predefined metrics.
• Dataset creation and experiment management via LangFuse.
• Iterative workflows that take teams from prototype to production.

You will define how MCP Servers and Clients are templated via Backstage, ensuring governance and visibility over all deployed agentic systems. You will continuously expand the framework's capabilities so teams can build increasingly sophisticated agents without reinventing infrastructure. The stack includes LangGraph for orchestration, LangFuse for observability and evaluation, and AWS infrastructure for scale. This role requires deep expertise in LLMs and agentic systems, strong architectural thinking, and the ability to lead end-to-end in a fast-moving AI environment.

Qualifications

• 8+ years in machine learning engineering or applied ML.
• 4+ years hands-on with LLMs (fine-tuning, prompt engineering, integration, deployment).
• 2+ years building and shipping agentic systems in production, end-to-end.
• Proven experience building platforms or tooling used by other engineering teams.
• Deep experience with evaluation frameworks — dataset creation, metric definition, LLM-as-judge implementations.

Requirements

• Strong proficiency in Python.
• Hands-on experience with LangGraph, LangFuse, and MCP Servers/Clients.
• Deep understanding of LLM integration patterns: tool calling, structured outputs, prompt chaining, RAG.
• Strong evaluation methodology knowledge for generative AI and agentic systems.
• Experience with relational databases (PostgreSQL or similar).
• Excellent debugging and system-level thinking across multi-step agent executions.
• Comfortable in Agile, fast-paced environments with evolving requirements.

Benefits

• Impactful work: Lead the platform enabling agentic AI adoption across a global organization.
• Professional growth: Work at the frontier of agentic systems with continuous learning opportunities.
• Competitive compensation: Attractive salary and benefits package.
• Collaborative environment: Remote-friendly team with opportunities for travel, training, and industry events.