Evaluation Lead, AI Operations

Role Description

At Fetch, we’re building AI and automation systems that make our work smarter, faster, and more scalable. The AI Operations team ensures our models, automations, and LLM systems perform with quality, reliability, and measurable impact.

As an Automation Lead, you’ll own automation and evaluation programs across AI Operations. You’ll translate business and functional goals into scalable systems, define how we measure quality, and ensure automation and evaluation become durable, high-impact capabilities across the organization.

This role is ideal for someone who combines deep technical problem-solving with systems-level thinking and strong cross-functional leadership.

This is a full-time role that can be held from one of our US offices or remotely in the United States.

Role Responsibilities

• Own programs:
  • Lead complex, high-impact automation and evaluation initiatives across workflows or teams
• Design scalable solutions:
  • Architect end-to-end workflows integrating datasets, evaluations, automations, and HITL processes
• Establish standards:
  • Define best practices for datasets, evaluation methodologies, and quality measurement
• Drive cross-functional alignment:
  • Influence priorities and partner with Engineering, Product, and AI teams to deliver solutions
• Improve systems at scale:
  • Lead redesign of workflows, tooling, and processes to improve performance and durability
• Measure and communicate impact:
  • Define success metrics and communicate performance and recommendations to leadership
• Elevate the team:
  • Raise the bar through your work and actively mentor others by sharing approaches, guiding problem-solving, and enabling the team to build stronger automation and evaluation capabilities
• Drive innovation:
  • Stay current on emerging tools and approaches; pilot and translate them into actionable improvements for the team

Qualifications

• 5+ years of experience and the proven ability to lead complex automation or evaluation initiatives across systems or teams
• Experience designing, building, and scaling evaluation frameworks, datasets, and quality systems at scale for LLMs or AI products
• Strong understanding of AI/LLM workflows, automation platforms, and system design
• Experience in influencing cross-functional stakeholders and aligning priorities
• Demonstrated ability to define metrics and drive measurable business impact

Preferred Requirements

• Familiarity with data pipelines, APIs, or production systems
• Experience mentoring or leading technical contributors
• Background in AI Operations, applied AI, or process optimization

Compensation

At Fetch, we offer competitive compensation packages including base, equity, and benefits to the exceptional folks we hire. The base salary range for this position is [$97,000 - $114,000]. Discover our benefits and how our employees live rewarded at .

Benefits

• Equity: We offer full-time employees equity in Fetch, so that everyone can benefit from Fetch’s growth.
• 401k Match: Dollar-for-dollar match up to 4%.
• Benefits for humans and pets: We offer comprehensive medical, dental and vision plans for everyone including your pets.
• Continuing Education: Fetch provides ten thousand per year in education reimbursement.
• Employee Resource Groups: Take part in employee-led groups that are centered around fostering a diverse and inclusive workplace through events, dialogue and advocacy.
• Paid Time Off: On top of our flexible PTO, Fetch observes 9 paid holidays, as well as our year-end week-long break.
• Robust Leave Policies: 20 weeks of paid parental leave for primary caregivers, 14 weeks for secondary caregivers, and a flexible return to work schedule.
• Calvin Care Cash: Employees who are welcoming new family members will also receive a one time $2,000 incentive to assist employees with covering the cost of childcare, clothing, diapers and much more!
• Flexible Work Environment: Collaborate with your team in one of our stunning offices, or you can work fully remotely from anywhere in the US.

Company Description

Fetch helps people live rewarded every day, with a vision to become the rewards destination for everyone. We turn everyday activities into meaningful rewards, whether it’s grocery shopping, grabbing a quick meal, or playing a favorite mobile game. To date, we’ve awarded more than $1 billion in Fetch Points to our users.

Each day, more than 13 million receipts are submitted on Fetch, providing visibility into over $212 billion in gross merchandise value. This creates the largest retail-agnostic, SKU-level view of household spending, powering Fetch as an outcomes-based advertising platform that helps brands acquire and retain lifelong consumers.

The Fetch app is available on the App Store and Google Play, with more than 6 million five-star reviews from a highly engaged and loyal user base.

It’s not just our users who believe in Fetch: with investments from Softbank, ICONIQ, DST, Greycroft, and partnerships ranging from challenger brands to Fortune 500 companies, Fetch is reshaping how brands and consumers connect in the marketplace.

Fetch is an equal opportunity employer that embraces diversity, inclusion, and respect for all individuals. We do not discriminate on the basis of race, color, religion, gender, gender identity or expression, sexual orientation, age, national origin, marital status, veteran status, disability, or any other characteristic protected by applicable law.