Data Quality Team Lead (Human-in-the-Loop AI)

Job Description

Job Description

Overview

Welo Data is looking for a Data Quality Lead to oversee teams of Data Quality Analysts supporting AI model evaluation and improvement.

This role is equal parts people leadership, quality ownership, and operational thinking .

You’ll be responsible for guiding teams through fast-changing work, ensuring high-quality output, and acting as a bridge between analysts and stakeholders. This is not just about managing throughput — it’s about shaping how quality is defined, measured, and improved in a human-in-the-loop environment.

Project Details

• Job Title: Data Quality Lead
• Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame.
• Hours: Full-time, 40 hours per week
• Employment Type: W2 Full-Time Employee
• Pay rate: $43.50/ hour
• Contract Duration: 1-year contract with possibility of extension

Important : This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, or Burlingame. Please only apply if you meet this location requirement.

What You'll Do

• Lead and support a team of Data Quality Analysts
• Oversee overall operational performance across workflows and teams
• Ensure team activities align with broader business objectives and program goals
• Drive the success of key initiatives across quality, delivery, and team performance
• Own quality across workflows — including audits, calibrations, and feedback loops
• Identify trends, risks, and gaps in model performance and data quality
• Translate ambiguous or evolving guidelines into clear team direction
• Run calibrations and ensure consistency across reviewers
• Partner with stakeholders to align on quality standards and expectations
• Prioritize and support hiring of linguists and specialized talent as needed
• Drive continuous improvement across processes, tooling, and evaluation methods
• Step into edge cases and complex decisions when needed
• Support team growth, coaching, and performance management

What We're Looking For

• 5–8 years of experience in data quality, QA, AI/ML operations, or related fields
• 2+ years of experience leading teams in data quality, QA, or AI/ML-related work at scale
• Native-level English proficiency and a university degree (Bachelor’s or higher).
• Proficiency in languages other than English is preferred, with particular interest in candidates demonstrating bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese.
• Strong operational mindset with experience managing performance across multiple workstreams
• Proven ability to drive quality, delivery, and process improvements
• Strong judgment and ability to operate in ambiguity
• Comfortable interacting with stakeholders and representing the team
• Ability to balance quality, speed, and evolving priorities
• Strong communication and organizational skills
• Deep attention to detail, with the ability to zoom out and see patterns
• Interest in AI and how human feedback shapes model behavior

Role Scope & Accountability

This leader is accountable for end-to-end operational success — including resource management, process optimization, and continuous improvement.

You’ll be expected to think beyond day-to-day execution and focus on long-term outcomes, ensuring the team consistently meets targets across quality, delivery, and overall program performance. Benefits

• Paid Vacation: 6 days
• Paid Company Holidays: 2 days (Memorial Day and Labor Day)
• Paid Sick Leave: accrued per applicable state law and company policy
• Medical, Dental, and Vision Insurance (eligibility applies)
• Health Savings Account (HSA)
• 401(k) Retirement Plan
• Employee Assistance Program
• Additional voluntary benefits (life, accident, critical illness, etc.)
• Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
• Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
• Unique Campus Features: Some locations include roof-top nature parks
• Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.