Retail Professional for AI Model Evaluation

Apply deep retail expertise to help improve advanced AI models by creating, assessing, and refining retail-focused training materials. This role brings practical merchandising, category management, buying, planning, and retail operations judgment into AI evaluation work.

Key Responsibilities

• Advise research and engineering teams on retail merchandising, category management, and operations knowledge gaps.
• Create challenging, relevant retail tasks and accurate, well-reasoned solutions based on real-world retail practice.
• Assess AI model responses using structured rubrics and provide written feedback on accuracy, judgment, and reasoning quality.
• Develop and improve retail-specific evaluation guidelines and scoring rubrics.
• Work with other subject-matter experts to maintain consistent, accurate training data.

Qualifications

• At least 8 years of dedicated professional retail experience in areas such as merchandising, category management, retail operations, buying, or planning, gained at a recognized top-tier organization such as Amazon, Walmart, Target, Nike, Costco, Home Depot, or an equivalent company.
• Hands-on experience evaluating LLM or AI model outputs using rubrics or structured scoring criteria is required. Describe this experience in your application.
• Demonstrated career growth, such as progressing from Category Manager to Senior Manager to Director of Merchandising.
• Strong verbal and written communication, problem-solving, and interpersonal skills.

Work Terms

• United States, hourly W-2 employment.
• Reliable weekday availability of at least 35 hours per week is required.

Compensation

• $60 to $80 per hour.

Equal Opportunity

Employment decisions are made without discrimination based on race, religion, color, national origin, sex, pregnancy, childbirth, reproductive health decisions, related medical conditions, sexual orientation, gender identity or expression, age, protected veteran status, disability, genetic information, political views or activity, or any other legally protected characteristic.