Retail Professional for AI Model Evaluation

Apply deep retail expertise to help develop and evaluate advanced large language models. In this role, you will bring practical judgment in merchandising, category management, buying, planning, and retail operations to create rigorous training data and improve AI reasoning. Key Responsibilities

• Advise research and engineering teams on retail merchandising, category management, and operations knowledge gaps.
• Create challenging retail-focused tasks and accurate, well-reasoned solutions based on real-world retail practice.
• Assess AI model responses using structured rubrics and provide written feedback on correctness, judgment, and reasoning quality.
• Create and refine retail-specific evaluation guidelines and scoring rubrics.
• Partner with other subject-matter experts to maintain consistency and accuracy across training data.

• At least 8 years of dedicated professional retail experience in areas such as merchandising, category management, retail operations, buying, or planning.
• Experience at a recognized top-tier organization, such as Amazon, Walmart, Target, Nike, Costco, Home Depot, or an equivalent company.
• Hands-on experience evaluating LLM or AI model outputs against rubrics or structured scoring criteria is required. Describe this experience in your application.
• Demonstrated career progression, such as advancing from Category Manager to Senior Manager to Director of Merchandising.
• Strong verbal and written communication, problem-solving, and interpersonal skills.

• United States-based, hourly W-2 employment.
• Reliable weekday availability of at least 35 hours per week is required.

$60 to $80 per hour.

Employment decisions are made without discrimination based on race, religion, color, national origin, sex, including pregnancy, childbirth, reproductive health decisions, related medical conditions, sexual orientation, gender identity, gender expression, age, protected veteran status, disability, genetic information, political views or activity, or any other legally protected characteristic.