Retail SME - AI Evaluation Expert
$60 - $80 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Retail Specialist
Type: Contract
Compensation: $60–$80/hour
Location: Remote
Role Responsibilities
- Guide research and engineering teams to close knowledge gaps in retail merchandising , category management , and operations reasoning .
- Design challenging, domain-relevant retail tasks and write accurate, well-reasoned solutions grounded in real retail practice.
- Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
- Develop and refine evaluation guidelines and scoring rubrics specific to retail tasks.
- Collaborate with other subject matter experts to ensure consistency and accuracy in training data .
Qualifications
Must-Have
- 8+ years of dedicated professional experience in retail (e.g., merchandising, category management, retail operations, buying/planning) at a recognized, top-tier organization (e.g., Amazon, Walmart, Target, Nike, Costco, Home Depot, or equivalent).
- Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria — mandatory; please describe this experience in your application.
- Demonstrable career progression (e.g., Category Manager → Senior Manager → Director of Merchandising).
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Verbal and written communication skills, problem-solving skills, and interpersonal skills.
Compensation & Legal
- W-2 employment with Cincinnatus LLC
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Retail SME - AI Evaluation Expert in New York, NY vacancy
- SME Careers is seeking a General Nurse Subject Matter Expert for a remote contractor role to review and create healthcare content... .... Your expertise will enhance AI models' accuracy in clinical... ...model integrity through rigorous evaluation of responses. #J-18808-Ljbffr SME...SuggestedRemote jobFor contractors
$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...SuggestedRemote jobHourly payWork from homeFlexible hours$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...SuggestedRemote jobHourly payFlexible hours- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...SuggestedRemote jobWork from homeFlexible hours
- A leading AI research firm is seeking Expert Prompt Curators to design challenging prompts for evaluating advanced AI models. The role requires advanced knowledge in diverse fields and offers flexible hours, remote work, and a competitive hourly wage. Ideal candidates will...SuggestedRemote jobHourly payTemporary workFlexible hours
- A tech company focusing on AI research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least...Remote jobContract workFlexible hours
$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote workMercor
New York, NY3 days ago$30 per hour
About Prolific Prolific is not just another player in the AI space - we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote jobWork from homeFlexible hours$30 per hour
Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu...Remote jobWork from homeFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work- ...Remote Mathematics Expert (AI/LLM) - 34877 Remote Mathematics Expert (AI/LLM) - 34877 1 week ago Be among the first 25 applicants Turing... ...Collaborate with LLM researchers to align problem types with evaluation goals, particularly in areas where models commonly struggle (e...Hourly payContract workPart timeFor contractorsFreelanceInternshipRemote workWork from homeWorldwideAfternoon shift
Turing Inc
New York, NY3 days ago $100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity Labeling Expert Type: Contract Compensation... ...ransomware , worms , and exploits . Evaluate POC exploit development to determine...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote workMercor
New York, NY18 hours ago$120 per hour
...Prolific is seeking Licensed Pharmacists to evaluate and train AI models related to healthcare. You will earn competitive pay rates (up to $120 per hour) while conducting assessments for tasks requiring focused attention on complex medical data. Ideal candidates have a...Hourly payRemote workWork from homeFlexible hoursProlific
New York, NY2 days ago- ...hiring PhD‑level biologists to help make advanced AI models safer. You'll apply your scientific expertise to evaluate and strengthen how these models handle... ...train you on the workflow. Responsibilities Write expert‑level prompts across specialized life‑science topics...Part timeImmediate start
- Investment Banking AI Subject-Matter Expert is a remote review track for evaluating AI outputs across banking workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment...Hourly payFor contractorsWork experience placementRemote work10 hours per week
$50 - $60 per hour
DataAnnotation is seeking a Medical Expert to help train AI models. The role requires evaluating AI outputs and ensuring medical accuracy. Candidates should possess a current or in-progress medical degree and be fluent in English. Enjoy the flexibility to choose projects...Remote jobHourly payContract workWork from home$55 per hour
...Freelance Biology Expert with Python - AI Trainer 5 days ago – Be among the first 25 applicants This opportunity is only for candidates... ...challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers. Correct the model's responses...Part timeFreelanceRemote workMind Rift
New York, NY18 hours ago$73 per hour
...intelligence to ethically shape the future of AI. What We Do The Mindrift platform... ...how modern AI systems are tested and evaluated? This is a flexible, project‑based opportunity... ...to succeed with less hand‑holding. Real expert complexity only. You're improving the AI...Permanent employmentPart timeFreelanceRemote workFlexible hoursMind Rift
New York, NY18 hours ago$60 - $75 per hour
A leading information services firm is seeking a Remote Archivist to design questions and evaluate AI responses related to archival management. This position requires strong experience as an archivist and the ability to work independently in a fully remote environment....Remote jobHourly pay$50 per hour
A leading AI research accelerator is looking for remote PhD candidates in Chemistry, Chemical Engineering, or related fields. You will design advanced chemistry problems to evaluate AI performance and collaborate with researchers on benchmarks. This role offers flexible...Remote jobHourly payFlexible hours$128.5k - $171.5k
General Information Job Title Expert Consultant, Coro, AI Engineer Job ID 106501 Work Areas Technology & Engineering Employment... ...and ML engineering skills as needed, including building evaluation approaches, working with data pipelines, and developing...Permanent employmentFull timeTemporary workApprenticeshipLocal area$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work Areas Analytics, Data & Research, Management... ...from early-stage research, model experimentation, and evaluation design to production system deploymentOversee API...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week- Biology Subject Matter Expert (AI Training) We're looking for biology experts to help train and evaluate cutting-edge AI models used by the world's leading research labs. Your scientific knowledge will directly shape how AI reasons through complex biological problems —...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$70 - $75 per hour
...I am looking for a Knowledge Expert - Math for Meta. This is an 18... ...team and help build foundational AI models from the ground up. We’... ...legal specialty. As a domain SME, you\'ll set the gold standard... ...and detailed rubrics / evaluation frameworks to assess legal reasoning...Full timeContract workFor contractorsRemote workFlexible hours- You will review AI-generated Hebrew and English responses and/or... ...bilingual training content, evaluating reasoning quality and step-by-... ...problem‑solving while providing expert feedback that helps models... ...anywhere hours. This job is with SME Careers (a subsidiary of SuperAnnotate...Hourly payFor contractorsRemote workFlexible hours
$28.25 per hour
...Operations Expert Apple Chelsea, New York City Base pay starts at $28.25/hr. Tags: Featured No exp needed Retail Min. base wage: $28.25/hr Retail Est. base annual: $55... ...Strong organizational skills, quickly evaluating every situation. Location:...$40 per hour
Overview Join to apply for the Healthcare Expert role at DataAnnotation . We are looking for medical experts to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each...Hourly payFull timeContract workPart timeRemote work- A digital platform for project opportunities is seeking skilled LMMS users to assist with AI research. The role involves evaluating AI-generated music content and providing valuable feedback based on hands-on experience in music production. Applicants are required to have...Remote jobFor contractorsFlexible hours
$107.5k - $188.4k
...Wolters Kluwer, we combine deep clinical expertise with responsible AI to build products that improve care—and driving awareness,... ...Technical Product Manager to accelerate growth for our suite of UpToDate Expert AI products. This role spans the full clinician journey—from...Full timeWork at officeRemote work$65 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Biology Expert (PhD) — AI Safety Type: Contract... ...topics to enhance model understanding. Evaluate and annotate model responses for scientific...Contract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Retail SME - AI Evaluation Expert. Be the first to apply!
Related searches
- subject matter expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- cvs health retail New York, NY
- full time retail sales merchandiser New York, NY
- store manager retail New York, NY
- cookies retail New York, NY
- retail jobs New York, NY
- retail salesperson New York, NY