Shopify Expert - Fully Remote | Upto $50/hr
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Storefront Agent Evaluator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: up to 5 hours/week
Role Responsibilities
- Evaluate the Storefront Agent by simulating real shopper interactions, including product discovery, comparisons, and inquiries about sizing, stock, shipping, and returns.
- Grade responses based on Relevance , Accuracy , and Safety to ensure they meet shopper expectations and adhere to store policies.
- Provide concise feedback on any failures to ensure clarity for team members not present during evaluation.
- Work independently to deliver precise and repeatable judgments on agent performance.
Qualifications
Must-Have
- Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations.
- Careful, consistent judgment — apply the rubric uniformly across responses.
- Clear, concise written English — articulate reasons for response failures in a sentence or two.
Preferred
- Hands-on Shopify merchant experience — familiarity with shopper behavior on Shopify stores.
- Experience using AI shopping assistants or chat agents — understand common failure points.
- Prior work evaluating, red-teaming, or annotating AI model outputs.
- Familiarity with retail operations: catalog and variant structure, inventory, shipping, and returns policy.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Shopify Expert - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design and adoption,...Remote jobContract workSummer workWork at office$50 per hour
...Jack Dorsey . Position: Healthcare Business Development Contractor Type: Contract Compensation: $35–$50/hour Location: Remote Commitment: 30+ hours/week Role Responsibilities Identify and contact prospective healthcare data partners....Remote workContract workFor contractorsSummer workMercor
San Francisco, CA9 days ago$44 per hour
# Music Audio Expert - Fully Remote | Upto $44/hrUnited States2 hours agoID 5413158Price on request## DetailsEmployment type: ContractRemote: YesCompany: mercor## DescriptionAbout the job Mercor connects elite creative and technical talent with leading AI research labs...Remote jobContract workSummer workImmediate start$50 per hour
...Sociology Expert | $50/hr Remote | Mercor Join to apply for the Sociology Expert | $50/hr Remote | Mercor role at Crossing Hurdles Base pay range $40.00/hr - $50.00/hr Organization: Mercor Position: History / Humanities Specialist Referral Partner...Remote workHourly payContract workCrossing Hurdles
United States1 day ago$50 - $70 per hour
...Generalist Writer Position: Generalist Writer Type: Hourly Contract Compensation: $40–$50/hour Location: Remote About the Opportunity This opportunity is for experienced Generalist Writers interested in contributing to specialized...Remote workHourly payContract workPart timeFor contractorsImmediate startSynthires
United States1 day ago$90 per hour
..., and Jack Dorsey . Position: Kubernetes Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of Kubernetes tasks for training and evaluating AI models. Assess...Remote jobContract workSummer workMercor
San Francisco, CA7 days ago$77 per hour
...Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...statement. Rate each question's difficulty as Medium, Hard, or Expert, providing 1 correct answer and 9 plausible alternatives to challenge...Remote jobContract workSummer workMercor
New York, NY25 days ago$120 per hour
...Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeMercor
New York, NY10 days ago$50 per hour
Public Relations Expert | $50/hr Remote | Mercor Join to apply for the Public Relations Expert | $50/hr Remote | Mercor role at Crossing Hurdles This range is provided by Crossing Hurdles. Your actual pay will be based on your skills and experience — talk with your recruiter...Remote jobHourly payContract work$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote workContract workSummer workImmediate startMercor
New York, NY6 days ago$150 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Local Political Expert Elections Forecasting & Political Risk Type: Contract Compensation: $150-$250/hour Location: Remote Role Responsibilities Author point-in-time political reports and forecasts from a...Remote jobOdd jobContract workSummer workLocal area$75 per hour
...Specialist Type: Contract Compensation: $60-$75/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original... ...Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible...Remote jobContract workSummer work$100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Accounting & Audit Domain Expert Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California Commitment: 40 hours/week...Remote workHourly payWeekly payContract workFor contractorsSummer workMercor
New York, NYa month ago$120 per hour
...and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract... ...: $76–$120/hour Location: Remote Role Responsibilities Confirm every... ...point cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify...Remote jobContract workSummer work$100 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preclinical R&D Expert - In-house Drug Development Type: Contract Compensation: $60-$100/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review technical materials and real-...Remote jobContract workSummer work$142 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preclinical R&D Expert – ADC & Bispecifics Type: Contract Compensation: $85–$142/hour Location: Remote Role Responsibilities Review technical materials and real-world R&D data...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NYa month ago$100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70-$100/hour Location: Remote Commitment: 10-20+ hours/week Role Responsibilities Open and inspect downloaded office artifacts...Remote jobContract workSummer workWork at officeImmediate start$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote jobContract workSummer work$50 per hour
...Media Practice Reviewer Type: Contract Compensation: $45-$50/hour Location: Remote Role Responsibilities Evaluate AI work products in... ...a job alert for this search Media Practice Auditor - Fully Remote | Upto $50/hr London, England, United Kingdom #J-18808-Ljbffr...Remote jobContract workSummer work$50 per hour
...Jack Dorsey . Position: Corporate Lawyers — Occupation Research Survey Type: Contract Compensation: $50 total Location: Remote Role Responsibilities Complete a written survey to identify dimensions that distinguish jobs within corporate law...Remote jobContract workSummer work$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote jobContract workSummer work$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training. Provide one correct answer...Remote jobContract workSummer work$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: B2B Sales Expert (3+ YOE, US Only) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Generate and qualify pipeline through outbound efforts,...Remote jobContract workSummer work$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios spanning complex...Remote jobContract workSummer work$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial...Remote jobContract workSummer work$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Fraud Detection Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud scenarios for large-scale transaction...Remote jobContract workSummer workMercor
New York, NY2 days ago$50 - $70 per hour
...Generalist Expert Position: Generalist Expert Type: Freelance Hourly Contract Compensation: $70/hour Location: Remote About the Opportunity This opportunity is for strong analytical thinkers and experienced evaluators interested in...Remote workHourly payContract workFor contractorsFreelanceFlexible hoursSynthires
United States3 days ago$50 per hour
...Dorsey . Position: Voice Actor: CX Agent Voice Cloning (African American) Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Record high-quality voice samples across diverse scripts, including conversational, narrative...Remote jobContract workSummer workMercor
San Francisco, CA12 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text...Remote jobContract workSummer workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shopify Expert - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- fulfillment expert New York, NY
- graphic design remote New York, NY
- remote scrum master New York, NY
- remote document review New York, NY
- remote recruiter New York, NY
- remote infrastructure engineer New York, NY
- genetic counselor remote New York, NY