Shopify Expert - Fully Remote | Upto $50/hr
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Storefront Agent Evaluator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: up to 5 hours/week
Role Responsibilities
- Evaluate the Storefront Agent by simulating real shopper interactions, including product discovery, comparisons, and inquiries about sizing, stock, shipping, and returns.
- Grade responses based on Relevance , Accuracy , and Safety to ensure they meet shopper expectations and adhere to store policies.
- Provide concise feedback on any failures to ensure clarity for team members not present during evaluation.
- Work independently to deliver precise and repeatable judgments on agent performance.
Qualifications
Must-Have
- Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations.
- Careful, consistent judgment — apply the rubric uniformly across responses.
- Clear, concise written English — articulate reasons for response failures in a sentence or two.
Preferred
- Hands-on Shopify merchant experience — familiarity with shopper behavior on Shopify stores.
- Experience using AI shopping assistants or chat agents — understand common failure points.
- Prior work evaluating, red-teaming, or annotating AI model outputs.
- Familiarity with retail operations: catalog and variant structure, inventory, shipping, and returns policy.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Shopify Expert - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15-20 hours/week Role Responsibilities Evaluate the accuracy of AI models on visual document...Remote jobContract workPart timeSummer work$50 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Development Contractor Type: Contract Compensation: $35-$50/hour Location: Remote Commitment: Up to 40 hours/week Role Responsibilities Identify and contact prospective data partners to explore data-licensing...Remote jobContract workFor contractorsSummer work$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-...Remote workContract workSummer workWork at officeMercor
New York, NY24 days ago$50 per hour
...Visual Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15-20 hours/week Role Responsibilities Evaluate... ...and model performance. Collaborate with subject matter experts to ensure consistency and coverage across datasets. Work independently...Remote jobContract workPart timeSummer work$60 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50-$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets . Review annotator...Remote jobContract workSummer work$63 per hour
...Psychology Benchmark Specialist Type: Contract Compensation: $50-$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author... ...(intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9...Remote jobContract workSummer work$60 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50-$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial underwriting,...Remote jobContract workSummer work$120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Analyze and optimize GPU kernels for performance, efficiency, and...Remote workContract workSummer workMercor Inc
United States1 day ago$125 per hour
...Dorsey . Position: Biology & Biophysics Researchers (Part-time) Type: Contract Compensation: $125–$225/hour Location: Remote Commitment: 8–20 hours/week Role Responsibilities Author and review challenging biology and biophysics problems to train...Remote workContract workPart timeSummer workMercor Inc
United States2 days ago$120 per hour
...Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote workContract workSummer workWork at officeMercor Inc
United States2 days ago$70 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities Write expert-level prompts across...Remote workContract workPart timeSummer workImmediate startMercor Inc
United States1 day ago$50 per hour
...Sociology Expert | $50/hr Remote | Mercor Join to apply for the Sociology Expert | $50/hr Remote | Mercor role at Crossing Hurdles Base pay range $40.00/hr - $50.00/hr Organization: Mercor Position: History / Humanities Specialist Referral Partner...Remote workHourly payContract workCrossing Hurdles
United States1 day ago$105 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering & Software Domain Expert Type: Contract Compensation: $65–$105/hour Location: Hybrid, Bay Area, California Commitment: 40 hours/week...Remote jobContract workSummer workMercor
San Francisco, CA17 days ago$70 per hour
...specialized chemistry topics. No prior AI/ML experience is required — we'll train you on the workflow. What you'll do Write expert‑level prompts across specialized chemistry topics. Evaluate and annotate model responses for scientific accuracy, helpfulness, and...Remote workPart timeImmediate startMercor Inc
United States2 days ago$100 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Particle & Nuclear Physics Expert Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Design challenging computational problems...Remote workContract workSummer workMercor Inc
United States1 day ago$120 per hour
...Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeFlexible hoursMercor
New York, NY23 days ago$50 per hour
Healthcare Business Development Contractors We are seeking contractors to identify companies with valuable operational data and develop potential data-licensing partnerships. This external-facing role involves contacting founders and business owners, leading discovery calls...Remote jobFor contractors$50 per hour
Public Relations Expert | $50/hr Remote | Mercor Join to apply for the Public Relations Expert | $50/hr Remote | Mercor role at Crossing Hurdles This range is provided by Crossing Hurdles. Your actual pay will be based on your skills and experience — talk with your recruiter...Remote jobHourly payContract work$100 per hour
...AI models. 1. Overview We are hiring a senior legal domain expert to work directly with a leading AI lab's research and program... ...client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be...Remote jobFull timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package$110 per hour
We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per expert Potential...Remote job$100 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings releases, prepared remarks, and Q&A briefings for quarterly...Remote jobContract workSummer work$100 per hour
About the work We're building a high-quality library of public-company investor relations work products. You'll complete self-contained IR exercises from mock files (results packs, shareholder registers, analyst models) and produce the deliverable for each, graded against...Remote job$160 per hour
...Dorsey . Position: Engineering / Platform Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide structured...Remote workContract workSummer workMercor
New York, NY24 days ago$100 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements...Remote workContract workSummer workMercor
New York, NY24 days ago$160 per hour
...Larry Summers , and Jack Dorsey . Position: Litigation Lawyer (United Kingdom) Type: Contract Compensation: $150-$160/hour Location: Remote Commitment: ~10 hours Role Responsibilities Evaluate AI systems by running prompts through two AI (LLM) platforms . Compare outputs...Remote jobContract workSummer work$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote workContract workSummer workImmediate startMercor
New York, NY24 days ago$90 per hour
..., and Jack Dorsey . Position: Kubernetes Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of Kubernetes tasks for training and evaluating AI models. Assess...Remote workContract workSummer workMercor
San Francisco, CA8 days ago$119 per hour
...Specialist Type: Contract Compensation: $94-$119/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original... ...information included. Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers. Provide one correct answer...Remote jobContract workSummer work$90 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80-$90/hour Location: Remote Responsibilities Construct enterprise product scenarios for multi-quarter roadmap planning and cross-...Remote jobContract workSummer work$42 per hour
...General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14-$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated...Remote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shopify Expert - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- software engineering manager remote New York, NY
- remote recruitment consultant New York, NY
- remote data manager New York, NY
- business intelligence analyst remote New York, NY
- benefits specialist remote New York, NY