Shopify Expert - Fully Remote | Upto $50/hr
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Storefront Agent Evaluator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: up to 5 hours/week
Role Responsibilities
- Evaluate the Storefront Agent by simulating real shopper interactions, including product discovery, comparisons, and inquiries about sizing, stock, shipping, and returns.
- Grade responses based on Relevance , Accuracy , and Safety to ensure they meet shopper expectations and adhere to store policies.
- Provide concise feedback on any failures to ensure clarity for team members not present during evaluation.
- Work independently to deliver precise and repeatable judgments on agent performance.
Qualifications
Must-Have
- Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations.
- Careful, consistent judgment — apply the rubric uniformly across responses.
- Clear, concise written English — articulate reasons for response failures in a sentence or two.
Preferred
- Hands-on Shopify merchant experience — familiarity with shopper behavior on Shopify stores.
- Experience using AI shopping assistants or chat agents — understand common failure points.
- Prior work evaluating, red-teaming, or annotating AI model outputs.
- Familiarity with retail operations: catalog and variant structure, inventory, shipping, and returns policy.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Shopify Expert - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-...Remote workContract workSummer workWork at officeMercor
San Francisco, CA2 days ago$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training. Provide one correct answer...Remote workContract workSummer workMercor
New York, NY2 days ago$120 per hour
...and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract... ...: $76–$120/hour Location: Remote Role Responsibilities Confirm every... ...point cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote workContract workSummer workMercor
New York, NY2 days ago$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote workContract workSummer workMercor
New York, NY2 days ago$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial...Remote workContract workSummer workMercor
New York, NY2 days ago$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: B2B Sales Expert (3+ YOE, US Only) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Generate and qualify pipeline through outbound efforts,...Remote workContract workSummer workMercor
New York, NY2 days ago$60 per hour
...Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation: $50–$60/hour Location: Remote Commitment: 10 hours/week Role... ...Reliable commitment to 10 hours/week , fully Remote . Application Process (Takes 2...Remote workContract workPart timeSummer workWeekday workMercor
San Francisco, CA2 days ago$50 per hour
...Sociology Expert | $50/hr Remote | Mercor Join to apply for the Sociology Expert | $50/hr Remote | Mercor role at Crossing Hurdles Base pay range $40.00/hr - $50.00/hr Organization: Mercor Position: History / Humanities Specialist Referral Partner...Remote workHourly payContract workCrossing Hurdles
United States4 days ago$110 per hour
...We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per...Remote workObsidian
United States3 days ago$70 per hour
...specialized chemistry topics. No prior AI/ML experience is required — we'll train you on the workflow. What you'll do Write expert‑level prompts across specialized chemistry topics. Evaluate and annotate model responses for scientific accuracy, helpfulness, and...Remote workPart timeImmediate startObsidian
United States21 hours ago$160 per hour
...Jack Dorsey . Position: Event / Hospitality Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide...Remote jobContract workSummer workMercor
New York, NY9 days ago$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$170 per hour
...asynchronously to meet deadlines. Improve AI model performance through rigorous data analysis. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets. Qualifications Must-Have ~5+ years of experience required...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NY2 days ago$120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Banking (Oracle FLEXCUBE Research) Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm the customer/contract position reflects...Remote workContract workSummer workMercor
New York, NY2 days ago$100 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Excel Expert — Office / Retail Management Type: Contract Compensation: $70-$100/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Guide research teams to close...Remote jobContract workSummer workWork at officeWeekday work$110 per hour
...Type: Contract Compensation: $70–$110/hour Location: Remote Duration: 4–6 weeks Commitment: 20+ hours/week Role... ...interpretation, and client advisory decisions, providing expert feedback. Collaborate with AI research teams to improve AI...Remote workHourly payContract workSummer workImmediate startMercor
New York, NY2 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$190 per hour
...: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Review... ...teams can act on to improve AI systems . Contribute expert input on annotation guidelines, documentation standards, and edge...Remote workContract workWork experience placementSummer workMercor
New York, NY2 days ago$100 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements...Remote workContract workSummer workMercor
New York, NY2 days ago$100 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California...Remote workContract workSummer workMercor
New York, NY2 days ago$140 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Survey Research & Pharma Insights Expert Type: Contract Compensation: $140/hour Location: Remote Role Responsibilities Design, review, and refine physician and patient survey...Remote workContract workSummer workMercor
New York, NY2 days ago$80 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Accounting Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities Construct accounting scenarios spanning financial statement...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$12 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Malayalam Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find publicly accessible Malayalam PDFs...Remote workContract workWork experience placementSummer workMercor
New York, NY2 days ago$90 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Architecture Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content...Remote workContract workPart timeSummer work10 hours per weekMercor
San Francisco, CA2 days ago$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter...Remote workContract workSummer workMercor
New York, NY2 days ago$19 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Telugu Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote workContract workSummer workImmediate startMercor
New York, NY2 days ago$60 per hour
...Dorsey . Position: Fire & Life Safety Reviewer — Vulcan Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks from real fire and life safety review work, including egress and life safety...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NY2 days ago$55 per hour
...Type: Contract Compensation: $45–$55/hour Location: Remote Role Responsibilities Evaluate and utilize MATLAB for... ...to meet project deadlines. Collaborate with subject matter experts to enhance the quality and accuracy of AI-generated content...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote workContract workSummer workImmediate startMercor
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shopify Expert - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- guest service support expert New York, NY
- fulfillment expert New York, NY
- subject matter expert New York, NY
- sql expert New York, NY
- technology expert New York, NY
- remote reviewer New York, NY
- remote veterinarian New York, NY
- remote property manager New York, NY
- marketing assistant remote New York, NY
- remote sales consultant New York, NY