Shopify Expert - Fully Remote | Upto $50/hr
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Storefront Agent Evaluator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: up to 5 hours/week
Role Responsibilities
- Evaluate the Storefront Agent by simulating real shopper interactions, including product discovery, comparisons, and inquiries about sizing, stock, shipping, and returns.
- Grade responses based on Relevance , Accuracy , and Safety to ensure they meet shopper expectations and adhere to store policies.
- Provide concise feedback on any failures to ensure clarity for team members not present during evaluation.
- Work independently to deliver precise and repeatable judgments on agent performance.
Qualifications
Must-Have
- Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations.
- Careful, consistent judgment — apply the rubric uniformly across responses.
- Clear, concise written English — articulate reasons for response failures in a sentence or two.
Preferred
- Hands-on Shopify merchant experience — familiarity with shopper behavior on Shopify stores.
- Experience using AI shopping assistants or chat agents — understand common failure points.
- Prior work evaluating, red-teaming, or annotating AI model outputs.
- Familiarity with retail operations: catalog and variant structure, inventory, shipping, and returns policy.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Shopify Expert - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models...Remote jobContract workPart timeSummer workMercor
New York, NY18 days ago$50 per hour
...Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role... ...and model performance. Collaborate with subject matter experts to ensure consistency and coverage across datasets. Work...Remote jobContract workPart timeSummer workMercor
San Francisco, CA17 days ago$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-...Remote jobContract workSummer workWork at office$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote workContract workSummer workMercor
New York, NY8 days ago$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote workContract workSummer workMercor
New York, NY7 days ago$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial...Remote workContract workSummer workMercor
New York, NY2 days ago$120 per hour
...Summers , and Jack Dorsey . Position: Domain Expert - Legal (Lexis+ Research) Type: Contract Compensation: $76-$120/hour Location: Remote Role Responsibilities Confirm every case,... ...cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify currency...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text...Remote workContract workSummer workFlexible hoursMercor
San Francisco, CA5 days ago$90 per hour
About the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: LLM Red Team Specialist...Remote workSummer workUnited States Digital Space LLC
United States1 day ago$54 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type: Contract Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote workContract workSummer workImmediate startMercor
New York, NY2 days ago$90 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap...Remote workContract workSummer workMercor
New York, NY2 days ago$119 per hour
...Type: Contract Compensation: $94–$119/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...included. Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers. Provide one correct answer...Remote workContract workSummer workMercor
New York, NY1 day ago$100 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements...Remote workContract workSummer workMercor
New York, NY5 days ago$110 per hour
.... Position: Mathematics Research Collaborator (Part-time) Type: Contract Compensation: $80–$110/hour Location: Remote Commitment: Up to 20 hours/week Role Responsibilities Review and evaluate research papers in mathematics for correctness...Remote workContract workPart timeSummer workImmediate startMercor
San Francisco, CA3 days ago$150 per hour
...Jack Dorsey . Position: Mathematics Researchers (Part-time) Type: Contract Compensation: $90–$150/hour Location: Remote Commitment: 8–20 hours/week Role Responsibilities Author and review challenging mathematics problems to train and...Remote workContract workPart timeSummer workMercor
New York, NYa month ago$110 per hour
...: Contract Compensation: $70–$110/hour Location: Remote Commitment: 40 hours/week Role Responsibilities Guide... ...AI workloads . Collaborate with other subject matter experts to ensure consistency and accuracy in training data. Qualifications...Remote workContract workSummer workWeekday workMercor
New York, NY5 days ago$44 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Dutch Type: Contract Compensation: $44/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities...Remote workContract workSummer workImmediate startMercor
New York, NY7 days ago$100 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Development Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build valuation and merger models, including three-statement ,...Remote workContract workSummer workMercor
San Francisco, CA3 days ago$120 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Equity Research Expert Type: Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks Commitment: 10+ hours/week Role Responsibilities...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NY7 days ago$75 per hour
...Type: Contract Compensation: $60–$75/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible...Remote workContract workSummer workMercor
New York, NY2 days ago$80 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour Location: Remote Role Responsibilities Contribute subject matter expertise to a cutting-edge project with...Remote workContract workSummer workMercor
San Francisco, CA6 days ago$84 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Atomic Layer Deposition (ALD) Experts Type: Contract Compensation: $84/hour Location: Remote Commitment: 10–40 hours/week Role Responsibilities Contribute domain expertise across...Remote workContract workSummer workMercor
New York, NY3 days ago$70 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities Write expert-level prompts...Remote workContract workPart timeSummer workImmediate startMercor
New York, NYa month ago$50 per hour
Sociology Expert | $50/hr Remote | Mercor Join to apply for the Sociology Expert | $50/hr Remote | Mercor role at Crossing Hurdles Base pay range $40.00/hr - $50.00/hr Organization: Mercor Position: History / Humanities Specialist Referral Partner: Crossing Hurdles...Remote jobHourly payContract work$50 per hour
Public Relations Expert | $50/hr Remote | Mercor Join to apply for the Public Relations Expert | $50/hr Remote | Mercor role at Crossing Hurdles This range is provided by Crossing Hurdles. Your actual pay will be based on your skills and experience — talk with your recruiter...Remote jobHourly payContract work$110 per hour
We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per expert Potential...Remote job$120 per hour
...and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract... ...: $76–$120/hour Location: Remote Role Responsibilities Confirm every... ...point cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify...Remote jobContract workSummer work$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$120 per hour
...Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA7 days ago$50 per hour
..., and Jack Dorsey . Position: Healthcare Administrative Specialist Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Evaluate and improve administrative workflows in healthcare settings, focusing on patient...Remote workContract workSummer workWork at officeMercor
New York, NY7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shopify Expert - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- subject matter expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- sql expert New York, NY
- operations coordinator remote New York, NY
- remote appointment scheduler New York, NY
- head of marketing remote New York, NY
- content designer remote New York, NY
- remote coordinator New York, NY