Shopify Expert - Fully Remote | Upto $50/hr
$50 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Storefront Agent Evaluator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: up to 5 hours/week
Role Responsibilities
- Evaluate the Storefront Agent by simulating real shopper interactions, including product discovery, comparisons, and inquiries about sizing, stock, shipping, and returns.
- Grade responses based on Relevance , Accuracy , and Safety to ensure they meet shopper expectations and adhere to store policies.
- Provide concise feedback on any failures to ensure clarity for team members not present during evaluation.
- Work independently to deliver precise and repeatable judgments on agent performance.
Qualifications
Must-Have
- Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations.
- Careful, consistent judgment — apply the rubric uniformly across responses.
- Clear, concise written English — articulate reasons for response failures in a sentence or two.
Preferred
- Hands-on Shopify merchant experience — familiarity with shopper behavior on Shopify stores.
- Experience using AI shopping assistants or chat agents — understand common failure points.
- Prior work evaluating, red-teaming, or annotating AI model outputs.
- Familiarity with retail operations: catalog and variant structure, inventory, shipping, and returns policy.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Shopify Expert - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models...Remote jobContract workPart timeSummer workMercor
New York, NY10 days ago$50 per hour
...Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role... ...and model performance. Collaborate with subject matter experts to ensure consistency and coverage across datasets. Work...Remote jobContract workPart timeSummer work$110 per hour
...We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per...Remote workObsidian
United States4 days ago$50 - $60 per hour
DataAnnotation in California, Missouri is seeking a Medical Expert to help train AI models by providing healthcare-related scenarios. Responsibilities... ...offers flexibility to work from home and is compensated at $50-$60 per hour with potential bonuses. To qualify, candidates must...Remote jobHourly payContract workWork from home$50 - $60 per hour
DataAnnotation is seeking a Medical Expert to help train AI models. The role requires evaluating AI outputs and ensuring medical accuracy... ...schedule, working from home. Compensation is hourly starting at $50-$60 USD, with potential bonuses on certain projects. #J-18808-Ljbffr...Remote jobHourly payContract workWork from home$50 - $60 per hour
DataAnnotation is seeking a Medical Expert to assist in training AI models by providing diverse healthcare problems and evaluating AI outputs... ...with projects chosen on your schedule, paid hourly starting at $50-$60 USD. Ideal for professionals wishing to work from home. #J-...Remote jobHourly payContract workFor contractorsWork from home$50 - $60 per hour
DataAnnotation is looking for an experienced Medical Expert to help train AI models by evaluating their... ...healthcare-related problems. This role allows you to work remotely, setting your own schedule while earning between $50 and $60 per hour. Applicants must be fluent in...Remote jobHourly payContract work$50 - $60 per hour
DataAnnotation in Washington, DC, is seeking a Medical Expert to assist in training AI models through evaluating healthcare-related outputs... ...medical degree. The position offers hourly pay starting at $50-$60, ensuring flexibility and independence in your professional...Remote jobHourly payContract workFor contractors$50 per hour
Sociology Expert | $50/hr Remote | Mercor Join to apply for the Sociology Expert | $50/hr Remote | Mercor role at Crossing Hurdles Base pay range $40.00/hr - $50.00/hr Organization: Mercor Position: History / Humanities Specialist Referral Partner: Crossing Hurdles...Remote jobHourly payContract work$120 per hour
...Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual,...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA29 days ago$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$50 - $60 per hour
DataAnnotation is seeking a Medical Expert to assist in training AI models. This position offers flexibility as you can choose projects to... ...medical degree and be fluent in English. Payment starts at $50-$60 USD per hour, with additional bonus rates available. #J-188...Remote jobHourly payContract work$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote jobContract workSummer work$110 per hour
...Summers , and Jack Dorsey . Position: Real Estate Brokers Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/week Role Responsibilities Create deliverables addressing common...Remote jobContract workSummer workImmediate start$150 per hour
...Jack Dorsey . Position: Mathematics Researchers (Part-time) Type: Contract Compensation: $90–$150/hour Location: Remote Commitment: 8–20 hours/week Role Responsibilities Author and review challenging mathematics problems to train and...Remote jobContract workPart timeSummer work$120 per hour
...Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at office$180 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Internal Medicine Expert Type: Contract Compensation: $130–$180/hour Location: Remote Duration: Ongoing Commitment: 20+ hours/week Role Responsibilities Design clinically...Remote jobWeekly payContract workSummer workWork at office$120 per hour
...Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at office$100 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Particle & Nuclear Physics Expert Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Design challenging...Remote jobContract workSummer work$70 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities Write expert-level prompts...Remote jobContract workPart timeSummer workImmediate start$60 - $85 per hour
...onboarding, payroll, benefits administration, HR policy, compliance, and structured... .... This role supports current and upcoming remote consulting opportunities focused on HR and... ...Details ~Independent contractor role. ~Fully remote with flexible scheduling. ~Part-...Remote workHourly payWeekly payContract workPart timeFor contractorsWork at officeFlexible hours24-MAG
Remote29 days ago$50 per hour
...Newark, New Jersey? I am in search of a skilled, passionate, and dedicated tutor who can help me improve my English skills. My budget is $50.0 per hour, and I am looking for someone who can commit to regular sessions. If you have experience teaching English and are located...Hourly pay$75 per hour
...recruiter to learn more. Base pay range $60.00/hr - $75.00/hr Position: Archivists Type: Hourly contract Location: Remote Commitment: Minimum 15 hours/week Role Responsibilities... ...supported). Ability to work independently in a fully remote environment. Application Process (Takes...Remote workHourly payFull timeContract workCrossing Hurdles
New York, NY19 hours ago$50 per hour
...Shopping Expert (Remote) Hourly contract, 1-2 months with possibility of extension. Compensation: $30–$50/hour Location: Remote Duration: 1-2 months (extension feasible) Commitment: 10–40 hours/week Role Responsibilities: Develop and refine domain-specific prompts related...Remote workHourly payContract workCrossing Hurdles
New York, NY19 hours ago$85 per hour
.... Position: Underpayment & Managed-care Contract Specialist Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Identify, analyze, and recover underpayments and payment variances across commercial, Medicare Advantage...Remote jobDaily paidContract workSummer work$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Build MCP servers in Python using FastMCP . Integrate...Remote jobContract workSummer workLocal area$50 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Dutch Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Duration: 3–6 months Role Responsibilities Transcribe audio and video with precision...Remote jobContract workSummer work$20.35 - $23 per hour
Role Description As a Financial Wellness Expert, you will provide compassionate, non-judgmental... ...through phone-based services. This fully remote position is ideal for individuals who are... ...internal learning and development programs ~50% tuition discount through Cleary College...Remote workFull timeWork from homeHome officeShift workgreenpath, inc.
Remote26 days ago$75 per hour
...experience — talk with your recruiter to learn more. Base pay range $65.00/hr - $75.00/hr Position: Chemistry Expert (Master’s / PhD) Type: Hourly contract Compensation: $65–$75/hour Location: Remote Commitment: Part-time (15–20 hours per week, with potential extension)...Remote workHourly payContract workPart timeCrossing Hurdles
New York, NY19 hours ago$50 per hour
A leading research accelerator for AI is seeking remote PhD graduates in Biology, Biotechnology, or Biochemistry... ...researchers. The position offers competitive pay of $50+/hour with flexible working hours in a fully remote environment. No prior AI experience is necessary...Remote workFlexible hoursTuring
Los Angeles, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shopify Expert - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- fulfillment expert New York, NY
- remote appointment setter New York, NY
- remote clinical New York, NY
- junior front end developer remote New York, NY
- technical writer remote New York, NY
- case manager remote New York, NY
- remote chef New York, NY