Shop App Annotator - Fully Remote | Upto $50/hr
$50 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Shop App Agent Annotator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: ~5 hours/week
Role Responsibilities
- Evaluate full shopper and agent conversations, including tool calls and their outcomes.
- Identify the specific turn that received a thumbs-down from the shopper.
- Classify the issue with one primary tag and a specific secondary tag.
- Write concise comments explaining the shopper's intent, the agent's actions, and the rationale for the tags.
- Work independently and asynchronously to maintain consistency across evaluations.
Qualifications
Must-Have
- Rule discipline for consistent taxonomy application.
- Comfort reading structured traces to understand agent actions.
- Restraint under ambiguity to use the unknown label appropriately.
- Clear, concise written English for effective communication.
Preferred
- Consumer e-commerce fluency in orders, tracking, and returns.
- Experience in annotation, labeling, or model-evaluation work .
- Familiarity with the Shop app or other AI shopping assistants.
- Knowledge of customer-support operations and escalation paths.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Shop App Annotator - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Agent Evaluator Type: Contract Compensation: $40–$50/hour Location: Remote Commitment: up to 5 hours/week Role... ...Qualifications Must-Have Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Quality Analyst Type: Contract Compensation: $20–$50/hour Location: Remote Role Responsibilities Review work product against defined quality standards, rubrics, and guidelines. Identify...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-stakeholder IEP/504 planning, and...Remote workApplicationContract workSummer workWork at officeMercor
San Francisco, CA2 days ago$50 per hour
...and Jack Dorsey . Position: German Language and Literature Expert (German) Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated German text across various use cases...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Software Engineer Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Build MCP servers in Python... ...configuration. Implement populate/snapshot hooks for app state management. Test apps locally and debug build,...Remote jobApplicationContract workSummer workLocal area$18.5 per hour
...good for the planet. Buyers love shopping value, premium and luxury... ...Companies of 2023, Digiday's WorkLife 50 2023, TIME's Best Inventions... ...Use a USB scanner and iPad app with step-by-step prompts Record... ...Here Starting Pay: $18.50/hr for PM shift ($17 base + $1.50...ApplicationHourly payWeekly payCasual workShift workthredUP
Shermans Dale, PA7 days ago$50 per hour
...Shopping Expert (Remote) Hourly contract, 1-2 months with possibility of extension. Compensation: $30–$50/hour Location: Remote Duration: 1-2 months (extension feasible) Commitment: 10–40 hours/week Role Responsibilities: Develop and refine domain-specific prompts related...Remote workApplicationHourly payContract workCrossing Hurdles
United States3 days ago$60 per hour
...Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets . Review annotator quality to ensure high standards....Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Dorsey . Position: Voice Actor: CX Agent Voice Cloning (African American) Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Record high-quality voice samples across diverse scripts, including conversational, narrative...Remote jobApplicationContract workSummer work$50 per hour
..., Larry Summers , and Jack Dorsey . Position: Social Work Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct social work scenarios for complex case assessment, multi-stakeholder care coordination...Remote jobApplicationContract workSummer work$50 per hour
..., and Jack Dorsey . Position: Editorial and Media Practice Reviewer Type: Contract Compensation: $45–$50/hour Location: Remote Role Responsibilities Evaluate AI work products in editorial and media fields to ensure task realism and domain...Remote jobApplicationContract workSummer work$104k
...Automotive Benefits: ~*Up to $50/HR For The Most Skilled... ...Paid Holidays ~ Air Conditioned Shop to work in ~ Closed Every Weekend... ...Financial Wellness Program and App, SmartDollar & EveryDollar ~*... ...preferred, or a plan to achieve Fully Developed competency in...ApplicationHourly payPrice workFull timeLocal areaRelocation package$50 per hour
..., and Jack Dorsey . Position: American English Professional Voice Actor Type: Contract Compensation: $50/hour Location: Remote Duration: 1–2 weeks Commitment: 2–10 hours/week Role Responsibilities Collaborate with a leading AI lab...Remote jobApplicationContract workSummer work$50 per hour
..., and Jack Dorsey . Position: Healthcare Administrative Specialist Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Evaluate and streamline patient access workflows, including registration, scheduling, and...Remote jobApplicationContract workSummer workWork at office$50 per hour
..., and Jack Dorsey . Position: Healthcare Administrative Specialist Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Evaluate and improve administrative workflows in healthcare settings, focusing on patient...Remote jobApplicationContract workSummer workWork at office$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Position Gambling Manager Type Hourly contract Compensation $20–$50/hour Location Remote Commitment 10–40 hours/week Role Responsibilities Train and... ...Comfortable working independently and collaboratively in a fully remote environment. Application Process (Takes 20 Min)...Remote workApplicationHourly payContract workShift workCrossing Hurdles
United States4 days ago$120 per hour
...Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and... ...authority is found and on-point cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify currency by checking...Remote workApplicationContract workSummer workMercor
San Francisco, CA2 days ago$60 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial underwriting, multi-...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$70 per hour
...Summers , and Jack Dorsey . Position: B2B Sales Expert (3+ YOE, US Only) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Generate and qualify pipeline through outbound efforts, executive relationships, events,...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$63 per hour
..., and Jack Dorsey . Position: Applied Psychology Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original psychology questions that test deep conceptual...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$50 per hour
...Competitive Pay for Qualified Technicians Climate Controlled Shop Paid Vacation & Paid Holidays Closed Every Weekend To... ...and import vehicles ~ Have the drive and the ability to flag 40-50+ hours per week ~ Knowledgeable with reflashing/reprogramming...ApplicationFull timeLocal areaWeekend workChristian Brothers Automotive
Daphne, AL3 days ago$60 per hour
...Expert Interviewer Type: Contract Compensation: $50–$60/hour Location: Remote Commitment: 10 hours/week Role Responsibilities... ...availability. Reliable commitment to 10 hours/week , fully Remote . Application Process (Takes 20–30 mins to...Remote workApplicationContract workPart timeSummer workWeekday workMercor
San Francisco, CA2 days ago$65 per hour
...Dorsey . Position: Retail and Pharmacy Practice Reviewer Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate AI work product in retail and pharmacy fields to ensure task realism and accuracy. Review...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$80 per hour
...Larry Summers , and Jack Dorsey . Position: Full-Stack Software Engineer Type: Contract Compensation: $50–$80/hour Location: Remote Role Responsibilities Write precise product specifications for application development and automatic grading....Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$104k
...Automotive Benefits: Paid Vacation & Paid Holidays Fully Climate Controlled Shop Employee Discounts Closed Every Weekend To Spend Time... ...Employer-paid Financial Wellness Program and App, SmartDollar & EveryDollar ASE Certification Reimbursement...ApplicationHourly payFull timeLocal areaRelocation packageWeekend work$80 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: HR Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities Construct HR scenarios spanning talent acquisition, workforce...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$85 per hour
...Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$64 per hour
...Jack Dorsey . Position: Software Developer — O NET Occupation Study Type: Contract Compensation: $64/hour Location: Remote * Role Responsibilities Complete a one-time online survey/interview about your day-to-day work as a software developer. It takes...Remote workApplicationContract workSummer workMercor
New York, NY2 days ago$100 per hour
...and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements, and variance explanation....Remote workApplicationContract workSummer workMercor
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shop App Annotator - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- field application scientist New York, NY
- cash applications coordinator New York, NY
- cash application clerk New York, NY
- application scientist New York, NY
- application security lead New York, NY
- product manager mobile applications New York, NY
- applications consultant New York, NY
- cash application representative New York, NY
- app delivery New York, NY
- senior application security New York, NY