Shop App Annotator - Fully Remote | Upto $50/hr
$50 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Shopify Shop App Agent Annotator
Type: Contract
Compensation: $40–$50/hour
Location: Remote
Commitment: ~5 hours/week
Role Responsibilities
- Evaluate full shopper and agent conversations, including tool calls and their outcomes.
- Identify the specific turn that received a thumbs-down from the shopper.
- Classify the issue with one primary tag and a specific secondary tag.
- Write concise comments explaining the shopper's intent, the agent's actions, and the rationale for the tags.
- Work independently and asynchronously to maintain consistency across evaluations.
Qualifications
Must-Have
- Rule discipline for consistent taxonomy application.
- Comfort reading structured traces to understand agent actions.
- Restraint under ambiguity to use the unknown label appropriately.
- Clear, concise written English for effective communication.
Preferred
- Consumer e-commerce fluency in orders, tracking, and returns.
- Experience in annotation, labeling, or model-evaluation work .
- Familiarity with the Shop app or other AI shopping assistants.
- Knowledge of customer-support operations and escalation paths.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Shop App Annotator - Fully Remote | Upto $50/hr in New York, NY vacancy
$50 per hour
...Summers , and Jack Dorsey . Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models on visual document understanding...Remote jobApplicationContract workPart timeSummer workMercor
New York, NY23 days ago$50 per hour
...Agent Evaluator Type: Contract Compensation: $40–$50/hour Location: Remote Commitment: up to 5 hours/week Role... ...Qualifications Must-Have Consumer e-commerce fluency — you shop online regularly and understand effective product recommendations...Remote workApplicationContract workSummer workMercor
New York, NY14 days ago$50 per hour
..., and Jack Dorsey . Position: Education — Visual Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding and...Remote workApplicationContract workPart timeSummer workMercor
San Francisco, CAa month ago$50 per hour
...Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-stakeholder IEP/504 planning, and...Remote workApplicationContract workSummer workWork at officeMercor
San Francisco, CA10 days ago$50 per hour
...Summers , and Jack Dorsey . Position Voice Actor: CX Agent Voice Cloning (Australian English) Type Contract Compensation $50/hour Location Remote Commitment 5-10 hours/week Role Responsibilities Record high-quality voice samples across diverse scripts, including conversational...Remote jobApplicationContract workSummer work10 hours per week$50 per hour
..., and Jack Dorsey . Position: Healthcare Administrative Specialist Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Evaluate and improve administrative workflows in healthcare settings, focusing on patient...Remote workApplicationContract workSummer workWork at officeMercor
New York, NY12 days ago$50 per hour
Shopping Expert (Remote) Hourly contract, 1-2 months with possibility of extension. Compensation: $30-$50/hour Location: Remote Duration: 1-2 months (extension feasible) Commitment: 10-40 hours/week Role Responsibilities: Develop and refine domain-specific prompts related...Remote jobApplicationHourly payContract work$150 per hour
...Jack Dorsey . Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each...Remote workApplicationContract workSummer workMercor
New York, NY13 days ago$50 per hour
...Position Gambling Manager Type Hourly contract Compensation $20–$50/hour Location Remote Commitment 10–40 hours/week Role Responsibilities Train and... ...Comfortable working independently and collaboratively in a fully remote environment. Application Process (Takes 20 Min)...Remote workApplicationHourly payContract workShift workCrossing Hurdles
New York, NY3 days ago$60 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial underwriting, multi-...Remote workApplicationContract workSummer workMercor
New York, NY7 days ago$63 per hour
..., and Jack Dorsey . Position: Applied Psychology Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original psychology questions that test deep conceptual...Remote workApplicationContract workSummer workMercor
New York, NY6 days ago$190 per hour
...Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: MCP & Plug In Connectors ExpertType:ContractCompensation:$50-$190/hourLocation:RemoteCommitment:20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows,...Remote jobApplicationHourly payFor contractorsSummer workTrial period$70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality...Remote workApplicationContract workSummer workFlexible hoursMercor
New York, NY5 days ago$120 per hour
...Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and... ...authority is found and on-point cases are not missed. Maintain distinct 50-state/multi-jurisdiction splits. Verify currency by checking...Remote jobApplicationContract workSummer workMercor
San Francisco, CA14 days ago$175 per hour
...Larry Summers , and Jack Dorsey . Position: JSON-fluent & Rubrics Expert Type: Contract Compensation: $50–$175/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate JSON-formatted AI model outputs against...Remote jobApplicationContract workSummer workStart working todayMercor
San Francisco, CA10 days ago$180 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Physics PhD (Top 50 Program, US/UK/CA) Type: Contract Compensation: $70–$180/hour Location: Remote Role Responsibilities Solve and evaluate challenging physics problems across various...Remote workApplicationContract workSummer workImmediate startMercor
San Francisco, CAa month ago$60 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist (Macbook User) Type: Contract Compensation: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Develop high-quality research questions, answers, and evaluation...Remote workApplicationContract workSummer workImmediate startFlexible hoursMercor
San Francisco, CA8 days ago$70 per hour
.... Position: Network Engineer - Data for Autonomous Systems annotation Type: Contract Compensation: $50–$70/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review real-world data from deployed networks, including...Remote workApplicationContract workSummer workMercor
New York, NY6 days ago$90 per hour
...Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $50–$90/hour Location: Remote Commitment: 40 hours/week Role Responsibilities Evaluate the quality of legal knowledge work tasks and AI...Remote jobApplicationWeekly payContract workSummer workMercor
San Francisco, CA10 days ago$60 per hour
...Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Government & Public Policy ExpertType:ContractCompensation:$50-$60/hourLocation:Remote Role Responsibilities Design realistic public-sector scenarios and tasks from your experience. Focus on policy options...Remote jobApplicationContract workSummer workLocal area$50 per hour
Mercor is partnering with a leading AI research lab to build next-generation text-to-speech (TTS) systems capable of producing natural, expressive, and human-like voices. We are seeking USA-based voice actors with native Southern American English accents (e.g. Texas, Georgia...Remote jobTemporary work10 hours per week$90 per hour
...Summers , and Jack Dorsey . Position: Finance Domain Expert — AI Training & Evaluation Type: Contract Compensation: $50–$90/hour Location: Bay Area, California Commitment: 40 hours/week Role Responsibilities Evaluate the quality of...Remote workApplicationContract workSummer workMercor
San Francisco, CA8 days ago- ...Manufacturing Senior Analyst to drive data-driven improvements on client shop floors. This remote-friendly role requires 50-75% travel and focuses on designing digital solutions, dashboards, and apps that boost productivity across industries. You will leverage MES, low-...Remote jobApplication
$80 per hour
...and Jack Dorsey . Position: Electrical Engineering Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities Construct enterprise electrical engineering scenarios for complex circuit and systems design cycles,...Remote jobApplicationContract workSummer workMercor
San Francisco, CA10 days ago$90 per hour
...and Jack Dorsey . Position: Electrical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses in...Remote jobApplicationContract workPart timeSummer workMercor
San Francisco, CA12 days ago$100 per hour
...Position: Electrical Engineering & RF/Circuit Design Expert Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Design challenging computational problems to test AI systems using...Remote jobApplicationContract workSummer workMercor
New York, NY23 days ago$100 per hour
...Position: Electrical Engineering & RF/Circuit Design Expert Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Design challenging computational problems to test AI using real scientific...Remote jobApplicationContract workSummer workMercor
San Francisco, CA10 days ago$90 per hour
...and Jack Dorsey . Position: Electrical Engineering Expert Type: Contract Compensation: $65–$90/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review and evaluate written content and AI-generated responses in...Remote jobApplicationContract workPart timeSummer workMercor
San Francisco, CA4 days ago$120k - $145k
...while doing good for the planet. Buyers love shopping value, premium and luxury brands all in... ...Influential Companies of 2023, Digiday's WorkLife 50 2023, TIME's Best Inventions of 2022, and... ...: 3 days in the office and 1 day remote each weekCompetitive salary (we leverage market...Remote workApplicationFull timeWork at office$100 per hour
...and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements, and variance explanation....Remote workApplicationContract workSummer workMercor
New York, NY10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Shop App Annotator - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- director of enterprise application services New York, NY
- cash application clerk New York, NY
- paper application New York, NY
- director enterprise applications New York, NY
- now accepting applications New York, NY
- application system administrator New York, NY
- cash application representative New York, NY
- applications consultant New York, NY
- oracle apps technical consultant New York, NY
- app support New York, NY