AI Annotation Specialist - Fully Remote | Upto $30/hr
$30 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Session Annotator (English)
Type: Contract
Compensation: $24–$30/hour
Location: Remote
Role Responsibilities
- Review recorded sessions where users interact with an AI assistant via voice and camera.
- Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details.
- Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
- Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
- Write detailed comments supporting scores with concrete session evidence.
- Capture conversation turns in the intake form.
Qualifications
Must-Have
- Native or native-level English , spoken and written.
- Clear, precise written English.
- An Android phone with a working camera and microphone .
- Attention to detail and consistent rubric application.
Preferred
- Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
- Training in linguistics, translation, or interpreting.
- Ability to recognize unnatural or non-native English.
Start Date
- Immediate ; high volume of work expected between 26 to 31 Aug .
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant background.
- Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Annotation Specialist - Fully Remote | Upto $30/hr in New York, NY vacancy
$62 per hour
...technical talent with leading AI research labs. Headquartered in... ...$48–$62/hour Location: Remote Role Responsibilities Red... ...Generate high-quality human data. Annotate failures, classify vulnerabilities... ...Application Process (Takes 20–30 mins to complete) Upload...Remote workContract workSummer workMercor
New York, NY5 days ago$22 per hour
...technical talent with leading AI research labs. Headquartered in... ...$20–$22/hour Location: Remote Role Responsibilities Red... ...Generate high-quality human data. Annotate failures, classify vulnerabilities... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workMercor
New York, NY16 days ago$22 per hour
...technical talent with leading AI research labs. Headquartered in... ...$16–$22/hour Location: Remote Role Responsibilities Red... ...high-quality human data by annotating failures, classifying vulnerabilities... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workMercor
New York, NY9 days ago$25 per hour
...technical talent with leading AI research labs. Headquartered in... ...$17–$25/hour Location: Remote Role Responsibilities Red... ...Generate high-quality human data. Annotate failures, classify vulnerabilities... ...Application Process (Takes 20–30 mins to complete) Upload...Remote workContract workSummer workMercor
San Francisco, CA5 days ago$25 per hour
...technical talent with leading AI research labs. Headquartered in... ...$17–$25/hour Location: Remote Role Responsibilities Red... ...Generate high-quality human data. Annotate failures, classify vulnerabilities... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$20 per hour
...As an AI Training Specialist (Data Annotation), you’ll play a key role in helping train and improve artificial... ...candidate will have: This is a fully remote position, but you must be located within... ...Competitive hourly pay from $20/hr Training provided for all...Remote workHourly payFull timePart timeRemote Talent Cloud
United States3 days ago$84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $70–$84/hour Location: Remote Role Responsibilities Design adversarial... ...scientific safety. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer workMercor
New York, NY24 days ago$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...content. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer workMercor
San Francisco, CA18 days ago$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design...Remote workContract workSummer workMercor
San Francisco, CA5 days ago$55 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $45–$55/hour Location: Remote Role Responsibilities Act as a day-to... ...or Amazon. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $90–$110/hour Location: Remote Commitment: 40 hours/week Role Responsibilities... ...LLC. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer workShift work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design...Remote jobContract workSummer work$25 per hour
...technical talent with leading AI research labs. Headquartered in... ...$20–$25/hour Location: Remote Duration: Approximately... ...consistent application of detailed annotation guidelines. Strong written... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workDay shift$30 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Conversation Data Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the accuracy and completeness...Remote jobHourly payContract workFor contractorsSummer workMercor
New York, NY4 days ago$40 - $50 per hour
...technical talent with leading AI research labs. Headquartered in... ...$40–$50/hour Location: Remote Commitment: ~5 hours/week... ...and returns. Experience in annotation, labeling, or model-evaluation... ...Application Process (Takes 20–30 mins to complete) Upload...Remote workContract workSummer workMercor
Philadelphia, PA5 days ago$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Contract Compensation: $24–$30/hour Location: Remote Role Responsibilities Review recorded... .... Preferred Experience in data annotation, linguistic QA, content moderation,...Remote jobContract workSummer workImmediate start- ...Prolific is seeking AI Training Experts to help train and evaluate cutting-edge AI models. You will complete training tasks, analyze and annotate data, and assess AI performance. If selected, you join Prolific’s participant pool and are paid for your work, with the...Remote workWork from home
Prolific Academic Ltd
United States3 days ago $105 per hour
...technical talent with leading AI research labs. Headquartered in... ...Compensation: $105/hour Location: Remote Role Responsibilities... ...delivery. Evaluate and annotate AI-generated eligibility verification... ...Application Process (Takes 20–30 mins to complete) Upload...Remote workContract workSummer workMercor
Dallas, TX5 days ago- A leading AI solutions provider is seeking AI Data Specialists to improve AI-generated content in English. This freelance, part-time position allows for a... ...Responsibilities include data collection, evaluation, annotation, and labeling across various content types....Remote workExtra incomePart timeFreelance10 hours per weekFlexible hours
RWS Group
United States1 day ago $40 - $80 per hour
...Help improve next generation AI systems by turning short video clips into precise, high quality training data. This remote contract role is well suited to detail focused contributors... ...repetitive tasks, and deliver accurate annotations. Key Responsibilities Review and...Remote workHourly payContract workFor contractorsSaidGig
United Statesmore than 2 months ago- ...Speakers to join our Expert Network to train and evaluate cutting-edge AI models using real legal expertise. If you have the necessary... ...and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $30/hr per task completed. #J-18808-LjbffrRemote work
Prolific
United States3 days ago $35 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: $35/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities... ...incomplete responses and provide structured annotations and written feedback. Identify and...Remote jobContract workSummer workMercor
New York, NY24 days ago$80 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Retail Specialist Type: Contract Compensation... ...$60–$80/hour Location: Remote Role Responsibilities Guide... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workPart timeSummer workWeekday workMercor
San Francisco, CA18 days ago$25 per hour
Prolific is hiring an AI Training Expert in Colorado Springs to assist in training and evaluating AI models. This role involves tasks such as analyzing and writing annotations and judging AI performance. Candidates must have relevant experience and be detail-oriented, with...Remote jobHourly payWork from homeFlexible hours$30 per hour
Prolific is seeking Advanced Portuguese Speakers for AI training tasks that involve analyzing, editing, and judging AI performance based on Portuguese prompts. This role offers competitive pay at $30/hr and flexibility to work from home. Successful candidates will take...Remote jobWork from homeFlexible hours$25 per hour
Prolific is seeking AI Training Experts to help train and evaluate cutting-edge AI models. Candidates will complete paid tasks requiring... ...hour. Responsibilities include analyzing, editing, and writing annotations for AI training tasks. The ideal candidates should possess AI...Remote jobHourly payWork from homeFlexible hours$30 per hour
...seeking Advanced Traditional Chinese/Cantonese-Fluent Speakers to participate in AI training tasks. In this role, you will analyze and improve AI models while being compensated at a rate of $30 per hour for tasks you complete. The position offers the flexibility to work...Remote jobHourly payWork from home$25 per hour
Prolific is seeking an AI Training Expert in Fresno, California to join their team and help train and evaluate cutting-edge AI models... ...responsibilities will include analyzing, editing, and writing annotations, as well as judging AI performance. Benefits include...Remote jobHourly payWork from homeFlexible hours- ...their Expert Network. In this role, you will help train and evaluate AI models by completing tasks that involve analyzing, editing, and... ..., and attention to detail. Successful candidates can earn up to $30/hr per task and enjoy flexible hours working from home. Join...Remote jobWork from homeFlexible hours
- ...fluent Korean speakers to join our Expert Network for AI training and evaluation tasks. You will complete... ...Prolific as participants, with paid tasks typically around $30/hour per task, and many assignments allowing remote, work-from-home participation. #J-18808-Ljbffr...Remote jobWork from homeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Annotation Specialist - Fully Remote | Upto $30/hr. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- remote reviewer New York, NY
- remote veterinarian New York, NY
- remote property manager New York, NY
- marketing assistant remote New York, NY
- remote sales consultant New York, NY
- remote ui developer New York, NY
- contract specialist remote New York, NY
- backend internship remote New York, NY