Video Evaluation Expert - Fully Remote | Upto $20/hr
$20 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
- Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
- Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
- Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
Preferred
- 2+ years of experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Video Evaluation Expert - Fully Remote | Upto $20/hr in New York, NY vacancy
$60 per hour
...Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks from real fire and life... ...areas and conduct fire occupancy video inspections. Verify firestop... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobVideoHourly payContract workFor contractorsSummer work$80 per hour
...PhDs and Technical Domain Experts Type: Contract... ...0/hour Location: Remote Role Responsibilities... ...in your domain. Evaluate and improve AI model performance... ...interview and task (20–30 mins ). Paid... ...this and a few onboarding videos if hired. Application...Remote jobVideoContract workSummer work$90 per hour
...Jack Dorsey . Position: Visual Quality Expert (Film, VFX & Animation) Type:... ...Compensation: $60–$90/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate high-resolution video and stills at the pixel level . Identify...Remote jobVideoContract workSummer work$19 per hour
.... Position: Music & Lyrics Expert - Bengali Type: Contract... ...$11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities... ...adherence, and originality. Evaluate whether lyrics sound natural, including...Remote jobContract workSummer workImmediate start$70 per hour
...Position: Video related professional for AI training Type: Contract Compensation: $20 - $70/hour Location: Remote Commitment: 10-40 hrs/week Role Responsibilities... ...for model training and evaluation. Review and critique AI-... ...video concepts to non-experts. Be able to work...Remote workVideoContract workCrossing Hurdles
United States2 days ago$70 per hour
...Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract... ...: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of... ...setup. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$54 per hour
...Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type:... ...Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various...Remote jobContract workSummer workImmediate start$90 per hour
...$60–$90/hour Location: Remote Commitment: 35 hours/week... ...insights with researchers and fellow experts to continually improve the... ...-engineering, security, or AI-evaluation roles. ~ Ability to identify... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and... .... Collaborate with teams to improve evaluation processes and methodologies. Work independently... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of Kubernetes tasks for... ...task-grading experience. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobContract workSummer work$140 per hour
...Survey Research & Pharma Insights Expert Type: Contract... ...: $140/hour Location: Remote Role Responsibilities Design... ...methodologically sound questionnaires. Evaluate screeners, eligibility... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$60 per hour
...Compensation: $60/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ...outputs and objective rubrics. Evaluate AI models on visual document understanding... ...Collaborate with subject matter experts to ensure task relevance and...Remote jobContract workPart timeSummer work$90 per hour
...Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction &... ...Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text errors in... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workFlexible hours$120 per hour
...Dorsey . Position: Legal Expert — Regulatory, Privacy & Healthcare... ...$100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI-generated legal content to... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$150 per hour
...Investment Banking & M&A - Finance Domain Expert Type: Contract Compensation: $1... ...40 hours/week Role Responsibilities Evaluate the quality of finance knowledge work tasks... ...week. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer work$60 per hour
...Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-... ...specifications for web applications. Evaluate if product requests are realistic, complete... ...QA teams. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer work$160 per hour
...Position: Analyst / Insights Experts Type: Contract Compensation... ...$80–$160/hour Location: Remote Role Responsibilities... ...to contribute to high-impact evaluation projects. Collaborate asynchronously... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workFlexible hours$84 per hour
...Compensation: $84/hour Location: Remote Role Responsibilities... ...review workflows. Evaluate AI-generated clinical documentation... ...working independently in a fully remote environment. Preferred... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$100 per hour
...Summers , and Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $60–$100/hour Location... ...and able to work on-site. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$110 per hour
...Collaborator (Part-time) Type: Contract Compensation: $80–$110/hour Location: Remote Commitment: Up to 20 hours/week Role Responsibilities Review and evaluate research papers in mathematics for correctness, novelty, and rigor. Author and...Remote jobContract workPart timeSummer workImmediate start$12 per hour
...PDF Annotation & Transcription Experts – Malayalam Type:... ...Compensation: $13/hour Location: Remote Role Responsibilities... ...annotation, labeling, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workWork experience placementSummer work$55 per hour
...Compensation: $45–$55/hour Location: Remote Role Responsibilities Evaluate and utilize MATLAB for numerical... ...Collaborate with subject matter experts to enhance the quality and accuracy... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...Dorsey . Position: Legal Expert — Disputes & International (Project... ...$100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal content in... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$110 per hour
...$70–$110/hour Location: Remote Commitment: 40 hours/week... ...performance engineering problems. Evaluate performance engineering tasks... ...with other subject matter experts to ensure consistency and... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWeekday work$12 per hour
...PDF Annotation & Transcription Experts – Telugu Type: Contract... ...Compensation: $13/hour Location: Remote Role Responsibilities... ...data annotation or bilingual evaluation. Skills in transcription,... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$40 per hour
...Contract Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Unreal Engine on... ...monitor or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer workFlexible hours$120 per hour
...Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer workWork at office$19 per hour
...Dorsey . Position: Music & Lyrics Expert - Telugu Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobContract workSummer workImmediate start$44 per hour
.... Position: Music Audio Expert - Dutch Type: Contract... ...Compensation: $44/hour Location: Remote Duration: Up to 6 months... ...Role Responsibilities Evaluate AI model output for lyrics... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workImmediate start$50 per hour
...Dorsey . Position: Shopify Storefront Agent Evaluator Type: Contract Compensation: $40–$50/hour Location: Remote Commitment: up to 5 hours/week Role... ...policy. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Video Evaluation Expert - Fully Remote | Upto $20/hr. Be the first to apply!
Related searches
- guest service support expert New York, NY
- fulfillment expert New York, NY
- subject matter expert New York, NY
- sql expert New York, NY
- technology expert New York, NY
- video camera New York, NY
- video creator New York, NY
- video interpreter New York, NY
- video streaming New York, NY
- audio video engineer New York, NY