Generalist Expert - Content Evaluator
$50 - $70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert (US/Canada)
Type: Contract
Compensation: $50–$70/hour
Location: Remote
Role Responsibilities
- Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness.
- Provide clear, well-reasoned written feedback and ratings.
- Compare and rank AI-generated outputs against defined criteria.
- Flag errors, inconsistencies, and gaps in reasoning or formatting.
- Work independently across common productivity tools with flexible hours .
Qualifications
Must-Have
- Bachelor's degree (minimum requirement)
- Based in the United States or Canada
- Excellent reading comprehension and written communication in English
- Strong attention to detail and sound judgment across varied subject matter
- Comfort working independently across common productivity tools (docs, slides, sheets)
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Generalist Expert - Content Evaluator in New York, NY vacancy
$50 per hour
...Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation... ...Transcribe and optimize audio and video content in Hindi, ensuring clarity and accuracy. Produce high-...ContentContract workSummer work10 hours per weekMercor
New York, NY6 days ago$50 per hour
...and Jack Dorsey . Position: Spanish (Mexico) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location... ...Transcribe and optimize audio and video content in Spanish (Mexico) , ensuring clarity and adherence to guidelines...ContentContract workSummer workRemote workMercor
New York, NY6 days ago- ...growing network of industry experts supporting AI research and development... ...professionals to help evaluate and improve how AI systems... ...clinical expertise to review content for accuracy, answer domain-specific... ...experience; broad or generalist clinical exposure is a plus over...ContentContract workPart timeRemote work10 hours per weekFlexible hours
- ...looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with Krita and...ContentContract workRemote workFlexible hours
Handshake
New York, NY3 days ago - ...experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design... ...booking, logged-in customer portals, UX writing and product content, and design-to-engineering/production handoff) Score AI-generated...Content
$60 - $70 per hour
...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-harm, violence, cyber...ContentContract workSummer workRemote workMercor
New York, NY8 days ago- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex,... ...factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-harm,...ContentWorldwide
$30 per hour
...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image... ...distinguish between "consumer-grade" and "enterprise-ready" content, ensuring outputs are professional and highly readable....ContentRemote jobWork from homeFlexible hours$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... ...Google Workspace , especially Slides , to assess and review content. Qualifications Must-Have ~5+ years of relevant professional...ContentContract workSummer workWork at officeRemote work- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Provide clear, structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for...ContentContract workSummer workWork at officeRemote work$24 - $45 per hour
...apply for the Portuguese Biology Expert role at Mercor Join to apply for... ...Portuguese and English) to review, evaluate, and refine AI-generated content involving scientific, mathematical,... .... Ideal Qualifications: Generalist, STEM & Linguistic Proficiency:...ContentContract workSummer workFreelanceRemote workMercor Inc
New York, NY4 days ago$20 per hour
...Larry Summers, and Jack Dorsey. Position Generalist - English & Urdu Type Contract... ...external tools. Generate high-quality human evaluation data by identifying response strengths,... ...writing or editing high-quality written content Experience comparing multiple outputs and...ContentRemote jobContract workPart timeSummer work- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap Compensation: this...Hourly payImmediate startFlexible hours
- Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with...Remote jobFor contractorsFlexible hoursWeekday work
- Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...Immediate startFlexible hours
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY6 days ago- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote workMercor
New York, NY2 days ago- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
$100 - $150 per hour
...structured sales methodologies. Exceptionally strong written communication skills. Detail-oriented and comfortable with peer-reviewed judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital Space LLCSummer workRemote work- About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade...Hourly payWork at officeRemote work
- ...A leading research accelerator is seeking a contractor to evaluate North American teen humor. The role involves reviewing short-form content, rating based on cultural relevance, and explaining humor dynamics clearly. Ideal candidates are 18 to 19 years old, familiar with...ContentContract workFor contractorsFreelanceRemote workFlexible hours
Turing Inc
New York, NY5 days ago $11.5 per hour
...educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and...ContentHourly payPart timeRemote workUniversity of Delaware
New York, NY4 days ago$75 per hour
...Location: Remote Commitment: 10–40 hours/week Role Responsibilities Develop and deliver sociology content through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated academic papers. Create lectures,...ContentHourly payContract workRemote workCrossing Hurdles
New York, NY4 days ago- ...oriented linguists with native speaker fluency in Indonesian for remote freelance support in AI-related projects focusing on prompt evaluation, video understanding, and text review. The ideal candidates will possess a strong command of English, a keen attention to detail,...ContentFreelanceRemote work
LILT (Production)
New York, NY4 days ago - MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...ContentRemote jobContract workTemporary workImmediate start
$10 per hour
Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Korean. This freelance, remote role offers a flexible schedule and a starting rate of 10 USD per hour. Immediate start, part-time hours (10+ per week) with work-from-home in Korea...ContentRemote jobHourly payPart timeFreelanceImmediate startWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Generalist Expert - Content Evaluator. Be the first to apply!
Related searches
- sql expert New York, NY
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- work from home web search evaluator New York, NY
- social media evaluator New York, NY
- program evaluator New York, NY