Bilingual Evaluator - Fully Remote | Upto $50/hr
$50 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Dutch Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Duration: 3–6 months
Role Responsibilities
- Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.
- Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .
- Conduct model testing by running prompts and assessing outputs against expectations.
- Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
- Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.
Qualifications
Must-Have
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
- Fluent in Dutch and English
- Able to work within GMT or PST working hours
Preferred
- College students or graduates
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview (approximately 15 minutes)
- If selected, you will be invited to work on the project
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Bilingual Evaluator - Fully Remote | Upto $50/hr in New York, NY vacancy
$20 per hour
...English & Urdu Type Contract Compensation $15-$20/hour Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and...Remote jobContract workPart timeSummer work$425 per month
...opportunities! Requirements: This position pays up to 50% of revenue , 1-Day Evaluation $350 for remote and $425 for in person, 2-Day Evaluation $742.00 for... ...with CARF and/or APD standards is a plus; Bilingual (Spanish/English, Creole/English) is a plus. Computer...Remote workBilingualFull timeFor contractorsWork experience placementWork at officeLocal area$50 per hour
...Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models on visual document understanding in the Electrical & Electronics...Remote jobContract workPart timeSummer workMercor
New York, NY2 days ago$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote jobContract workSummer workWork at office$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote jobContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote jobContract workSummer workWork at office$50 - $60 per hour
...EPM Recruiter — Expert AI Interviewer Evaluator is a remote review track for evaluating AI... ...workflow tooling and its failure modes. Bilingual experience for cross-region operations... ...to work from US. Compensation $50–$60 / hr Application process Apply through...Remote jobBilingualFor contractorsWork experience placement10 hours per week$60 per hour
...enjoying the flexibility of remote work and setting your own schedule... ...-art AI models on tasks like evaluating AI-generated quantitative... ...our platform. Benefits Fully remote: work from anywhere in... ...Fluency in English (native or bilingual level) with strong writing...Remote workBilingualHourly payFull timeFlexible hoursDataAnnotation
Little Rock, AR4 days ago$50 per hour
...Coordinator to enhance AI models by evaluating chatbot outputs and providing... ...offers flexibility with remote work options and competitive hourly pay starting at $50+. Candidates must have a strong... ...fluency in English, either native or bilingual. This role is ideal for those...Remote jobBilingualHourly payFor contractorsFlexible hours$60 per hour
...enjoying the flexibility of remote work and setting your own schedule... ...-art AI models on tasks like evaluating AI-generated security content... ...our platform. Benefits Fully remote: work from anywhere in... ...Fluency in English (native or bilingual level) with strong writing...Remote jobBilingualHourly payFull timeFlexible hours- ...HR Policy Agent Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory... ...AI-assisted legal-research or compliance tooling. Bilingual experience for cross-jurisdiction matters. Skills...Remote jobBilingualHourly payFor contractors10 hours per week
$50 - $60 per hour
...while enjoying the flexibility of remote work and the freedom to set... ...paid hourly starting at USD $50-$60 per hour, with bonuses on... ...diverse and complex problems and evaluate their outputs Evaluate the... ...Fluency in English (native or bilingual level) Detail-oriented...Remote workBilingualHourly payFull timeContract workPart timeWork experience placementFlexible hoursDataAnnotation
Brooklyn, NY23 hours ago$41.26 - $50.55 per hour
...Position Highlights: EMR system is EPIC $41.26-$50.55/hour DOE with the ability to go higher for highly experienced... ...BCLS within 90 days of hire; ACLS and PALS preferred Spanish bilingual proficiency is preferred at a level 10 Our Mission Statement...BilingualRelocationYakima Valley Farm Workers Clinic
Waitsburg, WA1 hour ago$41.26 - $50.55 per hour
...and families! Position Highlights: EMR system is EPIC $41.26-$50.55/hour DOE with the ability to go higher for highly experienced candidates Additional pay for your bilingual skills, paid on hours worked What You'll Do: Provides care during...BilingualRelocationYakima Valley Farm Workers Clinic
Greenacres, WA1 hour ago$15 - $20 per hour
...Role Overview Evaluate AI-generated responses in Bengali, identify factual errors and areas... ...experience. Work Terms Location, remote, global. Contract work, hourly... ...considered for this role you must take the Bilingual Competency interview in Bengali, this is...Remote workBilingualHourly payContract workSaidGig
United States12 days ago$41.26 - $50.55 per hour
...: FTE (40 hours per week) EMR system is EPIC $41.26-$50.55/hour DOE with the ability to go higher for highly experienced... ...relocating more than 50 miles Additional pay for your bilingual skills, paid on hours worked $7,000.00 Hiring/Retention Bonus...BilingualFull timeRelocationRelocation packageYakima Valley Farm Workers Clinic
Kennewick, WA2 hours ago$15 - $20 per hour
...and specific areas for improvement. Your evaluations will be used to help create the "perfect... ...and user experience. Work Terms Remote, global contract position. Engagement... ...considered for this role, you must complete the Bilingual Competency interview in Marathi....Remote workBilingualHourly payContract workFor contractorsSaidGig
United States3 days ago$50 per hour
...Shopping Expert (Remote) Hourly contract, 1-2 months with possibility of extension. Compensation: $30–$50/hour Location: Remote Duration: 1-2 months (extension feasible) Commitment... ..., tech, outdoor gear, etc.). Assess and evaluate AI outputs for accuracy, depth, and...Remote workHourly payContract workCrossing Hurdles
New York, NY2 days ago$55 per hour
...time (15-20 hrs. per week) fee-for-service evaluator. Founded in 1985, the Forensic Services... ...client interviews, the work can be done remotely. Travel is required for visit... ...to Diversity, Equity, and Inclusion Bilingual language skills desirable Key/Children...Remote workBilingualHourly payPart timeFlexible hoursKey Program, Inc.
Waltham, MA24 days ago- ...throughout North America. Over 50+ years of experience in... ...partner cross-functionally with HR to uphold benefits and leave compliance... ...human resources emphasis. Bilingual (Spanish) skills to include... ...OUR ENVIRONMENT: This is a fully remote or a hybrid role, partially...Remote workBilingualContract workTemporary workWork at officeLocal areaWork from homeHome office3 days per week
Fortrex
Atlanta, GA2 days ago $40 per hour
...measure the progress of these AI chatbots, evaluate their logic, and solve problems to... ...Benefits This is a full-time or part-time REMOTE position You’ll be able to choose... ...Qualifications Fluency in English (native or bilingual level) Detail-oriented Strong grasp...Remote workBilingualHourly payFull timeContract workPart timeDataAnnotation
Charleston, WV4 days ago$50 per hour
...Education — Visual Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding and instruction-following in the Education...Remote jobContract workPart timeSummer work$40 per hour
...train AI models. In this role, you will evaluate AI-generated security content, solve technical... ...This is a full-time or part-time REMOTE position You’ll be able to choose which... ...~ Fluency in English (native or bilingual level) ~ Strong writing and analytical...Remote workBilingualHourly payFull timePart timeDataAnnotation
California, MO4 days ago$50 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Build MCP servers in Python using FastMCP . Integrate web or desktop applications...Remote jobContract workSummer workLocal area- ...appraisal report fee. You will earn up to 50% of the total fee for each completed... ...coordination and back-end services like IT and HR) Dedicated quality development resources... ...appraisers work outdoors at construction and remote sites in all seasons and weather, including...Remote workFull timeTraineeshipLong distance
True Footage
New York, NY2 days ago - A leading insurance provider is seeking a Remote Member Onboarding & Benefits Rep in Virginia Beach, VA. The ideal candidate is dynamic... ...providing exceptional service. The role offers extensive training, a fully remote setup, and attractive benefits including health insurance...Remote workBilingual
American Income Life
Virginia Beach, VA4 days ago $22.5 - $27.57 per hour
...our communities, health, and families! Position Highlights: $22.50-$27.57/hour DOE with the ability to go higher for highly experienced candidates Additional pay for your bilingual skills paid on hours worked What You'll Do: Answers the phone,...BilingualWork at officeYakima Valley Farm Workers Clinic
Astoria, OR17 hours ago$20 per hour
...leading AI services company is seeking a Bilingual Customer Support Representative fluent... ...AI chatbots. This role involves evaluating AI model outputs and creating conversation... ...and pays hourly starting at $20+. It is fully remote, but applicants must be located in the...Remote workBilingualHourly payDataAnnotation
Lansing, MI4 days ago$40 per hour
...measure the progress of these AI chatbots, evaluate their logic, and solve problems to... ...Benefits This is a full-time or part-time REMOTE position You’ll be able to choose... ...Qualifications Fluency in English (native or bilingual level) A current or in progress...Remote workBilingualHourly payFull timeContract workPart timeDataAnnotation
Lincoln, NE4 days ago- Mercor is seeking a Generalist fluent in English and Assamese to work remotely. You will be responsible for fact-checking, generating evaluation data, and assessing model responses for clarity and completeness. The ideal candidate holds a Bachelor's degree, has significant...Remote jobBilingual
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Bilingual Evaluator - Fully Remote | Upto $50/hr. Be the first to apply!
Related searches
- evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- work from home web search evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- bilingual New York, NY