Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Bilingual Evaluator - Fully Remote | Upto $50/hr

$50 per hour

Mercor

New York, NY
  • Remote job

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Dutch Audio Generalist Evaluator Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Duration: 3–6 months

Role Responsibilities

  • Transcribe audio and video with precision in Dutch and English . Ensure adherence to multiple constraints and instructions.
  • Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English .
  • Conduct model testing by running prompts and assessing outputs against expectations.
  • Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
  • Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.

Qualifications

Must-Have

  • Strong writing and critical thinking skills
  • Ability to work independently and meet deadlines
  • Fluent in Dutch and English
  • Able to work within GMT or PST working hours

Preferred

  • College students or graduates

Application Process (Takes 20–30 mins to complete)

  • Complete an AI-led interview (approximately 15 minutes)
  • If selected, you will be invited to work on the project

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Bilingual Evaluator - Fully Remote | Upto $50/hr in New York, NY vacancy
  • $120 per hour

    About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents...  ...deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    13 hours ago
  • $50 - $60 per hour

     ...AI. Enjoy the flexibility of remote work and the freedom to set your...  ...paid hourly starting at USD $50-$60 per hour, with bonus rates...  ...and complex problems and evaluate their outputs Evaluate the...  ...Fluency in English (native or bilingual level) Detail-oriented Proficient... 
    Remote work
    Bilingual
    Hourly pay
    Contract work
    For contractors
    Work experience placement

    Data Annotation

    Wisconsin Rapids, WI
    more than 2 months ago
  • $20 per hour

     ...English & Urdu Type Contract Compensation $15-$20/hour Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and... 
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    3 days ago
  • $425 per month

     ...opportunities! Requirements: This position pays up to 50% of revenue , 1-Day Evaluation $350 for remote and $425 for in person, 2-Day Evaluation $742.00 for...  ...with CARF and/or APD standards is a plus; Bilingual (Spanish/English, Creole/English) is a plus. Computer... 
    Remote work
    Bilingual
    Full time
    For contractors
    Work experience placement
    Work at office
    Local area

    EmployU, Inc

    Lake City, FL
    12 days ago
  • $18.5 per hour

     ...Remote Call Center Customer Service Representative – $18.50/hr | Republic Services Are you passionate about delivering exceptional customer service and looking...  ...systems and entering data Experience using bilingual skills, especially Spanish, is a plus Remote Work... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Temporary work
    Work from home
    Monday to Friday

    School Result

    Phoenix, AZ
    2 days ago
  • $120 per hour

     ...Larry Summers , and Jack Dorsey . Position: Investment analysis / valuation / credit Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    a month ago
  • $120 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    29 days ago
  • $15.5 per hour

     ...communication skills. Excellent demonstration of caring and compassion. Bilingual in English and Spanish. Able to provide 2 monitors at least 22...  ...& Benefits The wage for the Healthcare CSR role is $15.50 per hour. In addition, we offer a comprehensive benefits package... 
    Remote job
    Bilingual
    Hourly pay
    Work at office
    Work from home
    Flexible hours

    Carenet Health

    San Antonio, TX
    1 day ago
  • $120 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    a month ago
  • $50 - $60 per hour

     ...About the job Telemedicine NP/PA (Bilingual Spanish) Part-Time $50-60/hr. San Antonio, TX Telemedicine NP/PA (Bilingual Spanish) Part-Time $50-60/hr. San Antonio, TX Private Practice Location: San Antonio, TX Pay: $50-$60 per hour Telemedicine Nurse... 
    Bilingual
    Hourly pay
    Part time
    Private practice
    Work from home

    Nirvana Healthcare

    San Antonio, TX
    2 days ago
  • $50 per hour

     ...Designers and UX Specialists to join our Expert Network to help train AI models using real design expertise. This role involves evaluating AI-generated designs, auditing accessibility, and validating UX principles. The successful candidate will have at least one year... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Virginia Beach, VA
    4 days ago
  • $60 per hour

     ...enjoying the flexibility of remote work and setting your own schedule...  ...-art AI models on tasks like evaluating AI-generated quantitative...  ...our platform. Benefits Fully remote: work from anywhere in...  ...Fluency in English (native or bilingual level) with strong writing... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Topeka, KS
    2 days ago
  • $60 per hour

     ...enjoying the flexibility of remote work and setting your own schedule...  ...-art AI models on tasks like evaluating AI-generated quantitative...  ...our platform. Benefits Fully remote: work from anywhere in...  ...Fluency in English (native or bilingual level) with strong writing... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    United States
    3 days ago
  • $60 per hour

     ...enjoying the flexibility of remote work and setting your own schedule...  ...-art AI models on tasks like evaluating AI-generated security content...  ...our platform. Benefits Fully remote: work from anywhere in...  ...in English (native or bilingual level) with strong writing skills... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Nevada, IA
    2 days ago
  • $50 - $60 per hour

     ...while enjoying the flexibility of remote work and the freedom to set...  ...paid hourly starting at USD $50-$60 per hour, with bonuses on...  ...diverse and complex problems and evaluate their outputs Evaluate the...  ...Fluency in English (native or bilingual level) Detail-oriented... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Contract work
    Part time
    Work experience placement
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • $50 per hour

    Prolific is hiring HR and Talent Professionals to join their Expert Network, helping train...  ...offers competitive pay rates of up to $50 per hour, flexible hours, and the opportunity...  ...work from home. Responsibilities include evaluating AI outputs, creating HR scenarios, and... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Oklahoma City, OK
    13 hours ago
  • $41.26 - $50.55 per hour

     ...Position Highlights: EMR system is EPIC $41.26-$50.55/hour DOE with the ability to go higher for highly experienced...  ...BCLS within 90 days of hire; ACLS and PALS preferred Spanish bilingual proficiency is preferred at a level 10 Our Mission Statement... 
    Bilingual
    Relocation

    Yakima Valley Farm Workers Clinic

    Walla Walla, WA
    2 hours ago
  • $43k - $50k

     ...Your Handz! You will be making at least 50 Outbound calls a day to candidates that...  ...This is a Contract position to start. Fully Remote Incredible Team that is very Cohesive...  ...an unwavering focus on objectives. ~ Bilingual abilities would be the cherry on top ( but... 
    Remote work
    Bilingual
    Contract work

    Work With Your Handz

    Haymarket, VA
    25 days ago
  • $50 - $60 per hour

     ...AI. Enjoy the flexibility of remote work and the freedom to set your...  ...paid hourly starting at USD $50-$60 per hour, with bonus rates...  ...and complex problems and evaluate their outputs Evaluate the...  ...Fluency in English (native or bilingual level) Detail-oriented Proficient... 
    Remote work
    Bilingual
    Hourly pay
    Contract work
    For contractors
    Work experience placement

    Data Annotation

    Elwood, IN
    more than 2 months ago
  • $50 - $60 per hour

     ...AI. Enjoy the flexibility of remote work and the freedom to set your...  ...paid hourly starting at USD $50-$60 per hour, with bonus rates...  ...and complex problems and evaluate their outputs Evaluate the...  ...Fluency in English (native or bilingual level) Detail-oriented Proficient... 
    Remote work
    Bilingual
    Hourly pay
    Contract work
    For contractors
    Work experience placement

    Data Annotation

    Kyle, TX
    more than 2 months ago
  • $40 per hour

     ...measure the progress of these AI chatbots, evaluate their logic, and solve problems to...  ...Benefits This is a full-time or part-time REMOTE position You’ll be able to choose...  ...Qualifications Fluency in English (native or bilingual level) Detail-oriented Strong grasp... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Contract work
    Part time

    DataAnnotation

    Charleston, WV
    2 days ago
  • $41.26 - $50.55 per hour

     ...: FTE (40 hours per week) EMR system is EPIC $41.26-$50.55/hour DOE with the ability to go higher for highly experienced...  ...relocating more than 50 miles Additional pay for your bilingual skills, paid on hours worked $7,000.00 Hiring/Retention Bonus... 
    Bilingual
    Full time
    Relocation
    Relocation package

    Yakima Valley Farm Workers Clinic

    Wallula, WA
    2 hours ago
  • A leading insurance provider is seeking a Remote Member Onboarding & Benefits Rep in Virginia Beach, VA. The ideal candidate is dynamic...  ...providing exceptional service. The role offers extensive training, a fully remote setup, and attractive benefits including health insurance... 
    Remote work
    Bilingual

    American Income Life

    Virginia Beach, VA
    2 days ago
  • $50 per hour

     ...needs, administering first aid, and maintaining confidential health records. Applicants with bilingual skills and experience with special health care needs are encouraged to apply. Competitive pay of $50 per hour is offered. #J-18808-Ljbffr Young World Physical Education
    Bilingual
    Hourly pay
    Part time

    Young World Physical Education

    Somerville, MA
    1 day ago
  • $50 per hour

    Shopping Expert (Remote) Hourly contract, 1-2 months with possibility of extension. Compensation: $30-$50/hour Location: Remote Duration: 1-2 months (extension feasible) Commitment...  ..., tech, outdoor gear, etc.). Assess and evaluate AI outputs for accuracy, depth, and... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    13 hours ago
  • $40 per hour

     ...to join its team and train AI models. This is a remote position where you can choose projects and schedule...  ...AI chatbots complex biology questions and evaluating their logic. Ideal candidates will be fluently bilingual in English and possess a strong background in biology... 
    Remote work
    Bilingual
    Hourly pay
    Flexible hours

    DataAnnotation

    El Paso, TX
    2 days ago
  • $40 per hour

     ...train AI models. In this role, you will evaluate AI-generated security content, solve technical...  ...This is a full-time or part-time REMOTE position You’ll be able to choose which...  ...~ Fluency in English (native or bilingual level) ~ Strong writing and analytical... 
    Remote work
    Bilingual
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Virginia, MN
    2 days ago
  •  ...Mercor is looking for Internet-Native Bilingual Evaluator Experts (Spanish-English) in Las Cruces, New Mexico. In this role, you will contribute to AI research by evaluating and improving models based on modern internet communication and cultural references. The ideal... 
    Remote work
    Bilingual

    Mercor Inc

    Las Cruces, NM
    3 days ago
  • $20 per hour

     ...leading AI services company is seeking a Bilingual Customer Support Representative fluent...  ...AI chatbots. This role involves evaluating AI model outputs and creating conversation...  ...and pays hourly starting at $20+. It is fully remote, but applicants must be located in the... 
    Remote work
    Bilingual
    Hourly pay

    DataAnnotation

    Lansing, MI
    2 days ago
  •  ...Mercor is hiring Internet-Native Bilingual Evaluator Experts (Spanish-English) to enhance AI models focusing on multilingual communication. This role involves evaluating content from various digital platforms, understanding internet culture, and ensuring linguistic accuracy... 
    Remote work
    Bilingual

    Mercor Inc

    Orem, UT
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Bilingual Evaluator - Fully Remote | Upto $50/hr. Be the first to apply!