Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Research Evaluation Consultant (Remote)

NEPSE Trading

Brooklyn, NY
  • Remote job

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role as Generalist Search Expert focuses on evaluating AI-generated content to strengthen reasoning and rigor in model outputs. You will review complex material, provide structured feedback to research teams, and help improve training data quality. Responsibilities include developing evaluation rubrics, collaborating with subject matter experts, and ensuring dataset coverage and methodological #J-18808-Ljbffr NEPSE Trading

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Research Evaluation Consultant (Remote) in Brooklyn, NY vacancy
  •  ...UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design. Applicants should have at least one... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    4 days ago
  •  ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    1 day ago
  • Mercor is looking for professionals to engage in a project evaluating AI models within the Radiology domain, focusing on visual document understanding. This fully remote role allows for flexibility with approximately 15-20 hours of work per week. As part of Mercor, you... 
    Remote job

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

     ...Role Overview Review AI-generated documents, spreadsheets, and slide decks...  ...through the lens of user and customer research expertise. This remote, hourly role focuses on assessing outputs...  ...quality, then delivering actionable evaluations. Key Responsibilities Evaluate... 
    Remote work
    Hourly pay
    Work at office

    SaidGig

    United States
    8 days ago
  • $130 per hour

    Obsidian is partnering with a leading AI lab seeking Internal Medicine experts to design clinical scenarios and evaluate AI outputs. This role offers flexible remote engagement at 20 hours per week, starting post-onboarding, with rates between $130 and $300 per hour depending... 
    Remote job
    Hourly pay
    Flexible hours

    Obsidian

    New York, NY
    1 day ago
  • $238k - $302k

     ...+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI ambition . With advancements in Large...  ...-minded engineers to research and propose new ways to assess the...  ...or, if the role can be performed remote, the specific salary range for your... 
    Remote work
    Full time

    Waymo

    San Francisco, CA
    1 day ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    4 days ago
  • $77.6k - $176k

    Operations Research Systems Analyst, SeniorThe Opportunity: With all...  ...to use those skills to support AI governance.As an intelligence...  ...client understand testing and evaluation of AI systems. Using your comprehensive...  ...cameras on during meetings.Remote: If this position is listed as... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Shift work

    Booz Allen Hamilton

    Washington DC
    3 days ago
  • $150 - $180 per hour

    Prolific in Sacramento is seeking Mental Health Professionals to help train and evaluate advanced AI models. You will review AI-generated responses and engage in various training tasks, earning competitive pay rates up to $150-180/hr. Ideal candidates must hold a verified... 
    Remote job
    Work from home

    Prolific

    Sacramento, CA
    3 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates... 
    Remote job
    Hourly pay
    Work from home

    Prolific

    Denver, CO
    1 day ago
  • $150 - $180 per hour

    Prolific in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological scenarios and completing related tasks, offering competitive pay up to $150-180/hr. You must have a valid mental... 
    Remote job
    Work from home

    Prolific

    Virginia Beach, VA
    3 days ago
  • $8 - $65 per hour

    Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. You'll review AI-generated clinical responses and evaluate their accuracy and appropriateness, earning competitive pay of $80-$150 per hour depending on your skills and experience. Ideal candidates must... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    4 days ago
  • $80 - $150 per hour

    Prolific is seeking Medical Doctors to train and evaluate AI models. As a Domain Expert participant, you will receive $80-$150/hr for tasks requiring your expertise. Responsibilities include reviewing AI responses for accuracy and quality, and providing structured feedback... 
    Remote job
    Work from home

    Prolific

    Seattle, WA
    5 days ago
  • Prolific is seeking HR and Talent Professionals in Austin, Texas, to join their Expert Network. Your role will involve evaluating AI outputs, developing HR scenarios, and providing feedback on HR policies. Ideal candidates will have professional experience in HR, knowledge... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Austin, TX
    4 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    5 days ago
  • $20 - $26 per hour

     ...fluent Kannada speakers to act as evaluators. You will compare text and AI-generated Kannada audio, rating naturalness...  ...taking about an hour. Flexible, remote work from home and a global...  ...opportunities to contribute to AI research while earning #J-18808-Ljbffr Prolific
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Columbus, OH
    2 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with flexible hours and offers a competitive pay rate of up to $60 per hour for reviewing model responses... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    4 days ago
  •  ...York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating chemical reactions... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $80 - $150 per hour

    Prolific in New York, NY, is seeking Medical Doctors to join our Expert Network for training and evaluating AI models. As a Domain Expert participant, you will review and rate AI-generated clinical responses, providing crucial feedback for AI development. You must hold... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • $100k - $115k

    Join to apply for the CX Research and Evaluation Analyst role at Bixal 2 weeks ago...  ...Analyst role at Bixal Get AI-powered advice on this job and...  .... Why Bixal? Bixal is a consulting company headquartered in Fairfax...  ...Experience Administrator - Remote(Should be able to work CST... 
    Remote work
    Full time
    Contract work
    Temporary work
    Local area
    Work from home
    Weekend work

    Bixal

    Annapolis, MD
    4 days ago
  • $23 - $26.45 per hour

    Appen is seeking Independent Contractors for a remote Audio Evaluation Project. You will listen to two audio recordings per case and decide which is better based on the provided guidelines. The role emphasizes precision, consistency, and adherence to instructions. The project... 
    Remote job
    Hourly pay
    For contractors
    Work from home
    Flexible hours

    Appen

    New York, NY
    2 days ago
  • $20 - $26 per hour

    Prolific is looking for an AI Trainer who is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in pronunciation. Candidates must possess... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Chicago, IL
    4 days ago
  • $50 per hour

    Prolific seeks Product Designers and UX Specialists to help train AI models using your expertise. You'll evaluate AI-generated designs and ensure usability and accessibility while working from home. Ideal candidates hold a BS, MS, or PhD in a relevant field and have at... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Sacramento, CA
    5 days ago
  • $50 per hour

     ...Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree in Human-Computer...  ...least a year of relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility, and refining... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    1 day ago
  • $60 per hour

     ...Chemical Engineers to join our Expert Network to train AI models with your expertise. The role involves evaluating AI-generated chemistry, fact-checking chemical...  ...or related field and experience in laboratory research or industrial processing. Enjoy flexible hours and... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Seattle, WA
    5 days ago
  • $10 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Korean. This freelance, remote role offers a flexible schedule and a starting rate of 10 USD per hour. Immediate start, part-time hours (10+ per week) with work-from-home in Korea... 
    Remote job
    Hourly pay
    Part time
    Freelance
    Immediate start
    Work from home
    Flexible hours

    Dorado

    New York, NY
    2 days ago
  • MC² Education is seeking a versatile Research & Evaluation Analyst to conduct quantitative analyses, contribute to surveys, and support multiple applied research projects on a flexible, remote basis. The role emphasizes rigorous programming in R or Stata, collaboration... 
    Remote job
    Flexible hours

    MC2 Education

    New York, NY
    5 days ago
  • Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in Italian. This freelance, remote role offers a part-time schedule (10+ hours/week) with immediate start and flexible hours. You will conduct short voice conversations with AI models... 
    Remote job
    Part time
    Freelance
    Immediate start
    Work from home
    Flexible hours

    Dorado

    New York, NY
    3 days ago
  • $18 per hour

    Dorado is seeking a Speech AI Evaluation Specialist to help improve AI-generated content in German. This freelance, part-time role offers a flexible remote schedule with work-from-home options in Germany. Start immediately with 10+ hours per week and a rate of 18 USD per... 
    Remote job
    Hourly pay
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Dorado

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Research Evaluation Consultant (Remote). Be the first to apply!