Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning & NLP Research Evaluator

$75 - $105 per hour
Temporary

24-MAG

Role Description

We are sharing a specialised part-time consulting opportunity for machine learning and natural language processing professionals experienced in model development, language understanding, retrieval systems, transformer architectures, Python workflows, and advanced AI evaluation. This role supports a remote collaboration focused on improving how advanced AI systems reason across machine learning and natural language processing tasks. Selected professionals will apply their technical expertise to:

  • Design realistic ML and NLP problems
  • Develop rigorous reference solutions
  • Evaluate model behavior
  • Identify capability gaps
  • Contribute to high-quality technical assessment workflows

Qualifications

  • Deep hands-on experience in machine learning or natural language processing through industry work, academic research, graduate study, or open-source contributions
  • Practical proficiency in Python used in research, production, or technical development environments
  • Strong understanding of modern ML and NLP methods, including model training, evaluation, and transformer-based systems
  • Experience with large language models, retrieval systems, language generation, or applied machine learning pipelines
  • Ability to design technically rigorous tasks and analyze model behavior independently
  • Strong written communication and time-management skills
  • Availability to contribute approximately 20 hours per week
  • Current location in the United States

Requirements

  • A degree in computer science, machine learning, artificial intelligence, computational linguistics, data science, mathematics, or a related technical field is helpful
  • Graduate-level research or doctoral training in machine learning, NLP, artificial intelligence, or a related discipline is highly relevant
  • Professional experience developing or evaluating production ML or NLP systems is also highly valuable
  • Equivalent hands-on experience through established open-source, research, or applied technical contributions may be considered

Benefits

  • Apply advanced machine learning and NLP expertise to structured remote work
  • Contribute to the development of stronger language reasoning and model evaluation systems
  • Design realistic tasks aligned with your technical specialization and practical experience
  • Use your ability to identify subtle model failures and assess complex technical outputs
  • Participate in flexible, high-impact technical work with competitive hourly compensation

Contract Details

  • Part-time W-2 contingent employment arrangement
  • Fully remote within the United States
  • Expected commitment of approximately 20 hours per week
  • Competitive rates between $75–$105 per hour depending on experience, technical depth, and project scope
  • Role-based engagement involving collaboration with technical experts and evaluation teams
  • Work schedules and engagement details may be adjusted depending on scope, performance, and business needs
  • Work will not involve access to confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning & NLP Research Evaluator in Remote vacancy
  • $60 per hour

    A leading AI development company in the United States seeks experienced quantitative professionals to evaluate AI-generated analyses and contribute to the development of AI systems. You'll work remotely, enjoy flexible hours, and can earn up to $60 USD/hour. Candidates... 
    Suggested
    Remote job
    Flexible hours

    DataAnnotation

    Louisiana, MO
    1 day ago
  • $60 per hour

    A leading AI development team is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and design training problems. Work fully remote with a flexible schedule and competitive pay up to $60/hour. Ideal candidates should have 2+ years... 
    Suggested
    Remote job
    Flexible hours

    DataAnnotation

    Providence, RI
    3 days ago
  •  ...Job Description and Position Requirements The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person... 
    Suggested
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Irvine, CA
    4 days ago
  •  ...TryApplyNow is seeking a Clinical Researcher to join the Project Axiom team as an Axis Sanity Check Rater. This remote contract role involves evaluating and tagging taxonomy axes and health claims for accuracy. The ideal candidate will have a background in clinical medicine... 
    Suggested
    Contract work
    Remote work

    TryApplyNow

    California, MO
    4 days ago
  • $40 per hour

    DataAnnotation is seeking a Graduate Research Intern (Chemistry) to train AI models by measuring their progress and evaluating logic. The role allows you to work on various projects remotely, assisting AI chatbots with complex chemistry problems. The ideal candidate should... 
    Suggested
    Remote job
    Hourly pay
    Internship
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract...  ...from quality checks. Stay Current: Stay updated with the latest research, guidelines, and advancements in your area of expertise,... 
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    3 days ago
  • Turing is seeking graduate students or professionals for a remote role in evaluating AI-generated research reports. Responsibilities include reading, annotating, and scoring reports on a 1-5 scale, alongside providing written justifications. Candidates must possess strong... 
    Remote job

    Turing

    Austin, TX
    5 days ago
  • DataAnnotation is seeking a Graduate Research Intern (Chemistry) to help train AI models by evaluating their logic and improving their performance. You will have the flexibility to choose projects and set your own schedule while ensuring the quality of outputs from AI chatbots... 
    Remote job
    Hourly pay
    For contractors
    Internship

    DataAnnotation

    New York, NY
    2 days ago
  • Turing is seeking an experienced professional to review AI training issues and research environments for frontier AI labs. The ideal candidate will have a Master's/PhD or 4+ years experience in relevant engineering fields. This role emphasizes feedback skills, structured... 
    Remote job
    Contract work
    For contractors

    Turing

    Chicago, IL
    2 days ago
  • $40 per hour

    DataAnnotation is seeking a Graduate Research Intern (Chemistry) to enhance AI models through evaluating their outputs. This role involves significant interaction with chemistry-related questions and requires fluency in English and solid knowledge of chemistry concepts.... 
    Remote job
    Hourly pay
    Full time
    Part time
    Internship

    DataAnnotation

    Louisiana, MO
    1 day ago
  • $20 per hour

     ...0.00 hourly Remote Part-time Benchmark dataset project evaluating AI models on visual document understanding and instruction...  ...that drive operational excellence. Full-time Quick Apply Machine Learning Research Engineer (Scientific & Engineering AI). This is an urgent... 
    Remote job
    Hourly pay
    Weekly pay
    Full time
    Part time
    Immediate start
    Weekend work
    Afternoon shift

    Mercor

    Roseville, MI
    2 days ago
  •  ...cybersecurity firm is seeking experienced cybersecurity professionals for a remote position focused on training AI models. Candidates will evaluate AI-generated security content, tackle technical issues, and provide feedback for developing reliable cybersecurity tools. The... 
    Hourly pay
    Remote work

    DataAnnotation

    Raleigh, NC
    3 days ago
  • $28.84 - $43.27 per hour

     ...this is a phenomenal opportunity to do and learn AD/CVD analysis from experts. Background...  ...include: This position is focused on research, analysis, writing, and presentation of...  ...responsibilities. Assisting in analysis and data evaluation Attend meetings, briefings, and hearings... 
    Hourly pay
    Full time
    Contract work
    Local area
    Remote work
    Work from home
    Monday to Friday

    Ardent Eagle Solutions

    Washington DC
    4 days ago
  • $40 per hour

    A leading cybersecurity AI platform is seeking experienced professionals to evaluate AI-generated content and solve technical security challenges. Candidates should have 2+ years of cybersecurity experience, coding skills, and strong analytical abilities. This role offers... 
    Hourly pay
    Remote work

    DataAnnotation

    Providence, RI
    3 days ago
  • Mercor is seeking a Basque Audio Generalist Evaluator Expert to support an audio AI project. Responsibilities include transcribing and evaluating audio content, establishing evaluation standards, and conducting model testing. Candidates should be fluent in both Basque and... 
    Remote job
    10 hours per week
    Flexible hours

    Mercor

    Denton, TX
    1 day ago
  • $40 per hour

     ...cybersecurity solutions provider is looking for experienced professionals to join their team and help train AI models. The role involves evaluating AI-generated security content and providing technical problem-solving to enhance AI systems. Candidates should have over 2 years... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A leading AI-guided cybersecurity firm is looking for experienced cybersecurity professionals to evaluate AI-generated security content and provide feedback to enhance AI systems. This role involves solving technical cybersecurity problems and writing clear technical explanations... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    California, MO
    3 days ago
  • $40 per hour

     ...leading cybersecurity company is seeking experienced cybersecurity professionals to train AI models. In this remote role, you will evaluate AI-generated content and provide essential feedback to improve the accuracy of cybersecurity tools. Ideal candidates will have 2+... 
    Hourly pay
    Remote work

    DataAnnotation

    Oklahoma City, OK
    3 days ago
  • $40 per hour

    A cybersecurity consultancy is looking for skilled professionals to evaluate AI-generated security content, solve technical problems, and provide feedback for AI model improvements. The role requires at least 2 years of cybersecurity experience and coding ability. You... 
    Hourly pay
    Remote work

    DataAnnotation

    Annapolis, MD
    3 days ago
  • $20 - $40 per hour

    ESR Healthcare is looking for an AI Trainer & Evaluator to help train next-generation AI systems by evaluating and scoring AI-generated...  ...skills, ideally with experience in AI training or machine learning. This position offers a flexible remote work environment with... 
    Remote job
    Hourly pay
    Flexible hours

    ESR Healthcare

    New York, NY
    2 days ago
  • $60 per hour

     ...ll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems...  ...data science, astrophysics, economics, biostatistics, operations research, or any other quantitative field, if you think rigorously... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Topeka, KS
    5 days ago
  • $40 per hour

    A tech-focused company in the United States seeks a Research And Development Chemist (AI Trainer) to train AI models by evaluating their logic and problem-solving capabilities. This role involves assessing the performance of AI chatbots with complex chemistry queries and... 
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...Job Description \n Veterans Evaluation Services seeks a Physician with experience evaluating TBI within 100 miles of ALPENA, MI. Veterans would come to your office or we could provide Per Diem Office Space for this opportunity. Interested? Please send your CV to... 
    Daily paid
    Work at office
    Weekend work

    Maximus Federal & VES

    Alpena, MI
    23 days ago
  • $50 - $60 per hour

    DataAnnotation is seeking a Credit Research Analyst to enhance AI models specifically for finance professionals. You will leverage your expertise to assess AI outputs, ensuring accuracy and improving decision-making capabilities through advanced financial knowledge. This... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Boston, MA
    4 days ago
  • $80 - $120 per hour

     ...In this role, you will leverage your expertise in user and customer research to evaluate AI-generated work products, ensuring they meet high standards of accuracy and quality. Your assessments will play a crucial role in enhancing the rigor of documents, spreadsheets,... 
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    20 days ago
  • $50 per hour

     ...Join a high-impact audio AI research project as an English (New Zealand) Audio Generalist Evaluator Expert. This role involves transcription, annotation, and evaluation tasks that are essential for training and benchmarking advanced language models. It is a structured,... 
    Remote job
    Hourly pay
    Temporary work
    10 hours per week

    SaidGig

    United States
    24 days ago
  • $9.1k - $11.86k

     ...Functional Title: Psychologist III Forensic Evaluator \n Job Title: Psychologist III \n...  ...you thrive in an environment where you learn and grow personally and professionally...  ...best practices and current peer-reviewed research. Provides effective expert testimony to... 
    Full time
    Temporary work
    Part time
    Traineeship
    Internship
    Work at office
    Remote work
    Shift work
    Rotating shift

    Health and Human Services Commission (HHSC)

    Vernon, TX
    15 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • Role Description We're looking for Italian speakers living in the United States to participate in an exciting Google Pixel AI evaluation project. What You'll Do: ~Use the Google Pixel as your primary phone during the project. ~Spend approximately 10–15 minutes per... 
    Temporary work

    Productive Playhouse

    Remote
    9 hours ago
  • Role Description We are looking for Polish speakers living in the United States to participate in an exciting Google Pixel AI evaluation project. Join our FREE Virtual Enrollment Event: ~Available Date: July 15, 2026 ~Time: 3:00 PM EST ~Location: Virtual -... 
    Temporary work

    Productive Playhouse

    Remote
    9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning & NLP Research Evaluator. Be the first to apply!