Machine Learning & NLP Research Evaluator
$75 - $105 per hour24-MAG
Role Description
We are sharing a specialised part-time consulting opportunity for machine learning and natural language processing professionals experienced in model development, language understanding, retrieval systems, transformer architectures, Python workflows, and advanced AI evaluation. This role supports a remote collaboration focused on improving how advanced AI systems reason across machine learning and natural language processing tasks. Selected professionals will apply their technical expertise to:
- Design realistic ML and NLP problems
- Develop rigorous reference solutions
- Evaluate model behavior
- Identify capability gaps
- Contribute to high-quality technical assessment workflows
Qualifications
- Deep hands-on experience in machine learning or natural language processing through industry work, academic research, graduate study, or open-source contributions
- Practical proficiency in Python used in research, production, or technical development environments
- Strong understanding of modern ML and NLP methods, including model training, evaluation, and transformer-based systems
- Experience with large language models, retrieval systems, language generation, or applied machine learning pipelines
- Ability to design technically rigorous tasks and analyze model behavior independently
- Strong written communication and time-management skills
- Availability to contribute approximately 20 hours per week
- Current location in the United States
Requirements
- A degree in computer science, machine learning, artificial intelligence, computational linguistics, data science, mathematics, or a related technical field is helpful
- Graduate-level research or doctoral training in machine learning, NLP, artificial intelligence, or a related discipline is highly relevant
- Professional experience developing or evaluating production ML or NLP systems is also highly valuable
- Equivalent hands-on experience through established open-source, research, or applied technical contributions may be considered
Benefits
- Apply advanced machine learning and NLP expertise to structured remote work
- Contribute to the development of stronger language reasoning and model evaluation systems
- Design realistic tasks aligned with your technical specialization and practical experience
- Use your ability to identify subtle model failures and assess complex technical outputs
- Participate in flexible, high-impact technical work with competitive hourly compensation
Contract Details
- Part-time W-2 contingent employment arrangement
- Fully remote within the United States
- Expected commitment of approximately 20 hours per week
- Competitive rates between $75–$105 per hour depending on experience, technical depth, and project scope
- Role-based engagement involving collaboration with technical experts and evaluation teams
- Work schedules and engagement details may be adjusted depending on scope, performance, and business needs
- Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:
$60 per hour
A leading AI development company in the United States seeks experienced quantitative professionals to evaluate AI-generated analyses and contribute to the development of AI systems. You'll work remotely, enjoy flexible hours, and can earn up to $60 USD/hour. Candidates...SuggestedRemote jobFlexible hours$60 per hour
A leading AI development team is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and design training problems. Work fully remote with a flexible schedule and competitive pay up to $60/hour. Ideal candidates should have 2+ years...SuggestedRemote jobFlexible hours- ...Job Description and Position Requirements The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person...SuggestedHourly payPart timeSummer work
- ...TryApplyNow is seeking a Clinical Researcher to join the Project Axiom team as an Axis Sanity Check Rater. This remote contract role involves evaluating and tagging taxonomy axes and health claims for accuracy. The ideal candidate will have a background in clinical medicine...SuggestedContract workRemote work
$40 per hour
DataAnnotation is seeking a Graduate Research Intern (Chemistry) to train AI models by measuring their progress and evaluating logic. The role allows you to work on various projects remotely, assisting AI chatbots with complex chemistry problems. The ideal candidate should...SuggestedRemote jobHourly payInternshipFlexible hours- ...by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract... ...from quality checks. Stay Current: Stay updated with the latest research, guidelines, and advancements in your area of expertise,...Contract workRemote workWorldwide
- Turing is seeking graduate students or professionals for a remote role in evaluating AI-generated research reports. Responsibilities include reading, annotating, and scoring reports on a 1-5 scale, alongside providing written justifications. Candidates must possess strong...Remote job
- DataAnnotation is seeking a Graduate Research Intern (Chemistry) to help train AI models by evaluating their logic and improving their performance. You will have the flexibility to choose projects and set your own schedule while ensuring the quality of outputs from AI chatbots...Remote jobHourly payFor contractorsInternship
- Turing is seeking an experienced professional to review AI training issues and research environments for frontier AI labs. The ideal candidate will have a Master's/PhD or 4+ years experience in relevant engineering fields. This role emphasizes feedback skills, structured...Remote jobContract workFor contractors
$40 per hour
DataAnnotation is seeking a Graduate Research Intern (Chemistry) to enhance AI models through evaluating their outputs. This role involves significant interaction with chemistry-related questions and requires fluency in English and solid knowledge of chemistry concepts....Remote jobHourly payFull timePart timeInternship$20 per hour
...0.00 hourly Remote Part-time Benchmark dataset project evaluating AI models on visual document understanding and instruction... ...that drive operational excellence. Full-time Quick Apply Machine Learning Research Engineer (Scientific & Engineering AI). This is an urgent...Remote jobHourly payWeekly payFull timePart timeImmediate startWeekend workAfternoon shift- ...cybersecurity firm is seeking experienced cybersecurity professionals for a remote position focused on training AI models. Candidates will evaluate AI-generated security content, tackle technical issues, and provide feedback for developing reliable cybersecurity tools. The...Hourly payRemote work
$28.84 - $43.27 per hour
...this is a phenomenal opportunity to do and learn AD/CVD analysis from experts. Background... ...include: This position is focused on research, analysis, writing, and presentation of... ...responsibilities. Assisting in analysis and data evaluation Attend meetings, briefings, and hearings...Hourly payFull timeContract workLocal areaRemote workWork from homeMonday to Friday$40 per hour
A leading cybersecurity AI platform is seeking experienced professionals to evaluate AI-generated content and solve technical security challenges. Candidates should have 2+ years of cybersecurity experience, coding skills, and strong analytical abilities. This role offers...Hourly payRemote work- Mercor is seeking a Basque Audio Generalist Evaluator Expert to support an audio AI project. Responsibilities include transcribing and evaluating audio content, establishing evaluation standards, and conducting model testing. Candidates should be fluent in both Basque and...Remote job10 hours per weekFlexible hours
$40 per hour
...cybersecurity solutions provider is looking for experienced professionals to join their team and help train AI models. The role involves evaluating AI-generated security content and providing technical problem-solving to enhance AI systems. Candidates should have over 2 years...Hourly payRemote workFlexible hours$40 per hour
A leading AI-guided cybersecurity firm is looking for experienced cybersecurity professionals to evaluate AI-generated security content and provide feedback to enhance AI systems. This role involves solving technical cybersecurity problems and writing clear technical explanations...Hourly payRemote workFlexible hours$40 per hour
...leading cybersecurity company is seeking experienced cybersecurity professionals to train AI models. In this remote role, you will evaluate AI-generated content and provide essential feedback to improve the accuracy of cybersecurity tools. Ideal candidates will have 2+...Hourly payRemote work$40 per hour
A cybersecurity consultancy is looking for skilled professionals to evaluate AI-generated security content, solve technical problems, and provide feedback for AI model improvements. The role requires at least 2 years of cybersecurity experience and coding ability. You...Hourly payRemote work$20 - $40 per hour
ESR Healthcare is looking for an AI Trainer & Evaluator to help train next-generation AI systems by evaluating and scoring AI-generated... ...skills, ideally with experience in AI training or machine learning. This position offers a flexible remote work environment with...Remote jobHourly payFlexible hours$60 per hour
...ll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems... ...data science, astrophysics, economics, biostatistics, operations research, or any other quantitative field, if you think rigorously...Hourly payFull timeRemote workFlexible hours$40 per hour
A tech-focused company in the United States seeks a Research And Development Chemist (AI Trainer) to train AI models by evaluating their logic and problem-solving capabilities. This role involves assessing the performance of AI chatbots with complex chemistry queries and...Remote jobHourly payContract workFlexible hours- ...Job Description \n Veterans Evaluation Services seeks a Physician with experience evaluating TBI within 100 miles of ALPENA, MI. Veterans would come to your office or we could provide Per Diem Office Space for this opportunity. Interested? Please send your CV to...Daily paidWork at officeWeekend work
$50 - $60 per hour
DataAnnotation is seeking a Credit Research Analyst to enhance AI models specifically for finance professionals. You will leverage your expertise to assess AI outputs, ensuring accuracy and improving decision-making capabilities through advanced financial knowledge. This...Remote jobHourly payFor contractorsFlexible hours$80 - $120 per hour
...In this role, you will leverage your expertise in user and customer research to evaluate AI-generated work products, ensuring they meet high standards of accuracy and quality. Your assessments will play a crucial role in enhancing the rigor of documents, spreadsheets,...Hourly payWork at officeRemote work$50 per hour
...Join a high-impact audio AI research project as an English (New Zealand) Audio Generalist Evaluator Expert. This role involves transcription, annotation, and evaluation tasks that are essential for training and benchmarking advanced language models. It is a structured,...Remote jobHourly payTemporary work10 hours per week$9.1k - $11.86k
...Functional Title: Psychologist III Forensic Evaluator \n Job Title: Psychologist III \n... ...you thrive in an environment where you learn and grow personally and professionally... ...best practices and current peer-reviewed research. Provides effective expert testimony to...Full timeTemporary workPart timeTraineeshipInternshipWork at officeRemote workShift workRotating shift$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work- Role Description We're looking for Italian speakers living in the United States to participate in an exciting Google Pixel AI evaluation project. What You'll Do: ~Use the Google Pixel as your primary phone during the project. ~Spend approximately 10–15 minutes per...Temporary work
- Role Description We are looking for Polish speakers living in the United States to participate in an exciting Google Pixel AI evaluation project. Join our FREE Virtual Enrollment Event: ~Available Date: July 15, 2026 ~Time: 3:00 PM EST ~Location: Virtual -...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning & NLP Research Evaluator. Be the first to apply!
- evaluator Remote
- social media evaluator Remote
- work from home web search evaluator Remote
- quality evaluator Remote
- transcript evaluator Remote
- data engineer machine learning Remote
- artificial intelligence - machine learning intern Remote
- internship machine learning Remote
- machine learning researcher Remote
- machine learning research scientist Remote





