AI Evaluation Specialist
Virtual Vocations Inc
To support AI development, the part-time AI Evaluation Specialist will review and assess AI-generated outputs for quality and usability while collaborating with teams to refine evaluation standards in a remote contract role. Key responsibilities Review and critically assess AI-generated outputs for quality, clarity, and user experience Identify inconsistencies and improvement opportunities across various content types Provide insightful feedback to inform model improvements and enhance evaluation workflows Required qualifications Native English proficiency at C1 or C2 level Exceptional reading comprehension and attention to detail Strong observational skills with excellent aesthetic or editorial judgment Ability to think critically and deliver high-quality evaluations in ambiguous scenarios Excellent written and verbal communication skills
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist in United States vacancy
$70 per hour
Role Description Join a cutting-edge AI research initiative focused on improving the quality, accuracy, and reasoning capabilities... ...with exceptional critical thinking and communication skills to evaluate AI-generated responses across a variety of topics. In this role...SuggestedWeekly payContract workPart timeFor contractorsRemote workFlexible hoursWeekday AI
Remote28 days ago$130 - $180 per hour
Role Description Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking... ...to contribute their clinical expertise toward training and evaluating next-generation AI models capable of sophisticated medical reasoning...SuggestedWeekly payContract workPart timeFor contractorsRemote workFlexible hoursWeekday AI
Remote6 days ago$45 - $185 per hour
...using Model Context Protocol tools, plugins, and connectors for complex personal workflows. This role supports an AI research initiative focused on evaluating how effectively AI assistants complete personalised, multi-step tasks using connected tools such as Google Drive...SuggestedHourly payWeekly payContract workPart timeFor contractorsRemote workTrial period24-MAG
Remote3 days ago$20 per hour
A leading AI training company is seeking analytical, detail-oriented individuals to remotely teach AI chatbots. Responsibilities include developing prompts, writing high-quality responses, and evaluating different AI models. The role is ideal for those with experience in...SuggestedHourly payFull timePart timeRemote workFlexible hoursDataAnnotation
Providence, RI4 days ago$25 - $30 per hour
...independent contractors in the Town of Vermont, Wisconsin to help train AI chatbots. Ideal candidates are proactive individuals who can... ...include creating complex prompts, writing responses, and evaluating AI models. Candidates are required to have strong writing and research...SuggestedHourly payFor contractorsRemote workFlexible hoursDataAnnotation
Vermont4 days ago$20 per hour
...is seeking analytical, detail-oriented individuals to join their remote team. The role involves developing prompts to train AI chatbots, evaluating AI model outputs, and writing high-quality responses. Ideal candidates will have excellent writing and research skills,...Hourly payRemote workFlexible hoursDataAnnotation
New York, NY4 days ago$20 per hour
A leading AI company in the United States is seeking analytical and detail-oriented individuals for the role of AI chatbot trainer.... ...diverse conversations, writing high-quality responses to prompts, and evaluating AI model performance. Ideal candidates have strong writing,...Hourly payRemote workFlexible hoursDataAnnotation
Sioux Falls, SD4 days ago$20 per hour
A leading AI training company is seeking analytical and detail-oriented professionals to help train AI chatbots. This role, ideal for... ..., involves developing prompts, writing responses, and evaluating AI model outputs. Flexibility in choosing projects and schedules...FreelanceRemote workDataAnnotation
Lincoln, NE4 days ago- ...A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities...Immediate start
Crossing Hurdles
New York, NY2 days ago $20 per hour
A leading AI quality assurance company is seeking individuals to develop prompts and test AI chatbots. This role allows for remote... ...creating diverse conversations, providing high-quality responses, and evaluating AI model outputs. A bachelor's degree and experience in business...Hourly payFreelanceRemote workFlexible hoursDataAnnotation
Wisconsin4 days ago$20 per hour
A technology company focused on AI is seeking individuals for a remote position teaching AI chatbots. This role allows you to work flexibly, developing prompts and evaluating AI responses while managing your own schedule. Candidates should possess strong writing and research...Hourly payRemote workDataAnnotation
Santa Fe, NM5 days ago$25 - $30 per hour
...DataAnnotation is seeking analytical individuals in the United States to develop prompts and evaluate AI models. This independent contractor role allows you to choose your projects and work from home on your own schedule. A strong command of English, a bachelor's degree...Hourly payFor contractorsRemote workWork from homeDataAnnotation
El Paso, TX5 days ago$60 per hour
...seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong... ...familiarity with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected AI behaviors...Part timeRemote workFlexible hoursMind Rift
Kansas City, MO5 days ago$20 per hour
A tech firm specializing in AI seeks analytical and detail-oriented individuals for remote work in training AI chatbots. The role involves... ...diverse conversation prompts, writing high-quality answers, and evaluating different AI models. Ideal candidates should have a bachelor's...Remote jobFor contractorsFreelanceFlexible hours$20 per hour
A leading AI training company is seeking remote workers to assist in training AI chatbots. Responsibilities include developing conversations, writing responses, and evaluating AI performance. The ideal candidates are analytical and detail-oriented with strong communication...Remote jobHourly payFlexible hours$20 per hour
A growing AI development company is seeking individuals for a remote position to help train AI chatbots. You will create diverse conversations, provide high-quality responses, and evaluate AI model performance. This role is perfect for those with experience in managing...Remote jobHourly payFlexible hours$25 - $30 per hour
DataAnnotation is seeking analytical and detail-oriented contractors in Arizona to assist with training AI chatbots. Responsibilities include developing prompts and evaluating AI outputs. This position offers project flexibility, allowing you to choose your working hours...Remote jobHourly payFor contractorsWork from home$25 - $30 per hour
DataAnnotation is seeking analytical and detail-oriented individuals to help train AI chatbots. In this role, you will develop and evaluate complex prompts while working on your schedule from home. Ideal candidates should have excellent writing and research skills. This...Remote jobHourly payFor contractorsWork from home- DataAnnotation is seeking independent contractors in Maryland to train AI chatbots. Candidates will create complex prompts and write quality responses to evaluate diverse AI outputs. Flexibility is key, with potential hours ranging from 5-40 per week and hourly pay starting...Remote jobHourly payFor contractors
- A tech company specializing in AI projects is seeking skilled LibreSprite users to assist in evaluating AI-generated visual content. As an independent contractor, you can work flexibly from anywhere, contributing around 5-20 hours per week depending on project needs. Ideal...Remote jobFor contractors
$50 - $60 per hour
...DataAnnotation is seeking a Clinical Specialist to train AI models by providing complex healthcare-related problems. This independent contractor... ...degree and fluency in English. Responsibilities include evaluating AI outputs for medical accuracy and performance quality. Only...Hourly payFor contractorsRemote workWork from homeDataAnnotation
Wausau, WI5 days ago- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ3 days ago - ...Supporting AI data and language projects, the hourly contractor AI Trainer and Evaluator will work remotely on a flexible basis, focusing on content generation, data annotation, and evaluating AI-generated responses for accuracy and cultural appropriateness. Key responsibilities...Hourly payFor contractorsRemote workFlexible hours
Virtual Vocations Inc
United States3 days ago - A data technology company is seeking a Statistician to enhance AI models by evaluating their logic and progress. The role demands expert-level mathematical reasoning and offers a flexible working schedule, allowing for full-time or part-time remote work. Responsibilities...Hourly payFull timePart timeRemote workFlexible hours
DataAnnotation
Raleigh, NC4 days ago - ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
Prolific
Arizona City, AZ4 days ago $40 per hour
A leading data annotation company seeks a Statistician to enhance AI models through evaluating chatbot logic and solving complex mathematical problems. This remote position allows flexibility in projects and hours, with compensation starting at $40+ per hour. Ideal candidates...Hourly payContract workRemote workDataAnnotation
Bismarck, ND4 days ago$40 per hour
A tech company specializing in AI training is looking for a Statistician to join their team. In this remote role, you'll train AI models by providing complex math problems and evaluating their outputs for quality and correctness. The ideal candidate will have strong mathematical...Hourly payRemote workFlexible hoursDataAnnotation
Oregon, WI4 days ago- ...Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios...Hourly payFor contractorsFreelanceRemote work
Meridial Marketplace, by Invisible
New York, NY4 days ago $30 per hour
...Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in... ...home with competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr...Remote workWork from homeProlific
Chicago, IL3 days ago$40 per hour
A technology company specializing in AI training is looking for a Biology Expert based in the United States. This role involves training AI chatbots by providing complex biology questions and evaluating their maturity and performance. Candidates should have strong knowledge...Hourly payRemote workFlexible hoursDataAnnotation
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Specialist. Be the first to apply!
