Remote AI Evaluation Specialist
$18 per hourOutlier
Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, compare AI-generated images and videos to assess prompt adherence, and explain in writing what looked or sounded off.
You will help shape AI systems by providing precise feedback, earn up to $18 per hour, and access leading LLMs for free while working with a diverse global team.
#J-18808-LjbffrVacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist in United States vacancy
- ...management to design Excel-based tasks that test AI's ability to perform real PM work. You bring 3+... .... You will craft tasks, write precise evaluation rubrics, and work as an independent contractor on a fully remote, task-based program with weekly payments. #J-...Remote workWeekly payFor contractors
Aptura
United States5 days ago $20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance...Remote workContract workSummer workMercor
Abbeville, GA20 days ago$105 per hour
...OpenTrain AI, Inc. seeks experienced Defense and Intelligence Specialists to evaluate AI responses to defense and intelligence scenarios using professional judgment and public sources. This remote, asynchronous contract pays up to $105 per hour and requires at least...Remote workHourly payContract workOpenTrain AI, Inc.
United States4 hours ago- ...micro1 is a data lab that focuses on evaluating AI systems through SIGINT-inspired scenarios and expert analysis. This remote contractor role involves developing realistic, unclassified SIGINT scenarios and reference materials to evaluate AI outputs for accuracy and reasoning...Remote workFor contractors
micro1
United States2 days ago - ...AuraOne, Inc. is seeking a Turkish Linguistic Experts specialist to remotely evaluate AI outputs. You will review workflows, policy adherence, and stakeholder fit, grading tone and escalation, and documenting next steps for model training. This independent contractor...Remote workFor contractors
AuraOne, Inc.
New York, NY5 days ago - ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work... ..., from generating training data to evaluating the performance of models.About the opportunity... ...what looked or sounded wrong, all remotely and on your own schedule.At Outlier, your...Remote workContract workFor contractorsFreelanceInternshipFlexible hoursNight shift
Scale AI
East Lansing, MI1 day ago - ...OpenTrain AI, Inc. is hiring for a worldwide remote, part-time contract role focused on creating challenging prompts and evaluating language model responses. Candidates should bring strong English writing, analytic thinking, and team-management experience to assess accuracy...Remote workContract workPart timeWorldwideFlexible hours
OpenTrain AI, Inc.
United States5 days ago - ...detail-oriented English speakers to review AI-generated media. You will roleplay live... ...writing what looked or sounded off, all remotely on your schedule. At Outlier, your expertise... ...systems reason, learn, and improve. This evaluation loop turns frontier research into AI that...Remote workFlexible hours
Outlier
Florida3 days ago - ...Braintrust is seeking PhD-level experts to help train and evaluate advanced AI models. This fully remote, flexible contract work lets you apply your domain expertise to shape how models reason, answer, and improve. You will review AI-generated content in your field...Remote workContract workTemporary workFlexible hours
Brain Trust Inc
United States3 days ago - ...micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise...Remote workFor contractors
micro1
New York, NY5 days ago - ...Outlier is hiring detail-oriented evaluators to review AI-generated media from home on a flexible schedule. You will participate in live conversations... ..., and reporting why a given output diverged from the prompt. Remote work and weekly payments are offered. #J-18808-Ljbffr...Remote workWeekly payFlexible hours
Outlier
Boise, ID4 days ago - ...Crossing Hurdles is seeking a Personal Account Generalist Rater (Mobile) for a remote contract role. You will review AI-generated prompts and responses in English, evaluate relevance and usefulness, and provide clear ratings and feedback to help improve next-generation...Remote workContract work10 hours per weekFlexible hours
Crossing Hurdles
United States5 days ago - ...Outlier is seeking detail-oriented English-speaking reviewers to evaluate AI-generated media. You will engage in live conversations with AI... ...and provide written explanations of observed issues. Flexible remote work with weekly pay and access to AI tools. Ideal...Remote workWeekly payFlexible hours
Outlier
Honolulu, HI5 days ago - ...is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations... ...outputs, and explain in writing what looks off, all remotely on your own schedule. Expect to evaluate image/video pairs, rate outputs on adherence and quality...Remote workWeekly payFlexible hours
Outlier
United States5 days ago - ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will rate AI voice model conversations... ...welcomed. Responsibilities include live roleplay with AI models, evaluating realism and adherence to #J-18808-Ljbffr...Remote workHourly payFlexible hours
Outlier
Sioux Falls, SD4 days ago $32 per hour
...Position: Text Situated Alignment Specialist Type: Contractor... ...Compensation: $32/hour Location: Remote Commitment: Full-time (40... ...Responsibilities Review AI conversations involving real-world... ...follow-up questions. Evaluate whether additional information...Remote workFull timeFor contractorsCrossing Hurdles
United States5 days ago$40 - $125 per hour
...Sovrano AI is hiring for fully remote, project-based work in three tracks: experimental biology, drug discovery, and computational biology. You will design and evaluate tasks from real-world life sciences problems, grade frontier AI responses, and write clear rubrics....Remote workHourly payFor contractors10 hours per weekSovrano AI
United States5 days ago- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll...Remote workFor contractors
YO AI Labs
Seattle, WA3 days ago - ...Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will engage in live... ...in writing what looked or sounded off. Role focuses on evaluating realism, adherence to prompts, and quality, with paid weekly...Remote workWeekly payContract workFlexible hours
Outlier
United States3 days ago $18 per hour
...detail-oriented English speakers to review AI-generated media. You will hold live... ...explain what looked or sounded off, all remotely and on your own schedule. Earn up to $18... ...help improve AI systems through precise evaluations and clear explanations. #J-18808-Ljbffr...Remote workHourly payWeekly payFlexible hoursOutlier
Wilmington, DE4 days ago$18 per hour
...We are looking for Speech AI Evaluation Specialists living in Malaysia to support the improvement of AI-generated content in Chinese Simplified... ...professional living in Malaysia and seeking for a flexible remote work? Are you interested in shaping the development and safety...Remote workHourly payExtra incomePart timeFreelanceImmediate startWork from home10 hours per weekFlexible hoursRWS
Tallahassee, FL5 days ago$11 - $30.65 per hour
...Audio Specialist- Freelance AI Trainer Project World Wide - Remote A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support...Remote workHourly payContract workFor contractorsFreelanceMeridial
New York, NY4 days ago- ...AuraOne, Inc. seeks an Ophthalmology AI Evaluation Specialist — Clinical Reasoning Review to remotely review prompts and responses against a quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback for model retraining. The...Remote workFor contractors
AuraOne, Inc.
United States2 days ago $102k - $120k
...Chenega Professional Services’ company, is looking for a AI Evaluation Specialist . The AI Evaluation Specialist will evaluate enterprise... ...Teleworking Permitted? Yes Teleworking Details Remote - Continental US Estimated Salary/Wage USD $102,000.00/...Remote workFull timeContract workTemporary workFlexible hours- ...A leading AI research platform is seeking an AI Trainer with expertise in Graphic and Visual Design. The role involves evaluating designs, ensuring they meet professional standards, and providing... ...competitive pay, flexible hours, and remote work options. #J-18808-Ljbffr...Remote workFlexible hours
Prolific
Los Angeles, CA5 days ago $180 per hour
...OpenTrain AI, Inc. is seeking an obstetrician-gynecologist to evaluate AI systems remotely. You will develop expert-level clinical tasks, review AI responses for safety and accuracy, and provide structured feedback to improve model performance. This is a remote, part...Remote workHourly payPart timeFlexible hoursOpenTrain AI, Inc.
United States2 hours ago- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote workFor contractorsFlexible hours
Turing
Seattle, WA1 day ago $50 per hour
...OpenTrain AI, Inc. is seeking a remote, part-time reviewer for nursing prompt evaluation. You will assess prompts and AI responses, write improvements, and clearly explain reasoning to guide model behavior. The role requires current undergraduate nursing students, fluent...Remote workHourly payPart timeOpenTrain AI, Inc.
New York, NY2 days ago- ...Scale AI presents an opportunity via Outlier for detail-oriented English speakers to review AI-generated media and evaluate model outputs. You will engage in live conversations with AI voice... ..., all on your own schedule and remotely from the United States. As a freelance...Remote workFreelanceFlexible hours
Scale AI
Alaska11 hours ago - ...detail-oriented English speakers to review AI-generated media, roleplay live... ...and explain issues in clear English from a remote location. Flexibility to set your own... ...independent contractor status. Prior experience in evaluation tasks is helpful, and a Bachelor’s degree...Remote workFor contractorsFreelance
Outlier
Alaska11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Specialist. Be the first to apply!
Related searches
- ai data scientist United States
- ai scientist United States
- support specialist remote United States
- quality manager remote United States
- remote reviewer United States
- brand manager remote United States
- marketing assistant remote United States
- remote director United States
- automation engineer remote United States
- it manager remote United States