AI Evaluation Specialist
$40 per hourHandshake
Your Privacy Choices We and our vendors use technology that collects data about your use of our site so we can improve and personalize our products and services, for analytics and marketing, and to fulfill your requests. We may also share this information with marketing vendors, social media companies, and analytics partners. By using our website, you acknowledge and agree to our Terms of Use. To learn more about our privacy practices review our Privacy Policy. Please review your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers AI Skills Studio Handshake AI Research Log in Sign up AI EVALUATION SPECIALIST Sign up now Up to $40/hr Depending on the project Associate's , Bachelor's Remote Part-time Flexible hours About Handshake AI Overview Handshake is seeking motivated Associates, Bachelor’s, and Master’s students and grads to work remotely to test Large Language Models (LLMs) in collaboration with top AI labs. As part of this program, you’ll apply your overall skills and academic knowledge to help improve the performance of LLMs. All disciplines and majors are welcome to apply. Handshake AI projects are remote and part-time opportunities. Details Work remotely and independently on short-term AI training projects, with no minimum commitment to hours. No specific expertise required, just attention to detail. We’ll provide a brief training, and you’ll take a single assessment before starting. Learn how frontier AI labs are training their models while getting paid. Successful experience leads to eligibility for more projects in the future. Shape the future of AI while building skills and confidence to navigate an AI-driven job market. Qualifications Current students pursuing an Associate’s, Bachelor’s, or Master’s degree or those already holding degrees Individuals with exceptional attention to detail and the ability to follow detailed instructions accurately Candidates comfortable working in a primarily asynchronous, remote environment in collaboration with leading AI research labs People who believe their knowledge and reasoning skills can challenge today’s most advanced AI systems The application process Sign up and create an account Verify your identity Join and onboard into relevant projects Start working and earning Sign up now The career network for the AI economy Students Who's hiring Career tips Handshake AI Fellowship Program Opportunities Legal Help center Employers Pricing Request a demo Career centers Marketing toolkit Security Request demo Company About Join us Press Blog Support Careers Help center Contact Legal hub Your Privacy Choices ©2026 Handshake. All rights reserved Privacy policy Accessibility Terms of service
$30 per hour
...your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up HINDI AI EVALUATION SPECIALIST (SINGAPOREAN DIALECT) Sign up now Up to $30/hr Depending on the project Bachelor's Remote Part-time...SuggestedPart timeLocal areaRemote workFlexible hours- A forward-thinking tech company is seeking an AI Trainer specializing in visual and graphic design to evaluate AI outputs. Responsibilities include assessing design quality and providing feedback to ensure high professional standards. Applicants should have formal education...SuggestedRemote jobFlexible hours
- ...Enterprises, Inc. in San Francisco, CA is seeking a Software Engineering evaluator on a contract basis. You will create cutting-edge datasets for... ...code examples, providing precise solutions, and refining AI-generated code. You will work with researchers and cross-functional...SuggestedContract workFor contractors
- Cincinnatus LLC is seeking an Insurance SME to join a leading AI lab's GenAI team in San Francisco. You will evaluate AI outputs against rubrics and contribute real-world underwriting judgment to training data for foundational AI models. The role requires 8+ years in insurance...SuggestedWeekday work
- Mercor is seeking a Management Consulting Expert for a remote contract engagement. You will evaluate AI-generated artifacts for usability and provide clear, structured feedback to improve outputs while collaborating with AI teams to raise quality. Requirements include 5...SuggestedRemote jobContract work
$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code...Contract workSummer workLocal areaRemote work- ...Job Application for French Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial Back to jobs French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent Audio Evaluation...Hourly payPart timeFor contractorsFreelanceRemote work
$50 per hour
...Document Understanding contractor role. The position is remote, requires 15-20 hours per week, and compensates at $50/hour. You will evaluate AI-generated Real Estate content and ensure alignment with domain principles while working asynchronously to meet deadlines....Remote jobFor contractors$80 - $120 per hour
Mercor is seeking a Software / AI / IT / data Evaluator for contract work. The role is remote and pays $80-$120 per hour. You will assess AI outputs against domain rubrics, identify errors, and provide structured feedback to improve quality. Requirements include 5+ years...Remote jobHourly payContract work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work- ...About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI... ...detail-oriented Business Analyst to support a project involving the evaluation of multiple chatbot responses. The role will require analyzing...FreelanceRemote workFlexible hoursWeekday work
- Raydar is a seed-stage AI company in San Francisco building the data and infrastructure layer to improve model quality in creative... ...Engineer, RL & Evals to design, implement, and scale RL environments, evaluation systems, and production-grade backend pipelines. The role blends...
$130k - $220k
...Artificial Analysis** Artificial Analysis is the leading independent AI benchmarking and insights company. They help engineers,... ...What This Role Actually Is** This role is best described as an AI Evaluation Engineer / Technical Generalist. It is not a traditional software...Full timeWorldwide- ...Job Description Job Description San Francisco, California | Primarily On-site We are seeking an AI Evaluation Engineer – Reinforcement Learning & Agents to build the environments, evaluation systems, and supporting infrastructure used to train and assess long-...
- Deepgram is seeking a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our speech, audio, and multilingual models before they reach customers. You will define evaluation methodologies, build scalable pipelines...
- ...We are seeking elite Content Writers & AI Evaluation Specialists with expertise in copywriting, content creation and LLM evaluation. In this role, you will apply your deep expertise in writing, content strategy, and AI evaluation to create, review, and evaluate creative...Temporary workFor contractors
$30 - $90 per hour
...AI Evaluation Specialist Role Type: Contractor Location: Remote US Canada UK Ireland Australia New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project...Full timeFor contractorsRemote work$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...00–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Contract workSummer workWork at officeRemote work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$20 per hour
...Job Application for Search Engine Evaluation Specialist - Freelance AI Trainer Project at Meridial Back to jobs Search Engine Evaluation Specialist - Freelance AI Trainer Project United States of America Project Overview We are sourcing independent Search...Hourly payPart timeFor contractorsFreelanceRemote work$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...work , machine learning pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria...Contract workSummer workRemote work$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., machine learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria...Contract workSummer workRemote work$226k - $340k
## Job Description**Job Description**As an AI Sales Specialist, you'll be responsible for driving the growth and adoption of our full suite... ...(AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines...Work at officeLocal areaRemote work$162.7k - $220.2k
...customer action at scale? We're looking for a Sr. WW Data & AI GTM Specialist to own and evolve campaigns that help AWS customers adopt AI... ...conversations with the right customers at the right time. You'll evaluate, integrate, and interact with third-party agent ecosystems...Seasonal workLocal areaFlexible hoursNight shiftDay shift$204.44k - $324.99k
...test Prompt Builder templates and grounded AI experiences using Salesforce data, Data... ...(RAG) patterns Implement agent testing, evaluation, observability, and guardrails,... ...Developer I and Salesforce Certified Agentforce Specialist are required. Platform Developer II,...H1bLocal area$91.1k - $179.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a... ...capabilities such as orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop controlsProfessional...Local areaVisa sponsorship- ...radiological safety experts to red-team frontier AI models. The work focuses on judging misuse... ...benign, dual-use, and adversarial levels, evaluate model responses, and draft reference answers with clear rationales for non-specialists. This is writing-intensive work. #J-18808...
- Mercor is seeking a Private Banking Expert to evaluate AI systems in private banking settings and drive improvements across models and outputs. In this contract role, you will work remotely, test AI components, provide structured feedback to training data, and collaborate...Remote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Specialist. Be the first to apply!






