Search Quality Evaluator
Alignerr
Search Quality Evaluator (AI Training) What if your everyday curiosity and sharp judgment could directly influence how millions of people find information online? We're looking for Search Quality Evaluators to assess AI-generated answers, search results, and recommendations — helping ensure that the AI systems shaping how the world accesses knowledge are accurate, relevant, and genuinely useful. This is a fully remote, flexible contract role open to anyone with strong critical thinking and a keen eye for quality. No technical or AI background required — just a reliable internet connection, good judgment, and a commitment to doing thoughtful work. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–40 hours/week What You'll Do Evaluate search engine results for relevance, accuracy, and overall usefulness Rate AI-generated answers and recommendations using structured evaluation rubrics Compare multiple results side by side and rank them by quality Provide clear, concise written explanations to support your ratings Work through task-based assignments independently at your own pace and on your own schedule Who You Are Comfortable using search engines and navigating the web with confidence Able to assess content relevance and quality objectively and consistently Naturally detail-oriented with a methodical approach to evaluation tasks Clear and concise written communicator in English Self-motivated and reliable when working independently No prior AI, tech, or research experience required Nice to Have Background in research, journalism, education, or content analysis Experience with quality assurance, data review, or critical evaluation work Familiarity with AI tools or search platforms as an everyday user Broad general knowledge across a variety of topics and subject areas Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible — work when and where it suits you Freelance autonomy with the structure of meaningful, task-based work Contribute directly to AI development that shapes how technology connects people with information Potential for ongoing work and contract extension as new projects launch #J-18808-Ljbffr Alignerr
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityHourly payPart timeRemote workFlexible hoursWelo Data
New York, NY2 days ago$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY2 days ago- Alignerr is hiring for a fully remote Search Quality Evaluator (AI Training). This hourly contract role asks for strong critical thinking, reliability, and the ability to evaluate AI-generated answers and search results. You will rate content using structured rubrics and...QualityRemote jobHourly payContract work10 hours per week
- ...Role What if your everyday internet instincts — knowing a good search result from a bad one — could directly influence how AI finds... ...information to millions of people? We’re looking for Search Quality Evaluators to assess search engine results, AI‑generated answers, and...QualityHourly payOngoing contractContract workFreelanceRemote workFlexible hours
- ...your skills to the test! Welocalize is looking for English AI Search Evaluators to help improve the online search engine experience. In this... ...of age. Note: Full name of the position is "Scout Search Quality Rater - English (United States)". #J-18808-Ljbffr Welo DataQualityPart timeCurrently hiringImmediate startRemote workFlexible hours
$11.5 per hour
...offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and residency in the U.S. for the...QualityHourly payPart timeRemote workUniversity of Delaware
New York, NY5 days ago$30 - $45 per hour
...Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to... ...Browsing Evaluators to contribute high-quality web interaction data for a valued customer... ...activities, including clicking, typing, and searching. Provide clear written documentation...QualityFor contractorsRemote workESRhealthcare and EXEC STAFF RECRUITERS
New York, NY2 days ago$19 per hour
...high-fidelity simulated environments to evaluate and train AI models on real-world procurement... ...distribution, packaging, receiving, and quality assurance tasks within the Mobile... ...Garland Irving Plano The 10 most popular job searches in Lewisville, TX are: amazon work from...QualityHourly payPermanent employmentFull timeTemporary workCasual workSeasonal workWork at officeRemote workWork from homeMonday to FridayImpact Valuation Group LLC
New York, NY3 days ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY3 days ago $20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...QualityHourly payRemote workFlexible hoursDataAnnotation
New York, NY3 days ago- ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have... ...evaluating outputs for accuracy and relevance, and maintaining high-quality evaluations. This remote role offers competitive compensation...QualityLocal areaRemote work
BluePrint Technologies
New York, NY5 days ago - ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications...QualityFor contractorsRemote workFlexible hours
DataAnnotation
New York, NY3 days ago $40 per hour
...related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring... ...English. This is an independent contract position with hourly pay starting at $40, plus bonuses for high-quality work. #J-18808-LjbffrQualityHourly payContract workRemote workFlexible hoursDataAnnotation
New York, NY2 days ago$50 per hour
A leading AI healthcare firm is seeking a Diagnostic Imaging Coordinator to enhance AI models by evaluating chatbot outputs and providing complex healthcare-related problems. The position offers flexibility with remote work options and competitive hourly pay starting at...QualityRemote jobHourly payFor contractorsFlexible hours$30 per hour
...$20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows, including screenshots and reasoning...QualityRemote jobHourly payContract work$20 - $30 per hour
...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI... ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention...QualityRemote jobHourly pay- A leading AI evaluation firm is seeking medical experts to train AI models and evaluate their performance. This remote role allows you... ...compensation starting at $30 with potential bonuses for high-quality work. Ideal candidates will have a medical background, fluency...QualityRemote jobHourly pay
- ...elite creative and technical talent with leading AI research labs. They are seeking a Market research / competitive intelligence Evaluator. This remote position offers a chance to evaluate AI-generated content and provide structured feedback while leveraging deep expertise...QualityRemote jobWork at officeFlexible hours
$80 - $120 per hour
...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should...QualityHourly payContract workWork at officeRemote workMercor Inc
New York, NY3 days ago$25 per hour
...company is seeking a Language Specialist to improve AI chatbots by evaluating their progress and teaching them conversational skills in... ...Bachelor's degree. Payment is competitive, starting at $25+ USD per hour, reflecting the quality and volume of work. #J-18808-LjbffrQualityHourly payRemote workDataAnnotation
New York, NY3 days ago- ...fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract... ...the question posed in the user prompt. The goal is to assess quality, safety, and utility—particularly in literature summarization,...QualityContract workRemote workWorldwide
- DataAnnotation is seeking a Customer Service Representative to help train AI models by evaluating their progress and improving their quality. In this flexible role, you can choose projects and work from home. The ideal candidate should be fluent in English, detail-oriented...QualityRemote jobHourly payContract workWork from homeFlexible hours
- ...YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will apply your domain expertise to train next-generation... ..., shaping how models learn, reason, and perform through high-quality real-world input. Responsibilities include scoring AI outputs,...QualityContract workRemote work
YO IT Consulting
New York, NY3 days ago - ...Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time position requires native-level language proficiency and a university degree. You will contribute to improving evaluation frameworks while...QualityFull timeRemote work
Welocalize
New York, NY2 days ago $20 per hour
...Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity...QualityRemote jobContract workPart timeSummer work$20 per hour
...contractors to teach AI chatbots using their language skills. This role involves creating diverse conversations, writing high-quality responses, and evaluating model performance. Ideal candidates will have excellent writing and research skills, strong attention to detail, and...QualityRemote jobHourly payFor contractors$20 per hour
...company is looking for detail-oriented individuals to train AI chatbots. Responsibilities include creating prompts, writing quality responses, and evaluating AI model outputs. Candidates must be fluent in English and possess excellent writing and research skills, along with...QualityRemote jobHourly payFor contractorsFreelanceFlexible hours- ...with hourly pay starting at $40 and additional bonuses for high-quality work. Applicants need to have a current or in-progress medical... ...include providing AI chatbots with complex problems, evaluating AI outputs, and ensuring medical accuracy in model performance...QualityRemote jobHourly payFlexible hours
- ...panel for assigned region. Consult and advise bank staff regarding real estate appraisal policy and procedures and state and federal appraisal regulations. Maintain review productivity and quality control measurements in-line with department benchmarks #J-18808-Ljbffr...QualityBank staff
North Carolina Chapter of the Appraisal Institute
New York, NY3 days ago $135 - $190 per hour
...Speech Language Pathologist Evaluator - Queens NY- Achieve Beyond Description: Apply to Achieve Beyond as a Speech Language Pathologist... ...and support, to ensure our services are of the highest quality and adhere to our strong ethical standards. We currently offer...QualityLocal areaFlexible hoursAchieve Beyond Pediatric Therapy & Autism Services
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Search Quality Evaluator. Be the first to apply!
- evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- work from home web search evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality assurance quality control engineer New York, NY