Search Quality Evaluator
Alignerr
About The Role What if your everyday internet instincts — knowing a good search result from a bad one — could directly influence how AI finds and presents information to millions of people? We’re looking for Search Quality Evaluators to assess search engine results, AI‑generated answers, and content recommendations, helping make AI smarter and more useful for everyone. This is a fully remote, flexible contract role open to anyone with sharp judgment and strong reading comprehension. No technical background required — just a reliable internet connection and a genuine eye for quality. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–40 hours/week What You’ll Do Evaluate search engine results for relevance, accuracy, and usefulness across a wide range of topics and queries. Rate AI‑generated answers and content recommendations using structured evaluation rubrics. Compare multiple results and rank them by overall quality and helpfulness. Provide clear, concise written explanations to support your ratings and judgments. Work through task‑based assignments independently and at your own pace. Who You Are Comfortable navigating the web and using search engines as part of everyday life. Able to assess content quality and relevance objectively and consistently. Naturally detail‑oriented with a systematic, methodical approach to tasks. Clear and concise written communicator in English. Self‑motivated and reliable when working independently. No prior AI, tech, or research experience required. Nice to Have Background in research, writing, editing, journalism, or critical analysis. Experience with quality assurance, information evaluation, or content review. Familiarity with AI tools, search platforms, or content rating systems as an end user. Broad general knowledge across a variety of subject areas. Why Join Us Work on cutting‑edge AI projects alongside leading research labs. Fully remote and flexible — work when and where it suits you. Freelance autonomy with the structure of meaningful, task‑based work. Make a direct, tangible impact on how AI finds and communicates information at scale. Potential for ongoing work and contract extension as new projects launch. #J-18808-Ljbffr Alignerr
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...your skills to the test! Welocalize is looking for English AI Search Evaluators to help improve the online search engine experience. In this... ...of age. Note: Full name of the position is "Scout Search Quality Rater - English (United States)". #J-18808-Ljbffr Welo DataQualityPart timeCurrently hiringImmediate startRemote workFlexible hours
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityRemote jobHourly payPart timeFlexible hours$11.5 per hour
...offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and residency in the U.S. for the...QualityHourly payPart timeRemote work$30 - $45 per hour
Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to Detail... ...Browsing Evaluators to contribute high-quality web interaction data for a valued customer... ...activities, including clicking, typing, and searching. Provide clear written documentation...QualityRemote jobFor contractors$19 per hour
...high-fidelity simulated environments to evaluate and train AI models on real-world procurement... ...distribution, packaging, receiving, and quality assurance tasks within the Mobile... ...Garland Irving Plano The 10 most popular job searches in Lewisville, TX are: amazon work from...QualityHourly payPermanent employmentFull timeTemporary workCasual workSeasonal workWork at officeRemote workWork from homeMonday to Friday- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
$20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...QualityHourly payRemote workFlexible hours- ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have... ...evaluating outputs for accuracy and relevance, and maintaining high-quality evaluations. This remote role offers competitive compensation...QualityLocal areaRemote work
- ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications...QualityFor contractorsRemote workFlexible hours
$40 per hour
...related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring... ...English. This is an independent contract position with hourly pay starting at $40, plus bonuses for high-quality work. #J-18808-LjbffrQualityHourly payContract workRemote workFlexible hours- A leading AI evaluation firm is seeking medical experts to train AI models and evaluate their performance. This remote role allows you... ...compensation starting at $30 with potential bonuses for high-quality work. Ideal candidates will have a medical background, fluency...QualityRemote jobHourly pay
$20 - $30 per hour
...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI... ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention...QualityRemote jobHourly pay$150 per hour
The Home and Community-Based Program evaluates preschoolers for special education for the Committee on Special Education (CPSE).Education... ...Street is a leader in education, a pioneer in improving the quality of classroom practice, and a national advocate for children and...QualityPart timeWork from homeShift work$50 per hour
A leading AI healthcare firm is seeking a Diagnostic Imaging Coordinator to enhance AI models by evaluating chatbot outputs and providing complex healthcare-related problems. The position offers flexibility with remote work options and competitive hourly pay starting at...QualityRemote jobHourly payFor contractorsFlexible hours- ...elite creative and technical talent with leading AI research labs. They are seeking a Market research / competitive intelligence Evaluator. This remote position offers a chance to evaluate AI-generated content and provide structured feedback while leveraging deep expertise...QualityRemote jobWork at officeFlexible hours
$30 per hour
...$20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows, including screenshots and reasoning...QualityRemote jobHourly payContract work- DataAnnotation is seeking a Customer Service Representative to help train AI models by evaluating their progress and improving their quality. In this flexible role, you can choose projects and work from home. The ideal candidate should be fluent in English, detail-oriented...QualityRemote jobHourly payContract workWork from homeFlexible hours
- ...re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in...QualityContract workTemporary workFreelanceImmediate startRemote work
- ...fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract... ...the question posed in the user prompt. The goal is to assess quality, safety, and utility—particularly in literature summarization,...QualityContract workRemote workWorldwide
- ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in...QualityContract workTemporary workFreelanceImmediate startRemote work
$25 per hour
...company is seeking a Language Specialist to improve AI chatbots by evaluating their progress and teaching them conversational skills in... ...Bachelor's degree. Payment is competitive, starting at $25+ USD per hour, reflecting the quality and volume of work. #J-18808-LjbffrQualityHourly payRemote work$80 - $120 per hour
...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should...QualityHourly payContract workWork at officeRemote work- ...YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will apply your domain expertise to train next-generation... ..., shaping how models learn, reason, and perform through high-quality real-world input. Responsibilities include scoring AI outputs,...QualityContract workRemote work
$20 per hour
...company is looking for detail-oriented individuals to train AI chatbots. Responsibilities include creating prompts, writing quality responses, and evaluating AI model outputs. Candidates must be fluent in English and possess excellent writing and research skills, along with...QualityRemote jobHourly payFor contractorsFreelanceFlexible hours- ...Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time position requires native-level language proficiency and a university degree. You will contribute to improving evaluation frameworks while...QualityFull timeRemote work
$20 per hour
...contractors to teach AI chatbots using their language skills. This role involves creating diverse conversations, writing high-quality responses, and evaluating model performance. Ideal candidates will have excellent writing and research skills, strong attention to detail, and...QualityRemote jobHourly payFor contractors$20 per hour
...Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity...QualityRemote jobContract workPart timeSummer work- ...with hourly pay starting at $40 and additional bonuses for high-quality work. Applicants need to have a current or in-progress medical... ...include providing AI chatbots with complex problems, evaluating AI outputs, and ensuring medical accuracy in model performance...QualityRemote jobHourly payFlexible hours
$135 - $190 per hour
...Speech Language Pathologist Evaluator - Queens NY- Achieve Beyond Description: Apply to Achieve Beyond as a Speech Language Pathologist... ...and support, to ensure our services are of the highest quality and adhere to our strong ethical standards. We currently offer...QualityLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Search Quality Evaluator. Be the first to apply!
- evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- work from home web search evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality assurance quality control engineer New York, NY

