Search Quality Evaluator
Alignerr
About The Role What if your everyday curiosity and sharp judgment could directly influence how millions of people find information online? We're looking for Search Quality Evaluators to assess AI-generated answers, search results, and recommendations - helping ensure that the AI systems shaping how the world accesses knowledge are accurate, relevant, and genuinely useful. Search Quality Evaluator (AI Training) What if your everyday curiosity and sharp judgment could directly influence how millions of people find information online? We're looking for Search Quality Evaluators to assess AI-generated answers, search results, and recommendations - helping ensure that the AI systems shaping how the world accesses knowledge are accurate, relevant, and genuinely useful. This is a fully remote, flexible contract role open to anyone with strong critical thinking and a keen eye for quality. No technical or AI background required — just a reliable internet connection, good judgment, and a commitment to doing thoughtful work. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10-40 hours/week What You'll Do Evaluate search engine results for relevance, accuracy, and overall usefulness Rate AI-generated answers and recommendations using structured evaluation rubrics Compare multiple results side by side and rank them by quality Provide clear, concise written explanations to support your ratings Work through task-based assignments independently at your own pace and on your own schedule Who You Are Comfortable using search engines and navigating the web with confidence Able to assess content relevance and quality objectively and consistently Naturally detail-oriented with a methodical approach to evaluation tasks Clear and concise written communicator in English Self-motivated and reliable when working independently No prior AI, tech, or research experience required Nice to Have Background in research, journalism, education, or content analysis Experience with quality assurance, data review, or critical evaluation work Familiarity with AI tools or search platforms as an everyday user Broad general knowledge across a variety of topics and subject areas Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible - work when and where it suits you Freelance autonomy with the structure of meaningful, task-based work Contribute directly to AI development that shapes how technology connects people with information Potential for ongoing work and contract extension as new projects launch #J-18808-Ljbffr Alignerr
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...QualityHourly payPart timeRemote workFlexible hoursWelo Data
New York, NY23 hours ago- RWS - TrainAI is seeking a part-time Search Quality Rater to help assess how our clients’ search engines respond to everyday queries. Based in the United States, you will work remotely up to 29 hours per week, maintaining quality standards and meeting SLAs while using...QualityRemote jobPart timeWork from homeHome office
- ...your skills to the test! Welocalize is looking for English AI Search Evaluators to help improve the online search engine experience. In this... ...of age. Note: Full name of the position is "Scout Search Quality Rater - English (United States)". #J-18808-Ljbffr Welo DataQualityPart timeCurrently hiringImmediate startRemote workFlexible hours
$14.5 per hour
Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages...QualityHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours$11.5 per hour
...offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and residency in the U.S. for the...QualityRemote jobHourly payPart time- ...hiring for a Personalized Internet Ads Evaluator role! This is a freelance, independent contractor... ...rating them on their relevance to the search terms used as well as providing feedback... ...in order to improve their content, quality, and layout. Your ultimate goal will be...QualityPart timeFor contractorsFreelanceCurrently hiringImmediate startWork from homeFlexible hours
$151k - $251.6k
LSEG's Evaluated Pricing Service provides end-of-day valuations across global CLO markets. We are seeking an expert Senior Evaluator to... ...secondary trading data, and cash flow analytics to generate high-quality evaluations. The role requires active engagement with clients...QualityFull timePart timeInternship$20 per hour
A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position...QualityHourly payRemote workFlexible hoursDataAnnotation
New York, NY1 day ago- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...QualityWork at officeRemote work
Obsidian
New York, NY4 days ago - ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...QualityContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY1 day ago - ...PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and... ...including market data collection and analysis, price generation, quality control, and client interactionContinuously improve product and...Quality
- ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications...QualityFor contractorsRemote workFlexible hours
DataAnnotation
New York, NY1 day ago - ...with hourly pay starting at $40 and additional bonuses for high-quality work. Applicants need to have a current or in-progress medical... ...include providing AI chatbots with complex problems, evaluating AI outputs, and ensuring medical accuracy in model performance...QualityHourly payRemote workFlexible hours
DataAnnotation
New York, NY23 hours ago $20 per hour
...company is looking for detail-oriented individuals to train AI chatbots. Responsibilities include creating prompts, writing quality responses, and evaluating AI model outputs. Candidates must be fluent in English and possess excellent writing and research skills, along with...QualityHourly payFor contractorsFreelanceRemote workFlexible hoursDataAnnotation
New York, NY3 days ago$20 - $30 per hour
...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI... ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention...QualityRemote jobHourly pay$50 per hour
A leading AI healthcare firm is seeking a Diagnostic Imaging Coordinator to enhance AI models by evaluating chatbot outputs and providing complex healthcare-related problems. The position offers flexibility with remote work options and competitive hourly pay starting at...QualityRemote jobHourly payFor contractorsFlexible hours$30 per hour
...$20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows, including screenshots and reasoning...QualityRemote jobHourly payContract work- DataAnnotation is seeking a Customer Service Representative to help train AI models by evaluating their progress and improving their quality. In this flexible role, you can choose projects and work from home. The ideal candidate should be fluent in English, detail-oriented...QualityRemote jobHourly payContract workWork from homeFlexible hours
- ...re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in...QualityContract workTemporary workFreelanceImmediate startRemote work
- ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in...QualityContract workTemporary workFreelanceImmediate startRemote work
- A leading AI evaluation firm is seeking medical experts to train AI models and evaluate their performance. This remote role allows you... ...compensation starting at $30 with potential bonuses for high-quality work. Ideal candidates will have a medical background, fluency...QualityRemote jobHourly pay
- Job Summary: The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally... ...member of the interdisciplinary team to maintain high-quality patient care. The MHE reports to the Regional Program Manager for...Quality
$150 per hour
The Home and Community-Based Program evaluates preschoolers for special education for the Committee on Special Education (CPSE).Education... ...Street is a leader in education, a pioneer in improving the quality of classroom practice, and a national advocate for children and...QualityPart timeWork from homeShift work- ...fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract... ...the question posed in the user prompt. The goal is to assess quality, safety, and utility—particularly in literature summarization,...QualityContract workRemote workWorldwide
- ...increase visibility, recognition, and drive new user acquisition via Google Search, DV360, GDN and YouTube.Continuously monitor, identify and improve all three components of the AdWords Quality Score: Ad Relevance, Expected CTR, and Landing Page ExperienceAssure keyword...Quality
- ...Obsidian is hiring expert Evaluators for a remote, hourly role focused on Compliance and regulatory response with financial-services AI... ...'ll assess AI-generated work products for accuracy and domain quality, leveraging your expertise. The ideal candidate has over 5 years...QualityHourly payWork at officeRemote work
Obsidian
New York, NY4 days ago $25 per hour
...company is seeking a Language Specialist to improve AI chatbots by evaluating their progress and teaching them conversational skills in... ...degree. Payment is competitive, starting at $25+ USD per hour, reflecting the quality and volume of work. #J-18808-Ljbffr DataAnnotationQualityRemote jobHourly pay$20 per hour
...Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity...QualityRemote jobContract workPart timeSummer work$135 - $190 per hour
...Speech Language Pathologist Evaluator - Queens NY- Achieve Beyond Description: Apply to Achieve Beyond as a Speech Language Pathologist... ...and support, to ensure our services are of the highest quality and adhere to our strong ethical standards. We currently offer...QualityLocal areaFlexible hoursAchieve Beyond Pediatric Therapy & Autism Services
New York, NY23 hours ago$60 - $70 per hour
...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-harm, violence...QualityContract workSummer workRemote workMercor
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Search Quality Evaluator. Be the first to apply!
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- rn quality New York, NY