Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Search Quality Evaluator

Alignerr

About The Role What if your everyday internet instincts — knowing a good search result from a bad one — could directly influence how AI finds and presents information to millions of people? We’re looking for Search Quality Evaluators to assess search engine results, AI‑generated answers, and content recommendations, helping make AI smarter and more useful for everyone. This is a fully remote, flexible contract role open to anyone with sharp judgment and strong reading comprehension. No technical background required — just a reliable internet connection and a genuine eye for quality. Organization: Alignerr Type: Hourly Contract Location: Remote Commitment: 10–40 hours/week What You’ll Do Evaluate search engine results for relevance, accuracy, and usefulness across a wide range of topics and queries. Rate AI‑generated answers and content recommendations using structured evaluation rubrics. Compare multiple results and rank them by overall quality and helpfulness. Provide clear, concise written explanations to support your ratings and judgments. Work through task‑based assignments independently and at your own pace. Who You Are Comfortable navigating the web and using search engines as part of everyday life. Able to assess content quality and relevance objectively and consistently. Naturally detail‑oriented with a systematic, methodical approach to tasks. Clear and concise written communicator in English. Self‑motivated and reliable when working independently. No prior AI, tech, or research experience required. Nice to Have Background in research, writing, editing, journalism, or critical analysis. Experience with quality assurance, information evaluation, or content review. Familiarity with AI tools, search platforms, or content rating systems as an end user. Broad general knowledge across a variety of subject areas. Why Join Us Work on cutting‑edge AI projects alongside leading research labs. Fully remote and flexible — work when and where it suits you. Freelance autonomy with the structure of meaningful, task‑based work. Make a direct, tangible impact on how AI finds and communicates information at scale. Potential for ongoing work and contract extension as new projects launch. #J-18808-Ljbffr Alignerr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Search Quality Evaluator in New York, NY vacancy
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data... 
    Quality
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    1 day ago
  •  ...your skills to the test! Welocalize is looking for English AI Search Evaluators to help improve the online search engine experience. In this...  ...of age. Note: Full name of the position is "Scout Search Quality Rater - English (United States)". #J-18808-Ljbffr Welo Data
    Quality
    Part time
    Currently hiring
    Immediate start
    Remote work
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Quality
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    New York, NY
    1 day ago
  • $11.5 per hour

     ...offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English and residency in the U.S. for the... 
    Quality
    Hourly pay
    Part time
    Remote work

    University of Delaware

    New York, NY
    4 days ago
  • $30 - $45 per hour

    Web Browsing Evaluator remote $30 - $45/hour pay Required Skills Attention to Detail...  ...Browsing Evaluators to contribute high-quality web interaction data for a valued customer...  ...activities, including clicking, typing, and searching. Provide clear written documentation... 
    Quality
    Remote job
    For contractors

    ESRhealthcare and EXEC STAFF RECRUITERS

    New York, NY
    2 days ago
  • $19 per hour

     ...high-fidelity simulated environments to evaluate and train AI models on real-world procurement...  ...distribution, packaging, receiving, and quality assurance tasks within the Mobile...  ...Garland Irving Plano The 10 most popular job searches in Lewisville, TX are: amazon work from... 
    Quality
    Hourly pay
    Permanent employment
    Full time
    Temporary work
    Casual work
    Seasonal work
    Work at office
    Remote work
    Work from home
    Monday to Friday

    Impact Valuation Group LLC

    New York, NY
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Quality
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    2 days ago
  • $20 per hour

    A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position... 
    Quality
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  •  ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have...  ...evaluating outputs for accuracy and relevance, and maintaining high-quality evaluations. This remote role offers competitive compensation... 
    Quality
    Local area
    Remote work

    BluePrint Technologies

    New York, NY
    4 days ago
  •  ...DataAnnotation is seeking independent contractors to help train AI chatbots, developing prompts and evaluating model outputs. This role allows for flexible hours between 5-40 per week, ideally suited for detail-oriented professionals experienced in business communications... 
    Quality
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $40 per hour

     ...related problems. As part of this flexible remote role, you will evaluate the performance and correctness of AI outputs while ensuring...  ...English. This is an independent contract position with hourly pay starting at $40, plus bonuses for high-quality work. #J-18808-Ljbffr
    Quality
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • A leading AI evaluation firm is seeking medical experts to train AI models and evaluate their performance. This remote role allows you...  ...compensation starting at $30 with potential bonuses for high-quality work. Ideal candidates will have a medical background, fluency... 
    Quality
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    1 day ago
  • $20 - $30 per hour

     ...focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI...  ..., and providing actionable feedback to enhance product quality. Ideal candidates will have strong analytical skills, attention... 
    Quality
    Remote job
    Hourly pay

    Crossing Hurdles

    New York, NY
    4 days ago
  • $150 per hour

    The Home and Community-Based Program evaluates preschoolers for special education for the Committee on Special Education (CPSE).Education...  ...Street is a leader in education, a pioneer in improving the quality of classroom practice, and a national advocate for children and... 
    Quality
    Part time
    Work from home
    Shift work

    Bank Street

    New York, NY
    2 days ago
  • $50 per hour

    A leading AI healthcare firm is seeking a Diagnostic Imaging Coordinator to enhance AI models by evaluating chatbot outputs and providing complex healthcare-related problems. The position offers flexibility with remote work options and competitive hourly pay starting at... 
    Quality
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...elite creative and technical talent with leading AI research labs. They are seeking a Market research / competitive intelligence Evaluator. This remote position offers a chance to evaluate AI-generated content and provide structured feedback while leveraging deep expertise... 
    Quality
    Remote job
    Work at office
    Flexible hours

    Mercor

    New York, NY
    22 hours ago
  • $30 per hour

     ...$20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems using defined rubrics and quality standards. Review multi-step agent workflows, including screenshots and reasoning... 
    Quality
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    4 days ago
  • DataAnnotation is seeking a Customer Service Representative to help train AI models by evaluating their progress and improving their quality. In this flexible role, you can choose projects and work from home. The ideal candidate should be fluent in English, detail-oriented... 
    Quality
    Remote job
    Hourly pay
    Contract work
    Work from home
    Flexible hours

    DataAnnotation

    New York, NY
    22 hours ago
  •  ...re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance...  ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in... 
    Quality
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    BAM Ventures

    New York, NY
    2 days ago
  •  ...fueled by our partnership with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA) Job Type: Contract...  ...the question posed in the user prompt. The goal is to assess quality, safety, and utility—particularly in literature summarization,... 
    Quality
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    4 days ago
  •  ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance...  ...context Ability to distinguish subtle differences in tone, quality, and correctness High attention to detail and consistency in... 
    Quality
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    BAM Ventures

    New York, NY
    2 days ago
  • $25 per hour

     ...company is seeking a Language Specialist to improve AI chatbots by evaluating their progress and teaching them conversational skills in...  ...Bachelor's degree. Payment is competitive, starting at $25+ USD per hour, reflecting the quality and volume of work. #J-18808-Ljbffr
    Quality
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    2 days ago
  • $80 - $120 per hour

     ...Mercor is seeking a Nonprofit / philanthropy / community programs Evaluator to work remotely. The role involves evaluating AI-generated artifacts, providing structured feedback, and ensuring quality in documents, spreadsheets, and presentations. The ideal candidate should... 
    Quality
    Hourly pay
    Contract work
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    2 days ago
  •  ...YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will apply your domain expertise to train next-generation...  ..., shaping how models learn, reason, and perform through high-quality real-world input. Responsibilities include scoring AI outputs,... 
    Quality
    Contract work
    Remote work

    YO IT Consulting

    New York, NY
    2 days ago
  • $20 per hour

     ...company is looking for detail-oriented individuals to train AI chatbots. Responsibilities include creating prompts, writing quality responses, and evaluating AI model outputs. Candidates must be fluent in English and possess excellent writing and research skills, along with... 
    Quality
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time position requires native-level language proficiency and a university degree. You will contribute to improving evaluation frameworks while... 
    Quality
    Full time
    Remote work

    Welocalize

    New York, NY
    1 day ago
  • $20 per hour

     ...contractors to teach AI chatbots using their language skills. This role involves creating diverse conversations, writing high-quality responses, and evaluating model performance. Ideal candidates will have excellent writing and research skills, strong attention to detail, and... 
    Quality
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    New York, NY
    1 day ago
  • $20 per hour

     ...Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity... 
    Quality
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    2 days ago
  •  ...with hourly pay starting at $40 and additional bonuses for high-quality work. Applicants need to have a current or in-progress medical...  ...include providing AI chatbots with complex problems, evaluating AI outputs, and ensuring medical accuracy in model performance... 
    Quality
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $135 - $190 per hour

     ...Speech Language Pathologist Evaluator - Queens NY- Achieve Beyond Description: Apply to Achieve Beyond as a Speech Language Pathologist...  ...and support, to ensure our services are of the highest quality and adhere to our strong ethical standards. We currently offer... 
    Quality
    Local area
    Flexible hours

    Achieve Beyond Pediatric Therapy & Autism Services

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Search Quality Evaluator. Be the first to apply!