Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Product Evaluator: Training & QA Specialist

Zekai

New York, NY
  • Remote job

Zekai is seeking an AI Product Evaluator for a 100% remote contractor role across global teams. You will apply expertise to train next-generation AI systems by evaluating models and agents against predefined scenarios. You will document findings, reset usage limits, and contribute to datasets on training platforms, ensuring high accuracy, repeatability, and strict adherence to project milestones. #J-18808-Ljbffr Zekai

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Product Evaluator: Training & QA Specialist in New York, NY vacancy
  • $30 per hour

    A leading AI innovation firm is seeking a Freelance Physics QA Reviewer to enhance Generative AI models. You will create and refine content, assess expert qualifications...  .... This part-time role allows for flexible hours and remote work, offering rates up to $30/hour depending on... 
    Remote work
    Part time
    Freelance
    Flexible hours

    Mind Rift

    Italian Republic
    5 days ago
  • A growing AI Data Services company is seeking a detail-oriented professional to review...  .... This role involves creating prompts, evaluating AI responses, and ensuring model reliability...  ...improving AI models with flexible, fully remote work hours. #J-18808-Ljbffr SME Careers
    Remote job
    Flexible hours

    SME Careers

    Boston, MA
    2 days ago
  • A tech consulting firm is seeking a Freelance Physics QA (with Python) to contribute to advanced AI projects. Candidates should hold an advanced degree in...  ...ensuring quality of work. This is a part-time, fully remote position with competitive pay rates, allowing you to manage... 
    Remote job
    Part time
    Freelance

    Mindrift

    New York, NY
    1 hour ago
  • Zekai is seeking a Hindi bilingual expert for a 100% remote contractor role. You will review Hindi audio content, judge nativeness...  ...and provide precise linguistic feedback in English to inform AI model training. No AI domain experience required beyond your linguistic... 
    Remote job
    For contractors

    confidential

    New York, NY
    3 days ago
  • Role Title: AI Product Evaluator Role Type: Contractor Location:...  ...Japan or United Kingdom, Remote Our team is engaging...  ...your expertise to help train next-generation AI...  ...contributions of multiple specialists, each bringing a...  ...digital product, software QA, or AI research projects... 
    Remote work
    For contractors

    Remotebridge

    New York, NY
    1 day ago
  • AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    3 days ago
  •  ...Practitioner or Physician Assistant for a remote, full-time role in the United States. You will test the product by following predefined clinical tasks, evaluate usability, and provide feedback...  ...work with flexible pay through Turing. #J-18808-Ljbffr AI Work Expert
    Remote job
    Full time
    For contractors
    Flexible hours

    AI Work Expert

    New York, NY
    1 hour ago
  • $30 - $50 per hour

     ...A tech company specializing in AI solutions is searching for a remote, full-time candidate to support AI/ML training workflows. In this role, you will perform high-accuracy data labeling, execute RLHF evaluation, and ensure training data quality. Candidates should have... 
    Remote work
    Hourly pay
    Full time

    Rex USA

    New York, NY
    1 day ago
  • Remotebridge is seeking an AI Product Evaluator for remote, contract work across international teams. You...  ...help ensure high-quality inputs for training. The role emphasizes attention to detail...  ...within strict timeframes. Prior QA or AI research experience is a plus.... 
    Remote job
    Contract work

    Remotebridge

    New York, NY
    4 days ago
  •  ...1336Reference26-21577Remote50% Remote Remote with occassional onsite...  ...seeking an experienced Senior QA Engineer to lead quality assurance...  ...efforts for our conversational AI applications. This role...  ...ensuring our conversational AI products meet the highest standards of reliability... 
    Remote work
    Contract work
    Work experience placement

    Mindlance

    Jacksonville, FL
    11 hours ago
  • Hidden Jobs is seeking a meticulous Hungarian language QA specialist for a fully remote AI transcription project focused on improving speech recognition...  ..., and requires independent work with clear guidelines. Training and comprehensive guidelines are provided before the... 
    Remote job

    Tsmg

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking a QA Specialist - AI Product Testing & Support to remotely evaluate AI outputs across operations workflows. Reviewers assess tone, policy adherence, and stakeholder fit. You will flag risks, document next steps for the modeling team, and adjudicate... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    1 day ago
  • AuraOne, Inc. seeks an AI Facial Data Collection Contributor referrals specialist operations contractor to join a remote workflow evaluation track. You will review outputs, grade policy adherence...  ...so the modeling team can improve training data. Remote-US eligible;... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    2 days ago
  • Get notified about new Mathematics Department Chair jobs in United States . 1,000+ Mathematics Department Chair Jobs in United States Assistant/Associate/Professor of Mathematics (i... Tenured: Professor and Arthur George and Mary Emolene Owen Chair of Mathematics Open ...
    Remote job

    Crossing Hurdles

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a remote VA Eligibility Specialist to review AI outputs across VA eligibility operations workflows. You will assess workflow correctness...  ...the right next steps so the modeling team can train on them. In this contractor role you will grade tone,... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    4 days ago
  •  ...bilingual experts to contribute to language and AI training projects. In this contract role, you will listen to audio, evaluate nativeness and fluency, and provide concise...  ...in linguistics or audio analysis is valued. Remote work with flexible deadlines and strict quality... 
    Remote job
    Contract work
    Flexible hours

    micro1

    New York, NY
    2 days ago
  • Zekai is seeking a Visual Content Evaluator for a 100% remote contractor role. You will assess AI-generated images against originals, report subtle discrepancies, and document artifacts with precise notes that guide model improvement. Strong English writing and keen visual... 
    Remote job
    For contractors
    Worldwide

    Confidential

    New York, NY
    3 days ago
  •  ...travel, finance, and tech support. The work emphasizes practical dialogue, cultural nuance, and authentic problem-solving. You will evaluate AI audio responses using structured criteria for accuracy, naturalness, and task completion, and you will build high-quality audio... 
    Remote job

    Jobgether

    New York, NY
    2 days ago
  • SME Careers is seeking a remote hourly contractor to review and generate language content for AI training. You will craft prompts, assess model...  .... Responsibilities include evaluating AI responses for accuracy,...  ...bias, and clarity, and applying QA workflows to ensure... 
    Remote job
    Hourly pay
    For contractors

    SuperAnnotate AI, Inc.

    New York, NY
    1 day ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to train and evaluate AI models. Candidates should have a degree in HCI or related fields and experience...  ...Competitive pay up to $50 per hour, with flexible hours and remote work options are offered. #J-18808-Ljbffr Prolific
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    Nashville, TN
    1 day ago
  • Crewlia is seeking a Data Verification Specialist for a remote hourly contract in the United States and Canada. You will assess AI-generated data for accuracy, completeness, and alignment with guidelines, and provide concise justifications for each review. Ideal candidates... 
    Remote job
    Hourly pay
    Contract work

    Crewlia

    New York, NY
    3 days ago
  • SuperAnnotate AI, Inc is seeking an expert Japanese localization evaluator for an hourly, fully remote contractor role. You review AI-generated responses and craft high-quality explanations, ensuring accuracy, clarity, and correct tone across use cases. Requirements include... 
    Remote job
    Hourly pay
    For contractors

    Braintrust

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking an Architecture Expert to remotely review AI outputs across architecture operations workflows. You will grade tone, escalation logic,...  ...role requires direct experience in architecture specialist operations on real teams, clear written reasoning... 
    Remote job
    10 hours per week

    Auraone

    New York, NY
    1 day ago
  • $85 per hour

    AI Trainer Jobs seeks an Office and Administrative Domains specialist for a remote review track evaluating AI outputs across office workflows. Reviewers grade workflow correctness, policy...  ...next step so the modeling team can train on it. Role is contractor, hourly rate... 
    Remote job
    Hourly pay
    For contractors
    Work at office
    10 hours per week
    Flexible hours

    AuraOne

    New York, NY
    2 days ago
  • $55 per hour

     ...Expert for a Quality Assurance role. Responsibilities include evaluating AI-generated content and ensuring quality across complex topics....  ...professional experience, and be proficient in English. This fully remote position offers competitive hourly rates up to $55 depending... 
    Remote job
    Hourly pay
    Freelance

    Mindrift

    Jackson, MS
    1 day ago
  • $30 per hour

     ...seeks Spanish LATAM language experts for a remote, freelance evaluation project. You will identify real-world search-related failures where AI responses are inadequate, run test...  ...and locale knowledge, with experience in QA or compliance. #J-18808-Ljbffr Welocalize... 
    Remote job
    Hourly pay
    Freelance
    Immediate start

    Welocalize, Inc.

    New York, NY
    2 days ago
  • Handshake AI Fellowship is seeking registered cardiac sonographers to support AI research on a flexible, remote basis. You will apply your echocardiography expertise to assess AI-generated content, provide structured feedback, and help AI models reason like expert sonographers... 
    Remote job
    Flexible hours

    Handshake AI Fellowship

    New York, NY
    3 days ago
  •  ...AI Training Specialist (Data Annotation) As an AI Training Specialist (Data Annotation), you'll play a key role in helping train and improve...  ...instructions to ensure high-quality results Meeting productivity and accuracy goals within project timelines Maintaining... 
    Remote work

    Remote Talent Cloud

    United States
    2 days ago
  • AuraOne, Inc. seeks a Data Provenance Data Specialist contractor to review AI outputs and ensure compliance with data provenance workflows, policies, and escalation rules. You will evaluate tone, eligibility, and stakeholder fit against structured rubrics. You’ll flag... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    1 day ago
  • Prolific in Fort Worth, Texas, is seeking Customer Support Representatives for AI training. You will evaluate AI-generated responses, simulate customer interactions, and refine knowledge bases, contributing to next-generation AI models. Proficient experience in customer... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Fort Worth, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Product Evaluator: Training & QA Specialist. Be the first to apply!