Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Response Evaluator Entry Level

OpenTrain AI, Inc.

New York, NY
  • Remote job

OpenTrain AI, Inc. is seeking a remote contractor to evaluate language-model responses in social scenarios and provide structured feedback that helps improve AI behavior. The work involves careful review, evidence-based decisions, and consistent use of project guidelines. You will review source materials and model outputs, apply evaluation rubrics, document evidence, and explain decisions clearly in written feedback. #J-18808-Ljbffr OpenTrain AI, Inc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Response Evaluator Entry Level in New York, NY vacancy
  • $14.5 per hour

    Join to apply for the AI Web Search Evaluator role at Welo Data...  ...passion for quality. Key Responsibilities Analyze search...  .... Seeks a flexible, remote job that can easily fit...  ...Agreement and Service Level Agreement Benefits...  ...form Seniority level Entry level Employment type... 
    Remote work
    Entry level
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance...  ...search engines, making it suitable for entry-level applicants. The position offers a pay... 
    Remote job
    Entry level
    Hourly pay
    Part time
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $30 - $50 per hour

    A leading AI training company is seeking a Remote Annotator to support human-in-the-loop AI training workflows for large language models. This role involves reviewing labeled datasets, performing evaluations for helpfulness and safety, and ensuring quality in training data... 
    Remote job
    Entry level
    Hourly pay

    Rex.zone

    New York, NY
    2 days ago
  • $20 per hour

     ...Job Description Job Description We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects....  ...for work across AI model evaluations, computer-use tasks, response ranking, red teaming, tool-use evaluation, and other AI training... 
    Remote work
    Entry level
    Part time
    For contractors
    Work experience placement
    Flexible hours

    Draft labs

    Miami, FL
    1 day ago
  • The Work You will evaluate language-model responses in social scenarios and provide structured...  ...that can help improve AI system behavior. The work...  ...It Pays and Takes This is remote contractor work. The...  ...Fluency in English. Experience level: Entry level; prior AI training... 
    Remote work
    Entry level
    For contractors
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  •  ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial...  ...analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and relevance of quantitative... 
    Remote work
    Full time
    Contract work
    Flexible hours

    Virtual Vocations Inc

    United States
    5 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Dallas, TX
    a month ago
  •  ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AI Trainer Jobs

    New York, NY
    1 day ago
  • $20 per hour

    A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing prompts, writing high-quality responses, and evaluating AI outputs. The ideal candidates are... 
    Remote work
    Hourly pay
    Flexible hours

    SupportFinity

    United States
    1 day ago
  •  ...Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational...  ...least one year of experience in design-related fields. Responsibilities include evaluating AI-generated designs for usability and... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    4 days ago
  • $24 per hour

    Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language...  ...emotional and cultural nuances. Responsibilities include assessing audio clips,...  ...for tasks, with flexible hours and remote work options. #J-18808-Ljbffr
    Remote work
    Flexible hours

    Prolific

    New York, NY
    6 hours ago
  • RWS Group is seeking a Speech AI Evaluation Specialist to support the improvement of AI-generated...  ...freelance, part-time position offers remote work from home in the USA, with a...  ...conversations, follow prompts, evaluate responses for relevance, accuracy, clarity, and overall... 
    Remote job
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • $150 per hour

    The Work You will help improve AI systems by creating expert-level quantitative finance training data and reviewing...  ...Your feedback will focus on whether responses are accurate, relevant, and...  ...quantitative finance methods. The work is remote, flexible, and asynchronous. You... 
    Remote work
    Hourly pay
    Ongoing contract
    Contract work
    Part time
    Flexible hours

    OpenTrain AI, Inc.

    Eastern, KY
    1 day ago
  • $14.5 per hour

     ...scalable to supercharge their AI models. As a Welocalize brand...  ...and domain experts. Key Responsibilities Analyze search result performance...  ...insights on relevance and quality. Evaluate and rate the effectiveness of...  .... Seeks a flexible, remote job that can easily fit around... 
    Remote work
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Kanz.us

    Dallas, TX
    5 days ago
  • Archangel Health AI is seeking Clinical AI Evaluators to review AI-generated clinical outputs, benchmark diagnostic reasoning, and refine responses to real-world medical queries. You will perform clinical...  ...AI models. This is a flexible remote role with no patient care... 
    Remote work
    Flexible hours
    Shift work

    Modern MedEd LLC

    New York, NY
    3 days ago
  • RWS Group is seeking a detail-oriented evaluator to work with an AI assistant in Bengali. You will translate English prompts into Bengali to test the AI application and evaluate responses against project guidelines. You will assess linguistic accuracy, naturalness, localization... 
    Remote job
    Flexible hours

    RWS Group

    New York, NY
    4 days ago
  • RWS - TrainAI is seeking a Tamil-language AI Linguistic Evaluator for a remote freelance collaboration. The role involves interacting with an AI assistant...  ..., and assessing the quality and localization of AI responses to ensure accuracy and cultural relevance. Ideal... 
    Remote job
    Freelance
    Immediate start
    Flexible hours

    AI Trainer Jobs

    New York, NY
    20 hours ago
  • $10 - $18 per hour

    Rws is seeking AI Linguistic Evaluators to assess Marathi language performance for a short remote collaboration. This freelance role requires native Marathi, strong English...  ...is about 10-15 hours at 18 USD/hour. Responsibilities include interacting with an AI assistant,... 
    Remote job
    Freelance
    Immediate start

    Rws

    Dallas, TX
    4 days ago
  • RWS Group is seeking a Speech AI Evaluation Specialist to support AI content improvement in Vietnamese...  ...USA). This freelance, part-time role is remote from the USA, with a flexible schedule and immediate start. You will rate AI responses for relevance, accuracy, and clarity,... 
    Remote job
    Part time
    Freelance
    Immediate start
    Flexible hours

    RWS Group

    New York, NY
    3 days ago
  • Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise...  ...Office and Google Workspace. Responsibilities include evaluating documents and... 
    Remote job
    Work at office

    Mercor

    New York, NY
    4 days ago
  • Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain...  ...and Google Slides, and fluency in English. Responsibilities include evaluating AI outputs and... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    2 days ago
  • $30 per hour

     ...Hourly contract Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous...  ...Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    2 days ago
  • Obsidian is looking for expert Evaluators to review AI-generated work products in Public-sector procurement and RFI response. In this remote hourly role, you will assess the accuracy and quality of documents, spreadsheets, and slide decks, applying your deep subject-matter... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    New York, NY
    4 days ago
  • $18 per hour

    Freelance, remote from the United States Flexible schedule, approximately...  ...You’ll Do: Interact with an AI assistant in Telugu Translate prompts from English and evaluate AI responses Assess linguistic accuracy...  ...Qualifications: Native-level fluency in Telugu and strong... 
    Remote job
    Hourly pay
    Temporary work
    Freelance
    Flexible hours

    RWS

    New York, NY
    1 day ago
  • Mercor, a San Francisco-based firm connecting elite talent with leading AI labs, offers a remote contract role focused on compliance/regulatory response in financial-services AI. You will evaluate AI artifacts and provide structured feedback to improve model outputs. Ideal... 
    Remote job
    Contract work

    mercor

    New York, NY
    3 days ago
  • RWS is seeking AI Linguistic Evaluators to assess Tamil-language outputs for a short-term collaboration. This remote role is open to applicants in the United States, with a flexible...  ...English, and evaluate AI-generated responses for linguistic accuracy, naturalness, and... 
    Remote job
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    Edison, NJ
    2 days ago
  • $18 per hour

    Rws is seeking AI Linguistic Evaluators to assess Malayalam content quality for a short remote collaboration. This freelance role requires native Malayalam and strong English...  ...English into Malayalam, and evaluating AI responses against project guidelines. Immediate start,... 
    Remote job
    Freelance
    Immediate start
    Flexible hours

    Rws

    Dallas, TX
    4 days ago
  • RWS - TrainAI is seeking AI Linguistic Evaluators to assess how an AI application performs in Marathi...  ...collaboration. This freelance role offers remote work from the United States with...  ...project involves evaluating prompts and responses for linguistic accuracy and cultural relevance... 
    Remote job
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    AI Trainer Jobs

    New York, NY
    20 hours ago
  • $50 - $150 per hour

     ...Canada + 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative reasoning. This is remote, flexible contract work where...  ...potential to extend. Key Responsibilities You may contribute your... 
    Remote job
    Contract work
    Temporary work
    Flexible hours

    Brain Trust Inc

    New York, NY
    4 days ago
  • RWS is seeking native Telugu speakers to remotely evaluate an AI application. This freelance, short-term project focuses on Telugu linguistic...  ...translate prompts from English into Telugu, and assess AI responses against guidelines. You’ll provide structured feedback to help... 
    Remote job
    Temporary work
    Freelance
    Immediate start
    Flexible hours

    RWS

    Austin, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Response Evaluator Entry Level. Be the first to apply!