Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Spoken Instruction Evaluator: AI Model QA & Feedback

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a remote Spoken Instruction Conversation Evaluator to review prompts and responses against its quality rubric. You will compare outputs, label edge cases, and provide structured feedback for retraining the model. As an independent contractor, you will evaluate model outputs, annotate according to rubric, tag severities, and calibrate judgments across long batches with attention to detail and clear reasoning. Remote US-eligible, hourly contract. #J-18808-Ljbffr AuraOne

Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Remote Spoken Instruction Evaluator: AI Model QA & Feedback in New York, NY vacancy
  • Preference Dataset QA Reward Model Evaluator is a remote evaluation track for reviewing preference...  ...the kind of structured feedback the modeling team can use...  .... Why this role matters AI data reviewers help turn...  .... Label hallucinations, instruction-following failures, and unsafe... 
    Remote work
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis and provide impactful feedback. This fully remote role allows for flexible scheduling and competitive pay starting at $40 per hour. Candidates... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Honolulu, HI
    3 days ago
  • $40 per hour

    A leading AI development company is seeking experienced quantitative professionals to work remotely. In this role, you'll evaluate AI-generated quantitative work and solve technical problems while providing feedback to shape AI systems. Qualifications include 2+ years in... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Salt Lake City, UT
    2 days ago
  • $40 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and provide critical feedback. This role offers the flexibility of remote work, allowing you to set your own schedule while focusing on impactful... 
    Remote work
    Hourly pay

    DataAnnotation

    Wisconsin
    2 days ago
  • $60 per hour

     ...developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your...  ...advance AI development. AI models are increasingly...  ...AI models on tasks like evaluating AI-generated quantitative...  ...problems, and providing feedback that directly shapes how... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Kansas City, MO
    2 days ago
  • $40 per hour

     ...A leading AI company in the United States is seeking experienced quantitative professionals to evaluate and validate AI-generated analytical work. This fully remote position allows you to set your own schedule...  ..., and providing critical feedback. Ideal candidates will... 
    Remote work
    Hourly pay

    DataAnnotation

    Jackson, MS
    2 days ago
  • $40 per hour

     ...A tech-focused company is seeking experienced quantitative professionals to evaluate AI-generated analysis and provide technical feedback. This remote role allows you to choose your schedule and work from various countries including the US. Ideal candidates will have... 
    Remote work
    Hourly pay

    DataAnnotation

    Providence, RI
    5 days ago
  • AuraOne is seeking a remote Preference Dataset QA Reward Model Evaluator to assess model outputs against a versioned rubric and provide structured feedback. You will compare paired responses, label issues, and document edge cases for retraining the model. As an independent... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    1 day ago
  • $60 per hour

     ...seeking experienced quantitative professionals to join their remote team. In this role, you'll evaluate AI-generated quantitative analysis, design problem-solving tasks for AI training, and provide insightful feedback on AI systems. Candidates must have hands-on experience... 
    Remote work

    DataAnnotation

    Nevada, IA
    2 days ago
  • $60 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated analytical work and solve complex problems...  ...work closely with advanced AI models, providing crucial feedback and insights. This is a remote position, allowing flexibility... 
    Remote work

    DataAnnotation

    Kansas City, MO
    3 days ago
  • $60 per hour

     ...A tech company focused on AI is seeking quantitative professionals to evaluate AI-generated analytical work and help...  ...statistical analysis, predictive modeling, and providing feedback to shape AI systems. The role offers flexible remote work opportunities and competitive... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Helena, MT
    3 days ago
  • $60 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to AI systems. This fully remote role offers flexibility in your schedule...  ...training and providing critical feedback on AI outputs. The... 
    Remote work
    Hourly pay

    DataAnnotation

    Iowa, LA
    2 days ago
  • $40 per hour

     ...professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content,...  ...problems, and provide feedback to improve how AI systems reason about...  ...This is a full-time or part-time REMOTE position You’ll be able to choose... 
    Remote work
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Jackson, MS
    2 days ago
  • $40 per hour

     ...A leading AI development firm is looking for experienced quantitative professionals to evaluate AI-generated work and design problems for AI training. This fully remote position allows for a flexible schedule, offering competitive pay starting at $40+ per hour. Ideal... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Bismarck, ND
    2 days ago
  • $40 per hour

    A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analyses and design quantitative problems for AI training. This fully remote role offers flexibility in project selection and scheduling, with competitive pay starting... 
    Remote work
    Hourly pay

    DataAnnotation

    Juneau, AK
    2 days ago
  • $40 per hour

     ...A forward-thinking AI solutions company is seeking experienced...  ...quantitative professionals to evaluate AI-generated analyses and contribute...  ...-edge AI systems. This fully remote role offers flexible...  ...the future of AI analytics and model reasoning. #J-18808-Ljbffr... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Lincoln, NE
    2 days ago
  • $40 per hour

    A forward-thinking AI development firm seeks experienced quantitative professionals to evaluate AI-generated work, applying their skills in statistical analysis, predictive modeling, and technical writing. This fully remote opportunity offers a flexible schedule and projects... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    2 days ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to join their team remotely. The role involves evaluating AI-generated quantitative work, providing insights, and shaping the future of AI systems. Candidates should have over two years of... 
    Remote work
    Hourly pay

    DataAnnotation

    Indiana, PA
    2 days ago
  • $40 per hour

     ...A forward-thinking analytics company is seeking quantitative professionals to evaluate AI-generated work, ensuring accuracy in statistical analysis and predictive modeling. This fully remote role offers a flexible schedule and competitive pay starting at $40 per hour.... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    2 days ago
  • AuraOne seeks a Language & AI Voice Evaluator for a remote contractor role to review language AI voice evaluation prompts and responses against AuraOne...  ...paired outputs, label edge cases, and provide structured feedback for retraining. Responsibilities include evaluating... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    5 hours ago
  • $40 per hour

     ...A leading AI development firm is seeking experienced quantitative professionals to join their remote team. You will evaluate AI-generated quantitative analysis and solve complex problems to ensure technical accuracy. The ideal candidate should have at least 2 years of... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Denver, CO
    16 hours ago
  • $40 per hour

     ...A leading AI development company is seeking experienced quantitative professionals to evaluate and validate AI systems. The role is fully remote, offering flexibility in project selection and competitive...  ...work and designing problems for model training, contributing to... 
    Remote work
    Hourly pay

    DataAnnotation

    Columbia, SC
    2 days ago
  • AuraOne is seeking a remote Classroom Scenario AI Evaluator to review prompts and responses against our quality rubric. You will compare paired...  ...outputs, label edge cases, and provide structured feedback to retrain the model. This contractor role requires prior evaluation... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    5 hours ago
  • $20 per hour

     ...looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user...  ...AI‑generated visuals and providing feedback to improve users' experience with AI tools. Working remotely, you'll assess how AI understands design principles... 
    Remote job

    Feedinkoo

    New York, NY
    1 day ago
  • $40 per hour

    An AI training company in the United States is looking for a Statistician to help improve AI models. You will evaluate the mathematics logic behind chatbots and assess their performance. Candidates...  ...United States will be considered for this remote contract role. #J-18808-Ljbffr
    Remote work
    Hourly pay
    Contract work

    DataAnnotation

    Honolulu, HI
    3 days ago
  • $40 per hour

    A leading data annotation company is seeking a Statistician to join their team. This remote role involves training AI models by posing complex mathematical problems, evaluating outputs, and assessing the model's performance. Candidates must be detail-oriented and proficient... 
    Remote work
    Hourly pay

    DataAnnotation

    New York, NY
    2 days ago
  • $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure...  .... Provide structured written feedback to improve AI model outputs . Identify nuances,... 
    Remote work
    Contract work
    Summer work

    Mercor

    Boston, MA
    more than 2 months ago
  • Productive Playhouse seeks AI Evaluators to support evaluating AI chatbots by interacting with models, assessing capabilities, safety, and usefulness. This is a project...  ...outside the United States, candidates work remotely, provide deliverables like write-ups, ratings,... 
    Remote job
    Freelance
    Flexible hours

    Triwill Group

    New York, NY
    1 day ago
  • $40 - $55 per hour

     ...used to train and evaluate next-generation AI systems. Your...  ...simulations that teach models how to reason...  ...detailed feedback and concrete examples...  ...documentation, instructional materials, and case...  ...in a remote setting while collaborating...  ...in written and spoken English and... 
    Remote work
    Hourly pay
    For contractors

    SaidGig

    United States
    a month ago
  • $40 per hour

    A leading AI training company is seeking a Postdoctoral Physics Associate to evaluate AI chatbot outputs and enhance model quality. This remote position requires an expert level of understanding in physics concepts, along with a PhD. Candidates will assess the performance... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Lansing, MI
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Spoken Instruction Evaluator: AI Model QA & Feedback. Be the first to apply!