Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Evaluation Specialist - Precision Feedback

Synthires

New York, NY
  • Remote job

Synthires seeks analytical thinkers to contribute to advanced AI research and evaluation projects. In this role, you will evaluate AI-generated responses, assess quality and reasoning, and provide structured, detailed written feedback to improve next-generation AI systems. Requirements include a Bachelor's degree from a recognized university, native English fluency, strong written communication, ability to work independently in a remote environment, and strict adherence to evaluation guidelines. #J-18808-Ljbffr Synthires

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist - Precision Feedback in New York, NY vacancy
  • $70 per hour

     ...technical talent with leading AI research labs....  ...$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses...  ...Provide structured written feedback to improve training data...  ...performance. Develop clear, precise, and well-evidenced written... 
    Remote work
    Contract work
    Summer work

    Mercor

    Philadelphia, PA
    a month ago
  •  ...Population Health Informaticist to join a remote, flexible hourly contract focused on training AI with public health data. You will evaluate AI-generated analyses for accuracy and...  ...identify gaps, and provide clear, actionable feedback to improve model performance. The role... 
    Remote work
    Hourly pay
    Contract work
    Flexible hours

    Alignerr Corp.

    Kansas City, MO
    1 day ago
  •  ...seeking a Personal Account Generalist Raters to review AI-generated prompts and responses in English, assess relevance...  ..., and helpfulness, and provide clear ratings and feedback. This contractor assignment is remote with a commitment of 20-40 hours per week. Candidates should... 
    Remote job
    For contractors

    Crossing Hurdles

    New York, NY
    20 hours ago
  • $15 per hour

    Outlier AI invites detail-oriented English speakers to join our remote evaluation platform. As an Outlier Expert, you will review AI-generated media, roleplay conversations with an AI voice model, and rate outputs for adherence to prompts. You set your own schedule, work... 
    Remote job
    Hourly pay
    Freelance

    Outlier Ai

    Tempe, AZ
    4 days ago
  •  ...Financial Services & Insurance AI Evaluation Engineer PRIMARY PURPOSE:...  ...their lifecycle. Fully remote role, open to U.S. based...  ...retrieval metrics (recall, precision, MRR/nDCG) and generation metrics...  ..., and production feedback loops. Familiarity with AI... 
    Remote work
    Full time
    Local area

    Sedgwick

    Remote
    9 days ago
  • $20 - $160 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...AI Conversation Quality Evaluation Type: Contract Compensation...  ...$20–$160/hour Location: Remote Role Responsibilities...  ...Experience in annotation, human-feedback, evaluation, or content review... 
    Remote work
    Contract work
    Summer work

    Mercor

    Abbeville, GA
    22 days ago
  • $80 - $150 per hour

     ...technical talent with leading AI research labs....  ...50/hour Location: Remote Role Responsibilities Design precise, task-specific grading criteria...  ...Incorporate structured feedback from senior reviewers...  ...experience with AI training , evaluation, or human-data projects.... 
    Remote work
    Contract work
    Summer work

    Mercor

    Boston, MA
    8 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...20/hour Location: Remote Role Responsibilities Design precise, task-specific grading criteria...  ...Incorporate structured feedback from senior reviewers...  ...experience with AI training , evaluation, or human-data projects.... 
    Remote work
    Contract work
    Summer work

    Mercor

    Dallas, TX
    5 days ago
  • $18 per hour

    We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content...  ...worker, or professional seeking flexible remote work? Are you interested in shaping...  ...quality Provide objective ratings and feedback according to project guidelines Complete... 
    Remote work
    Hourly pay
    Extra income
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    RWS

    Austin, TX
    11 hours ago
  •  ...English Speaking Generalist for remote contract work. You will craft prompts, run side-by-side evaluations using ChatGPT and Claude, and provide thorough verbal feedback in American English. The role emphasizes...  ...and collaboration with AI model improvement efforts. Ideal... 
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    1 day ago
  • Synthires is seeking strong analytical thinkers to evaluate AI-generated responses and provide detailed feedback to improve the performance of next-generation AI...  ...quality and reasoning and work independently in a remote setting. The role emphasizes clear, well-supported... 
    Remote job
    Flexible hours

    Synthires

    Austin, TX
    2 days ago
  • YO AI Labs is seeking an Evaluation Specialist and recent graduates for a remote contractor role focused on advancing AI. You will craft original, multi-step questions, verify...  .... Strong research, critical thinking, and precise English writing are essential. No prior AI... 
    Remote job
    For contractors

    Bazeta

    New York, NY
    1 day ago
  •  ...experienced Employment Law Specialist to contribute to a...  ...reliability of advanced AI systems. In this contractor...  ...law scenarios, evaluate AI-generated legal analyses...  ...provide structured expert feedback to improve AI-generated...  ...English LOCATION: Remote — United States only Key... 
    Remote work
    Full time
    For contractors

    Gramian Consulting Group

    Remote
    19 days ago
  •  ...analytical thinkers to contribute to advanced AI research and evaluation projects. You will evaluate AI-...  ...provide structured, detailed written feedback to help improve next-generation AI...  ...the ability to work independently in a remote, project-based role. #J-18808-Ljbffr... 
    Remote job
    Flexible hours

    Synthires

    Sacramento, CA
    2 days ago
  •  ...Inc. is seeking a French Transcription Expert (France) for a remote evaluation track. The role involves reviewing french generalist...  ...against the company quality rubric and providing structured feedback for retraining. You will compare paired outputs, label edge... 
    Remote job

    AuraOne, Inc.

    New York, NY
    1 day ago
  • $30 per hour

    TAMIL AI EVALUATION SPECIALIST (SINGAPORE/MALAYSIA) Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours About Handshake AI Opportunity Overview Handshake...  ...and reasoning Provide clear written feedback that helps AI better understand and personalize... 
    Remote work
    Part time
    Flexible hours

    Handshake

    New York, NY
    1 day ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ reliability / SRE Evaluator Type: Contract Compensation...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...  ...clear, structured written feedback to improve AI-generated work products... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    24 days ago
  •  ...seeking fluent Danish speakers to act as evaluators for AI training. You will compare text and...  ...snippets, rate naturalness, and provide feedback on tone and cultural alignment. A quiet...  ...with pay per hour for completed tasks. Remote work flexibility is offered, with short... 
    Remote job
    Hourly pay

    Prolific Academic Ltd

    New York, NY
    1 day ago
  •  ...The Role We are seeking AI Data Trainer Experts with strong...  ...in smart farming and precision agriculture to support the development...  ...to annotate, review, and evaluate data related to agricultural technologies...  ..., IoT enabled farm equipment, remote sensing, soil and crop health... 
    Remote work
    Temporary work

    Cognito AI

    Remote
    28 days ago
  • $40 per hour

    DataAnnotation is seeking contributors to evaluate AI translations in Slovak, focusing on localization and cultural...  ...identify errors, and provide clear, training-quality feedback from a linguistic perspective. Remote, flexible work with project-based tasks. No degree required... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    11 hours ago
  • $200k - $260k

     ...association management industry. Our AI workforce platform integrates...  ...hiring a Senior AI Engineer, Evaluation & Optimization to own the systems, experiments, and feedback loops that determine how those...  ...~401K with Company Match. ~ Remote Flexible - come to the office when... 
    Remote work
    Temporary work
    Work at office
    Flexible hours

    Vantaca

    Palo Alto, CA
    1 day ago
  •  ...role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You...  ...interactions Provide structured, detailed feedback and data for model optimization...  ...do not apply Work environment is remote; no office required #J-18808-Ljbffr... 
    Remote work
    Hourly pay
    For contractors
    Freelance
    Work at office
    Worldwide

    remote work

    New York, NY
    1 day ago
  • $120 - $170 per hour

     ...technical talent with leading AI research labs....  ...70/hour Location: Remote Role Responsibilities Design precise, task-specific grading criteria...  ...Incorporate structured feedback from senior reviewers...  ...experience with AI training , evaluation, or human-data projects.... 
    Remote work
    Contract work
    Summer work

    Mercor

    Philadelphia, PA
    16 days ago
  • $15 - $35 per hour

     ...Sales and Business Development Expert for a remote contract role. The position offers 10-40...  ...of $15-$35 per hour. You will evaluate AI interview models by responding to scenario...  ...business development, and provide structured feedback on relevance and realism. You will... 
    Remote job
    Hourly pay
    Contract work
    10 hours per week

    Crossing Hurdles

    New York, NY
    1 day ago
  • Workada is hiring a remote contractor to help evaluate AI assistants on realistic marketing, content and design tasks. You will work with an AI on tasks...  ...projects and rate performance, providing structured feedback to improve accuracy and usefulness. This hourly, remote... 
    Remote job
    Hourly pay
    For contractors

    Workada

    Auburn, WA
    11 hours ago
  •  ...Evaluating enterprise AI tools and capabilities, the full-time AI Evaluation Specialist will assess effectiveness, safety, usability, and readiness for business adoption while working remotely. Key responsibilities Plan and execute hands-on evaluations of AI tools using... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    1 day ago
  • $80 - $150 per hour

     ...technical talent with leading AI research labs....  ...50/hour Location: Remote Role Responsibilities Design precise, task-specific grading criteria...  ...Incorporate structured feedback from senior reviewers...  ...and asynchronously to evaluate and improve AI model performance... 
    Remote work
    Contract work
    Summer work

    Mercor

    Pennsauken, NJ
    5 days ago
  • $102k - $120k

     ...Chenega Professional Services’ company, is looking for a AI Evaluation Specialist . The AI Evaluation Specialist will evaluate enterprise...  ...Teleworking Permitted? Yes Teleworking Details Remote - Continental US Estimated Salary/Wage USD $102,000.00/... 
    Remote work
    Full time
    Contract work
    Temporary work
    Flexible hours

    Chenega Services & Federal Solutions

    Remote
    8 days ago
  •  ...Position Title: Senior Computer Programmer – AI Evaluation SpecialistLocation: Remote (Continental U.S.)Company: JR Software Solutions Inc. (JRSS)Employment...  ...JRSS AI/ML Team is seeking an AI Evaluation Specialist to determine the effectiveness, safety, usability, and... 
    Remote work
    Permanent employment

    JRSS Corporation

    United, PA
    1 day ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ environmental science Evaluator Type: Contract Compensation...  ...$80–$120/hour Location: Remote Role Responsibilities...  ...Provide clear, structured written feedback to improve AI model outputs.... 
    Remote work
    Contract work
    Summer work
    Work at office
    Flexible hours

    Mercor

    Washington DC
    29 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluation Specialist - Precision Feedback. Be the first to apply!