Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Specialist

Crossing Hurdles

A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities include ensuring clarity and empathy in evaluations, identifying weaknesses in AI reasoning, and contributing to a safe AI environment. Immediate availability post-onboarding is required for this role. #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist in New York, NY vacancy
  • $20 per hour

     ...is seeking analytical, detail-oriented individuals to join their remote team. The role involves developing prompts to train AI chatbots, evaluating AI model outputs, and writing high-quality responses. Ideal candidates will have excellent writing and research skills,... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...A tech company specializing in AI projects is seeking skilled LibreSprite users to assist in evaluating AI-generated visual content. As an independent contractor, you can work flexibly from anywhere, contributing around 5–20 hours per week depending on project needs.... 
    Suggested
    For contractors
    Remote work

    Handshake

    New York, NY
    4 days ago
  • $60 per hour

    A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analysis and shape future systems. Enjoy flexible remote work with competitive pay, up to $60/hour. The role requires a background in data science or adjacent fields... 
    Suggested
    Remote job
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $60 per hour

    A quantitative analysis company is looking for experienced professionals to evaluate AI-generated work and solve quantitiative problems. This fully remote position allows you to choose your projects and work schedule, with hourly pay reaching up to $60. If you have 2+ years... 
    Suggested
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development firm is looking for experienced quantitative professionals to evaluate AI-generated analysis and provide feedback for improvement. You will work fully remotely with flexible schedules, earning up to $60 USD/hour for your work. Candidates should... 
    Suggested
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $20 per hour

    A leading AI training company is looking for an Event Planner to evaluate and improve AI chatbot models. This role requires expert writing and editing skills, attention to detail, and is open to applicants across the United States. Projects are paid hourly starting at $... 
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $25 - $30 per hour

    DataAnnotation is seeking analytical and detail-oriented individuals to help train AI chatbots. In this role, you will develop and evaluate complex prompts while working on your schedule from home. Ideal candidates should have excellent writing and research skills. This... 
    Remote job
    Hourly pay
    For contractors
    Work from home

    DataAnnotation

    New York, NY
    5 days ago
  • $18 - $50 per hour

    TELUS Digital is looking for a Math & AI Evaluation Expert to ensure the quality and accuracy of AI-generated mathematical outputs. You will analyze and verify solutions while providing constructive feedback. This flexible role suits candidates with backgrounds in mathematics... 
    Remote job
    Hourly pay
    Flexible hours

    Jazmin Par

    New York, NY
    3 days ago
  • DataAnnotation is seeking a Freelance Writer to assist in training AI models. This role involves evaluating chatbots and improving their quality through writing and editing. You can choose your projects and work on your schedule from home. The ideal candidate will excel... 
    Remote job
    Freelance
    Work from home

    DataAnnotation

    New York, NY
    5 days ago
  • $50 - $60 per hour

     ...DataAnnotation is committed to creating high-quality AI. We are looking for a Sales & Trading Associate to join our team to help train...  ...Give AI chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced by AI models for... 
    Hourly pay
    Full time
    Contract work
    Part time
    Work experience placement
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    3 days ago
  • A data analysis company in Canada is seeking an individual for a role focused on assessing AI-generated responses. Responsibilities include evaluating reasoning quality and factual accuracy across diverse topics, as well as providing structured feedback to improve AI models... 
    Full time
    Part time
    Flexible hours

    Crossing Hurdles

    New York, NY
    5 days ago
  • Role Overview Join to apply for the AI QA Trainer - LLM Evaluation role at Invisible Expert Marketplace. Large‑scale language models are evolving from clever chatbots into enterprise‑grade platforms, and we need your expertise to harden model reasoning and reliability.... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Invisible Expert Marketplace

    New York, NY
    5 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical issues. This role is fully remote, allowing you to manage your own schedule and choose projects. Candidates should have at least 2 years of experience... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    2 days ago
  • Mercor is seeking a User/customer research and feedback synthesis Evaluator to evaluate AI-generated artifacts and provide structured feedback. This remote contract position requires 5+ years of experience and proficiency in Microsoft Office and Google Workspace. Key responsibilities... 
    Remote job
    Contract work
    Work at office

    Mercor

    New York, NY
    1 day ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate and enhance AI-generated security content. Responsibilities include solving technical problems and providing valuable feedback to improve AI systems. Ideal candidates will have 2+ years of hands-on cybersecurity... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A leading tech platform is seeking experienced Krita users for flexible, project-based contract work. You'll evaluate AI-generated content and use your skills in digital painting and illustration to provide feedback that improves AI's understanding of visual tasks. Ideal... 
    Remote job
    Contract work
    Flexible hours

    Handshake

    New York, NY
    5 days ago
  • Welo Data is hiring Data Labeling Associates in New York City for Project Perseus. The role involves evaluating Arabic language AI outputs and ensuring AI safety, requiring professional proficiency in Arabic and experience in writing and AI safety. You’ll critique models... 

    Welo Data

    New York, NY
    3 days ago
  • A leading AI evaluation firm in the United Kingdom is seeking an AI QA Trainer to enhance the reliability of large-scale language models. This mid-senior level contractor role involves designing and executing test plans while ensuring factual accuracy in model assessments... 
    Remote job
    Hourly pay
    For contractors

    Invisible Expert Marketplace

    New York, NY
    5 days ago
  • A technology consulting firm in Canada seeks an AI QA Trainer for LLM Evaluation. This remote role involves evaluating large-scale language models through testing and improvement processes. The ideal candidate will have experience in QA for ML systems, strong programming... 
    Remote job
    Hourly pay

    Invisible Expert Marketplace

    New York, NY
    5 days ago
  • $60 per hour

    An innovative AI development company is looking for quantitative professionals to evaluate AI-generated analyses and solve complex problems. Successful candidates will have at least 2 years of quantitative experience in fields like data science or economics. This fully... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    2 days ago
  • $30 per hour

     ...A prominent AI data company is seeking Advanced Mandarin Speakers for evaluating AI models and completing training tasks. This remote role offers competitive pay of $30/hr for tasks requiring one hour of focused work. Candidates should be fluent in Mandarin with the ability... 
    Remote work
    Work from home
    Flexible hours

    Prolific - UK Job Board?

    New York, NY
    4 days ago
  • Synstack Technologies is looking for an AI Model Quality & Evaluation Specialist to join our remote team. This role focuses on enhancing AI model outputs across various STEM fields, ensuring accuracy, clarity, and effectiveness in educational contexts. The ideal candidate... 
    Remote job

    Synstack Technologies

    New York, NY
    3 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This remote position allows you to work on your own schedule and choose projects. Ideal candidates will have 2+ years of experience... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    5 days ago
  • $40 per hour

    A leading AI development company seeks experienced quantitative professionals to evaluate AI-generated work and contribute to model development. Enjoy fully remote work flexibility from anywhere in the US with a competitive pay starting at $40 per hour. Ideal candidates... 
    Remote job
    Hourly pay
    Full time

    DataAnnotation

    New York, NY
    2 days ago
  • $40 per hour

    A leading AI development company in the United States is seeking quantitative professionals to evaluate AI-generated analyses and contribute to cutting-edge AI projects. This fully remote role offers flexible scheduling with competitive pay starting at $40+ per hour, making... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $40 per hour

    A technology company specializing in AI training is looking for a Biology Expert based in the United States. This role involves training AI chatbots by providing complex biology questions and evaluating their maturity and performance. Candidates should have strong knowledge... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • A leading AI company is seeking experienced quantitative professionals to evaluate AI-generated work and design quantitative problems for training AI systems. This fully remote role offers competitive pay, flexible schedules, and opportunities to impact AI development.... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $20 per hour

    A technology company specializing in AI training is looking for individuals to teach AI chatbots. This role allows for remote work...  ...manage diverse conversations, write high-quality responses, and evaluate AI model performance. Strong English skills, excellent writing,... 
    Remote job
    Hourly pay
    Work experience placement
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • DataAnnotation is looking for a Clinical Specialist to help train AI models in the United States. The role involves evaluating AI outputs related to healthcare and ensuring their accuracy. Candidates must be fluent in English and hold a current or in-progress medical degree... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    5 days ago
  • $60 per hour

    A company specializing in AI systems is seeking experienced quantitative professionals to evaluate AI-generated work across various fields. In this role, you'll work remotely, enjoying the flexibility to set your schedule while solving complex quantitative problems. Candidates... 
    Remote job

    DataAnnotation

    Brooklyn, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Specialist. Be the first to apply!