Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Specialist

Crossing Hurdles

A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities include ensuring clarity and empathy in evaluations, identifying weaknesses in AI reasoning, and contributing to a safe AI environment. Immediate availability post-onboarding is required for this role. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist in New York, NY vacancy
  • $20 per hour

     ...is seeking analytical, detail-oriented individuals to join their remote team. The role involves developing prompts to train AI chatbots, evaluating AI model outputs, and writing high-quality responses. Ideal candidates will have excellent writing and research skills,... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...A tech company specializing in AI projects is seeking skilled LibreSprite users to assist in evaluating AI-generated visual content. As an independent contractor, you can work flexibly from anywhere, contributing around 5–20 hours per week depending on project needs.... 
    Suggested
    For contractors
    Remote work

    Handshake

    New York, NY
    1 day ago
  • $25 - $30 per hour

     ...DataAnnotation is seeking analytical and detail-oriented individuals to help train AI chatbots. In this role, you will develop and evaluate complex prompts while working on your schedule from home. Ideal candidates should have excellent writing and research skills. This... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    Work from home

    DataAnnotation

    New York, NY
    4 days ago
  •  ...Mercor is seeking a User/customer research and feedback synthesis Evaluator to evaluate AI-generated artifacts and provide structured feedback. This remote contract position requires 5+ years of experience and proficiency in Microsoft Office and Google Workspace. Key... 
    Suggested
    Contract work
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    12 hours ago
  • $50 - $60 per hour

     ...DataAnnotation is seeking a Clinical Specialist to aid in training AI models by providing diverse healthcare problems and evaluating outputs. This independent contractor position allows you to work remotely, on your schedule, and offers hourly rates starting at $50-$60... 
    Suggested
    Hourly pay
    For contractors
    Remote work

    DataAnnotation

    New York, NY
    12 hours ago
  • Welo Data is hiring Data Labeling Associates in New York City for Project Perseus. The role involves evaluating Arabic language AI outputs and ensuring AI safety, requiring professional proficiency in Arabic and experience in writing and AI safety. You’ll critique models... 

    Welo Data

    New York, NY
    12 hours ago
  • $40 per hour

    A technology company specializing in AI training is looking for a Biology Expert based in the United States. This role involves training AI chatbots by providing complex biology questions and evaluating their maturity and performance. Candidates should have strong knowledge... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will apply your domain expertise to train next-generation AI systems, shaping how models learn, reason, and perform through high-quality real-world input. Responsibilities include scoring... 
    Remote job
    Contract work

    YO IT Consulting

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated analytics and solve complex problems. The role allows for remote work with a flexible schedule, offering up to $60 USD per hour. Candidates should have at least 2 years... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $161.6k - $200k

     ...deserve. To learn more, visit Hybrid 3 days (offices in NYC, Denver, CO and Charlotte, NC area) Position Summary As an AI Evaluation Engineer at Judi Health, you will build the testing frameworks, metrics, and tooling used to assess the safety, reliability, and... 
    Local area
    Flexible hours

    Capital Rx

    New York, NY
    6 days ago
  • $60 per hour

    A leading AI research firm is seeking experienced quantitative professionals to evaluate AI-generated analysis and solve technical problems. This fully remote position offers flexible scheduling and competitive pay of up to $60 per hour. Ideal candidates have 2+ years... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

    A leading AI training company in the United States is seeking a Software Engineer to evaluate and improve AI chatbots. The role offers flexibility to choose projects and work hours, as well as payment starting at $40 per hour. Candidates should be proficient in Python or... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    New York, NY
    2 days ago
  • $40 per hour

     ...We are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  • $60 per hour

    A leading AI development company is seeking quantitative professionals to evaluate AI-generated work and contribute to advancing AI systems. This remote role allows you to choose your projects and working hours, with competitive pay of up to $60 per hour. Ideal candidates... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    4 days ago
  • $150k - $250k

    Slingshot Aerospace is seeking a Senior AI Engineer to join our AI and Data Science team. This role involves developing evaluation frameworks for intelligent systems in mission-critical space operations. Responsibilities include maintaining our validation SDK, designing... 
    Remote job

    Slingshot Aerospace

    New York, NY
    2 days ago
  • $60 per hour

     ...experienced strategy consultants to build consulting domains for advanced AI systems. Candidates should have 3+ years from top-tier firms and...  ...on designing consulting tasks for AI agents and establishing evaluation standards, ensuring AI develops high-level business reasoning.... 
    Remote job
    Hourly pay

    Mindrift

    New York, NY
    3 days ago
  • $60 per hour

    A leading AI development company is seeking quantitative professionals to evaluate AI-generated outputs and solve complex problems. This fully remote role allows flexibility and offers competitive pay of up to $60 USD/hour. Ideal candidates should have at least 2 years... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago
  • $40 per hour

    A technology consulting company is seeking experienced cybersecurity professionals for a remote position. In this role, you'll evaluate AI-generated cybersecurity content, solve technical problems, and provide valuable feedback to enhance AI models. Ideal candidates should... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    2 days ago
  • A cybersecurity training company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and tackle technical cybersecurity challenges. Candidates should have at least 2 years of hands-on experience in cybersecurity, along with some... 
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated content and solve technical problems in cybersecurity. Candidates should have at least 2 years of relevant experience in areas such as penetration testing or incident response. This... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $40 per hour

    A cybersecurity firm in the United States seeks experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. In this remote role, you'll work on your own schedule, contributing to the next generation of AI security systems... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    2 days ago
  • $20 per hour

    A company focused on AI development is seeking analytical small business owners and freelancers to teach AI chatbots. Responsibilities include developing diverse prompts, writing answers, comparing AI models, and fact-checking responses. This role is remote and offers... 
    Remote job
    Hourly pay
    Freelance

    DataAnnotation

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development company is looking for quantitative professionals to evaluate AI-generated work and design quantitative problems to improve AI systems. The role offers fully remote work options and a flexible schedule. Candidates should have at least 2 years of... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $60 per hour

    A cutting-edge AI company is looking for experienced quantitative professionals to evaluate AI-generated analyses and solve complex problems. This fully remote role allows for flexible scheduling, with pay up to $60 per hour. Ideal candidates will have a background in... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • A cybersecurity solutions company is looking for experienced cybersecurity professionals to help train AI models. You will work remotely to evaluate AI-generated security content, solve technical problems, and provide feedback to improve AI systems. Ideal candidates have... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A healthcare technology company is seeking a Pyxis Technician to join their team to train AI models. The role involves evaluating AI outputs and ensuring medical accuracy. Candidates should possess a healthcare-related degree and be fluent in English. This is a remote independent... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A healthcare technology company based in the United States is seeking a HIM Analyst to train AI models. This role involves measuring the progress of AI chatbots and evaluating their logic to enhance quality. Ideal candidates should have strong healthcare expertise and... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  •  ...technology company is seeking a Pyxis Technician to join their team remotely. The role involves training AI models by providing healthcare-related problems and evaluating AI outputs for logic and accuracy. Ideal candidates should have healthcare expertise and be fluent in... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated cybersecurity content and solve technical security problems. You will play a significant role in training AI models, providing critical feedback, and improving system accuracy. This... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago
  • $40 per hour

    A leading data annotation company is seeking a Statistician for a remote role. You will train AI models by measuring progress and solving problems related to AI chatbots. Candidates should have proficiency in various mathematical fields and fluency in English. This position... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Specialist. Be the first to apply!