Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Trainer/Data Annotator - Remote

YO IT Consulting

Job Summary
As a AI Evaluation Specialist, youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required - your domain knowledge is what matters.

Job Title:

AI Evaluation Specialist

Job Type:

Contractor

Location:

Remote

Key Responsibilities

Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.

Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.

Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.

Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.

Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.

Contribute to the continuous enhancement of evaluation workflows and best practices.

Support the development of training data that enhances AI system performance and reliability.

Required Skills And Qualifications

Exceptional reading comprehension and acute attention to detail.

Strong observational skills with excellent aesthetic or editorial judgment.

Ability to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.

Excellent written and verbal communication skills.

Comfort working across various content types and evaluation guidelines.

Strong sense of ownership, reliability, and commitment to delivering high-quality work for the customer’s team.

Open-minded approach to learning and quickly adapting to new workflows.

Preferred Qualifications

Background in design, UX/UI, creative direction, editing, or content strategy.

Experience reviewing creative, visual, or AI-generated content.

Familiarity with annotation, QA, moderation, or evaluation workflows, as well as working with AI tools or LLMs.

We’re seeking highly perceptive and detail-oriented trainers passionate about shaping the future of AI. Bring your refined judgment, critical thinking skills, and commitment to excellence to the customer’s team and make a meaningful impact on emerging AI technologies.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Ai Trainer/Data Annotator - Remote in New York, NY vacancy
  • $23 per hour

     ...individuals with Generative AI projects from leading...  ...of the world. As an annotator, you may be invited to...  ...Carefully review provided data (text, images, or...  ...required. On this project, AI trainers earn up to $23 per hour...  ...part in a part-time, remote, freelance project that... 
    Remote work
    Hourly pay
    Part time
    Freelance

    Toloka Annotators

    Dallas, TX
    1 day ago
  •  ...Mercor is seeking Legal Experts to join their remote team. The role involves reviewing and...  ...evaluate case outcomes, and contributing to AI systems development. Candidates must have...  ...legal experience. Prior experience in legal data annotation or AI projects is preferred.... 
    Remote work
    Part time

    Mercor Inc

    New York, NY
    4 days ago
  •  ...Voice Data Annotator (Tamil) Salary range: Rs 360000 - Rs 420000 (ie INR 3.6-4.2 LPA) Min Experience: 0 years Location...  ...) to support the development of enterprise-grade Voice AI systems. This is a fully remote role suited for individuals who are detail-oriented and... 
    Remote work
    Full time

    Weekday

    United States
    2 days ago
  •  ...Voice Data Annotator (Malayalam) This role is for one of the Weekday's clients Salary range: Rs 360000 - Rs 420000 (ie...  ...Malayalam) to support the development of advanced Voice AI systems. In this fully remote role, you will work on annotating and transcribing audio... 
    Remote work
    Full time
    Weekday work

    Weekday

    United States
    2 days ago
  •  ...Entry-Level Ai Data Annotator We're looking for a detail-oriented, motivated individual to join our team as an Entry-Level AI Data Annotator...  ...questions or reporting issues. Comfortable working in a remote or team-based setup with productivity tracking.... 
    Remote work
    Work from home

    Expedock

    United States
    2 days ago
  •  ...Fluent in Thai, the part-time Data Annotation Analyst will annotate media for AR/VR UX research projects remotely, applying quality standards and methodologies while identifying errors and trends. Key responsibilities Annotate media according to provided guidelines as... 
    Remote work
    Part time

    Virtual Vocations Inc

    United States
    2 days ago
  • $15 per hour

     ...Responsibilities Evaluate AI model responses for personalization quality, including grounding...  ...debug information to ensure proper use of data sources. Maintain strict data hygiene and...  .... Ability to work independently in a remote environment. Willingness to use a personal... 
    Remote work
    Full time

    Crossing Hurdles

    Poland, NY
    3 days ago
  •  ...Data Annotator (Dutch) Company is helping its client find Annotators to assist with multiple...  ...United States. This assignment is part-time remote, but you can dictate your schedule, as...  ...producing datasets specifically for AI/ML model training, with experience working... 
    Remote work
    Contract work
    Part time
    Flexible hours

    Comrise

    United States
    2 days ago
  •  ...Licensed Registered Nurse (RN) to annotate and validate healthcare data for AI model training. This role involves collaborating with...  ...communication skills are essential, and the position supports remote work. Ideal candidates will have significant experience in patient... 
    Remote work

    Crossing Hurdles

    New York, NY
    4 days ago
  • $15 per hour

     ...Position: LLM – AI Quality Analyst (Personalization) – Finnish Type: Short-Term Contract...  ...Compensation: $11–$15 per hour Location: Remote Commitment: Part-time availability required...  ...integration quality to ensure personal data is incorporated naturally into responses without... 
    Remote work
    Hourly pay
    Temporary work
    Part time

    Crossing Hurdles

    United States
    4 days ago
  •  ...A leading AI consulting firm is seeking AI Trainers for a data annotation project. This fully remote role involves categorizing and labeling various datasets to support AI system development. Candidates should be based in the United States and possess strong critical... 
    Remote work
    Contract work
    Part time
    Flexible hours

    ChatGPT Jobs

    United States
    4 days ago
  •  ...To support the development of AI technologies, the part-time General AI Data Annotator - German will review, score, and improve AI-generated responses while working remotely from various states in the USA for approximately 20 hours per week. Key responsibilities Review... 
    Remote work
    Part time
    Flexible hours

    Virtual Vocations Inc

    United States
    1 day ago
  • $15 per hour

     ...Position: LLM – AI Quality Analyst (Personalization) – German Type: Short-Term Contract Location: Remote Commitment: 20 hours/week with minimum 2 hours overlap with PST...  ...Assess correct and incorrect use of personal data in model outputs Perform side-by-side (... 
    Remote work
    Temporary work
    Immediate start

    Crossing Hurdles

    New Bremen, OH
    1 day ago
  •  ...ChatGPT Jobs is seeking a Data Annotation Project Contractor to work remotely, dedicating around 20 hours per week. Responsibilities include synthesizing information...  ...This flexible role offers the opportunity to contribute to the improvement of AI systems. #J-18808-Ljbffr... 
    Remote work
    Part time
    For contractors
    Flexible hours

    ChatGPT Jobs

    Saint Paul, MN
    1 day ago
  • $21.5 per hour

     ...We are looking for Data Annotators for AI Models - Hindi and English – US Based Only. Remote, Part-Time, Work from Home. Job Details: Job Type: Part-time employee (W2) Location: Remote from one of the following states: CO, FL, GA, IL, IN, MA, MN, NH, NJ, NC, OK... 
    Remote work
    Extra income
    Part time
    Immediate start
    Work from home
    Monday to Friday
    Flexible hours

    RWS Group

    Florida, NY
    6 days ago
  • $21.5 per hour

    A technology company seeks Data Annotators for AI Models, requiring native-level fluency in Hindi and proficiency in English. This part-time, remote role involves evaluating prompts, correcting responses, and providing feedback on other annotators' work. Ideal candidates... 
    Remote work
    Part time

    RWS Group

    Florida, NY
    4 days ago
  •  ...A company is looking for a German/English Bilingual AI Data Annotator & Evaluator (Remote, Hourly Contractor). Key Responsibilities Label, classify, and structure documents and content for AI training datasets Review AI-generated responses for accuracy, coherence, and... 
    Remote work
    Hourly pay
    For contractors

    Virtual Vocations Inc

    United States
    4 days ago
  • $15 - $20 per hour

     ...connect our community with real earning opportunities — remote jobs, surveys, clinical trials, gig platforms, and...  ...actually get it. THE ROLE The future of AI is being built right now — and the humans labeling the data are the ones making it possible. NoGigiddy is... 
    Remote work
    Hourly pay
    Flexible hours

    NoGigiddy

    United States
    2 days ago
  • $37 per hour

     ...that collaborates with the world’s leading AI research labs to build and train cutting‑...  ...: Mercor Position: SaaS Software Data Reviewer Referral Partner: Crossing...  ...Compensation: $30–$37/hour Location: Remote Commitment: 10–40 hours/week Role... 
    Remote work
    Hourly pay
    Contract work

    Crossing Hurdles

    United States
    3 days ago
  •  ...Mercor is looking for a Telecommunications Expert who will work remotely. This role involves evaluating AI-generated outputs related to telecom workflows and is suitable for candidates with a strong background in telecommunications. You will be responsible for ensuring... 
    Remote work

    Mercor Inc

    New York, NY
    2 days ago
  •  ...Dutch-speaking Data Rater Opportunity Are you tech-savvy? Have a passion for quality?...  ...Suriname, to work on projects to advance AI technologies. Join us for a unique chance...  ...Freelance/Independent Contract Location: Remote Language: Dutch Pay Rate: $2.25/hour... 
    Remote work
    Contract work
    Freelance
    Immediate start

    Welocalize

    United States
    1 day ago
  •  ...professional looking for freelance, part-time, remote, work-from-home jobs where you can set...  ...to improve the reliability of today's AI models? If yes, then this opportunity is for...  ...'re looking for? RWS Group is looking for Data Annotators to work on a range of tasks in... 
    Remote work
    Extra income
    Part time
    Freelance
    Work from home

    Wahojobs

    New York, NY
    4 days ago
  •  ...Freelanceshop is seeking AI Data Annotators to assist in training and improving Large Language Models (LLMs) in a fully remote position. This role is flexible, offering weekly payouts for completed tasks, and is perfect for those interested in technology and AI. Applicants... 
    Remote work
    Flexible hours

    Freelanceshop

    New York, NY
    2 days ago
  • $21.58 per hour

    TEKsystems is seeking a Level 1 Data Annotators for a 12-month...  ...depending on where you sit. Remote but must sit in North America...  ...Data Annotators to support our AI and machine learning teams in...  ...real-world problems. As a Data Annotator, you will play a crucial role... 
    Remote work
    Contract work

    TEKsystems

    Austin, TX
    1 day ago
  •  ...Our high-profile technology Client is seeking an Annotator for a REMOTE contract assignment. As a Data Annotation Analyst, you will be part of the Data Quality Analytics Team supporting AR/VR UX research projects. Data Annotation Analyst - Dutch Language... 
    Remote work
    Contract work

    Experis/Manpower Group

    Tempe, AZ
    3 days ago
  • $15 per hour

     ...Position: LLM – AI Quality Analyst (Personalization) – Dutch Type: Short-Term Contract Location: Remote Commitment: 20-40 hours/week with 4 hours overlap with PST...  ...Assess correct and incorrect use of personal data in model outputs Perform side-by-side (... 
    Remote work
    Temporary work
    Immediate start

    Crossing Hurdles

    Staten Island, NY
    1 day ago
  • $9 per hour

     ...Data Annotator Remote - Georgia Innodata is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation... 
    Remote work
    Hourly pay
    Full time
    Part time
    Flexible hours
    Shift work

    Innodata Inc.

    United States
    4 days ago
  •  ...A tech-focused company is seeking tech-savvy Swedish speakers for an entry-level project in AI data transformation. This remote position allows for a flexible schedule of 5 to 15 hours per week. Responsibilities include evaluating search filters, analyzing customer intent... 
    Remote work
    Flexible hours

    Welo Data

    New York, NY
    4 days ago
  • $18 per hour

     ...Our client, a leading organization in the technology and data industry, is seeking a Data Annotator to join their team. As a Data Annotator, you will be...  ...organization. Job Title: Data Annotator Location: 100% Remote Contract Length : 3 month contract with likely... 
    Remote work
    Weekly pay
    Contract work
    Temporary work
    Flexible hours

    Manpower Inc

    Milwaukee, WI
    3 days ago
  •  ...Volga Partners is seeking a full-time Spanish Language Data Evaluator to remotely manage data evaluation and annotation tasks. The role involves ensuring data accuracy while working within a client's language platform during business hours. The ideal candidate should... 
    Remote work
    Full time

    Volga Partners

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Trainer/Data Annotator - Remote. Be the first to apply!