Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Quality Analyst (AI Training & Evaluation)

Crossing Hurdles

Employment Details Employment Type: Contractor / Freelance Engagement Duration: 4 Weeks Work Mode: Remote Start Date: Immediate Working Hours: Full-time, 8 hours/day, 40 hours/week Overlap Required: 4 hours with PST Experience Required: 2+ years About the Role We are hiring Quality Analysts for an AI training and evaluation project. In this role, you will work on improving large language models by reviewing content, validating responses, checking accuracy, analyzing information, and providing detailed feedback. This role is suitable for candidates with strong English comprehension, analytical thinking, research ability, and attention to detail. Key Responsibilities Review and evaluate AI-generated responses for accuracy, clarity, and quality Read, summarize, and break down large content into logical sections Validate claims and information through online research Check text accuracy, formatting, and consistency Provide detailed annotations and constructive feedback Work on reasoning, analytical, and content-based evaluation tasks Help improve AI models through structured review and feedback Required Skills Strong English reading and writing skills Good analytical and research skills Strong attention to detail, especially text accuracy and formatting Ability to provide detailed feedback and annotations Creative and logical thinking ability Good communication and collaboration skills Ability to work independently in a remote setup Laptop/desktop with a stable internet connection Vetting Process ICF Assessment Delivery Review Onboarding Important Note This is a short-term remote contractor assignment. No medical or paid leave benefits will be provided. #J-18808-Ljbffr Crossing Hurdles

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Quality Analyst (AI Training & Evaluation) in New York, NY vacancy
  • $40 per hour

     ...technology company is seeking medical experts for a remote position to assist in training AI models. Responsibilities include providing healthcare-related problems to AI chatbots and evaluating their output for accuracy. Candidates should have a medical degree (current or... 
    Training
    Hourly pay
    For contractors
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  •  ...Quality Control Analyst - Veterans Evaluation Services (July2026 Start) General information Date: Monday, May18, 2026 City: Remote Country: United States...  ...outside the scope of the assigned medical provider’s training or expertise, or has presented a problem/issue with... 
    Training
    Full time
    Contract work
    Currently hiring
    Work at office
    Remote work
    Work from home
    Home office
    Monday to Friday

    MAXIMUS

    New York, NY
    22 hours ago
  • $38 per hour

     ...About the job Australian English Data Quality Analyst(Human-in-the-Loop AI) Overview Welo Data...  ...project coordination, and hands-on training, where your ability to guide others...  ...workflows or human-in-the-loop evaluation environments ~ Prior experience auditing... 
    Training
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    New York, NY
    2 days ago
  •  ...technology company is seeking a 340B Analyst to assist in training AI models. The role involves providing...  ...chatbots with healthcare-related problems, evaluating model outputs for accuracy, and...  ...hourly pay and bonuses for quality work. #J-18808-Ljbffr DataAnnotation
    Training
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $25 - $30 per hour

    DataAnnotation seeks a Social Media Content Manager to enhance AI model training through expertly crafted content. Your key responsibilities include assigning tasks to AI chatbots and evaluating their outputs for quality and correctness. This independent contractor role offers... 
    Training
    Remote job
    Hourly pay
    For contractors
    Work from home

    DataAnnotation

    Brooklyn, NY
    2 days ago
  • $80 per hour

     ...A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies... 
    Remote work
    Flexible hours

    Mind Rift

    New York, NY
    3 days ago
  • Crossing Hurdles is seeking Quality Analysts for a remote assignment focusing on AI training and evaluation. The role involves reviewing AI-generated content, validating accuracy, and providing feedback. Candidates should possess strong English comprehension, analytical... 
    Training
    Remote job
    Contract work
    For contractors

    Crossing Hurdles

    New York, NY
    3 days ago
  • $15 per hour

    Innodata Inc. is looking for a Generative AI Specialist to contribute to AI development from anywhere in the...  ...while shaping the future of AI. Responsibilities include evaluating AI model performance, generating training data, and labeling content. Applicants should have at... 
    Training
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Innodata Inc.

    Brooklyn, NY
    3 days ago
  • $50 - $60 per hour

    A company specializing in AI is seeking a Fixed Income Trader to assist in training AI models used in finance. This is a flexible remote position suitable for...  ...and are fluent in English. Responsibilities include evaluating AI outputs and providing structured feedback.... 
    Training
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $130 per hour

    A leading technology firm is seeking a Medical AI Quality Analyst to work remotely. The role involves evaluating AI-generated medical responses for accuracy and clinical relevance, and it requires experience in medical research and writing. Compensation is set at $130 per... 
    Remote job
    Hourly pay
    Part time

    Indotronix UK

    New York, NY
    1 day ago
  •  ...Community Health Worker to join their team and assist in training AI models. The role involves providing AI chatbots with complex healthcare-related problems, evaluating their outputs for accuracy, and ensuring quality of responses. Candidates must have expertise in... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...Community Health Worker to join their team and assist in training AI models. The role involves evaluating AI chatbots for logic and performance, ensuring...  ...pay starting at $50, with bonuses available for high-quality work. Applicants must be based in the United States and... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • A medical AI training company is seeking healthcare experts to help train AI models through evaluating their responses to complex healthcare problems. This remote role allows for...  ...a commitment to medical accuracy and quality assessment in AI performance. #J-18808-Ljbffr... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $38 per hour

     ...Data Quality Analyst Welo Data is looking for experienced, detail-oriented...  ...with both people and AI systems — auditing outputs,...  ...coordination, and hands-on training, where your ability to guide...  ...workflows or human-in-the-loop evaluation environments ~ Prior experience... 
    Training
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    New York, NY
    1 day ago
  • $20 per hour

    A healthcare technology company is seeking an RCM Analyst to join their team. In this role, you will be responsible for training AI models by evaluating their logic and improving model quality with complex healthcare-related problems. Ideal applicants should possess expertise... 
    Training
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    New York, NY
    1 day ago
  • $50 - $60 per hour

     ...to set your own schedule. As part of this role, you'll train AI models in finance by evaluating their outputs and providing structured feedback. The ideal...  ...-time with pay starting at USD $50-$60 per hour plus bonuses for high-quality work. #J-18808-Ljbffr DataAnnotation
    Training
    Remote job
    Hourly pay
    Full time
    Part time

    DataAnnotation

    New York, NY
    22 hours ago
  • $20 per hour

     ...technology company is seeking a Risk Adjustment Analyst to assist in the training of AI models. This flexible position allows you to work remotely and involves evaluating AI chatbot outputs for logic and accuracy, ensuring quality responses in healthcare contexts. Ideal... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • A leading AI training company is seeking a Claims Adjuster to assist in training AI Assistant models for finance. This remote position...  ...understanding of financial principles. Responsibilities include evaluating AI performance and providing structured feedback. The role... 
    Training
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    1 day ago
  • Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time position requires native-level language proficiency and a university degree. You will contribute to improving evaluation frameworks while... 
    Full time
    Remote work

    Welocalize

    New York, NY
    1 day ago
  • $40 per hour

    DataAnnotation is seeking a Physics AI Training Specialist based in the United States to train AI models by providing complex physics problems and evaluating the outputs. This position requires expertise in physics and flexibility in working hours as you choose projects... 
    Training
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    Brooklyn, NY
    2 days ago
  • $20 per hour

    A healthcare technology firm is seeking an IV Room Technician to support AI model training. This role requires expertise in healthcare to address various medical issues and ensure the accuracy of AI chatbot responses. The position is flexible and can be full-time or part... 
    Training
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

    A technology company specializing in AI training is looking for a Biology Expert based in the United States. This role involves training AI chatbots by providing complex biology questions and evaluating their maturity and performance. Candidates should have strong knowledge... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $50 - $60 per hour

    DataAnnotation is seeking a Retail Banking Product Manager to assist in training AI models for finance. The role involves evaluating AI chatbot outputs and improving their reasoning based on complex financial scenarios. Ideal candidates are experienced finance professionals... 
    Training
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    22 hours ago
  • $38 per hour

     ...Between Human Judgment and AI Excellence — NYC | WA | CAAre...  ...? Welo Data is seeking Data Quality Analysts for Project Perseus. This isn...  ...& Coaching: Lead hands-on training for new associates, helping...  ...compliance, or policy-driven evaluation in a GenAI context. Premium... 
    Training
    Hourly pay
    Full time
    Work at office
    Shift work

    Welocalize

    New York, NY
    22 hours ago
  • $50 - $60 per hour

    DataAnnotation is seeking an Operating Room Nurse to help train AI models by providing diverse healthcare-related problems. The role...  ...contractor position allows you to work on your own schedule from home, evaluating AI outputs for correctness and performance. Projects are paid... 
    Training
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    New York, NY
    1 day ago
  •  ...distinction for nursing excellence and quality patient outcomes in our Lehigh Valley region...  ...Duties Conducts formal education and training for staff on policies/procedures, coding...  ...to coding questions from staff. Evaluates the quality of clinical documentation to... 
    Training
    Work experience placement
    Work at office
    Local area
    Remote work
    Shift work
    Day shift

    SwiftCruit

    New York, NY
    2 days ago
  • $70 per hour

    Position: Video related professional for AI training Type: Contract Compensation: $20 - $70/hour...  ...video datasets for model training and evaluation. Review and critique AI-generated video outputs to ensure accuracy, quality, and adherence to industry standards. Document... 
    Training
    Remote job
    Contract work

    Crossing Hurdles

    New York, NY
    1 day ago
  • $50 per hour

    A tech company specializing in AI training is seeking a Community Health Worker to assist in training AI models. The position requires expertise...  ...a remote role with flexible hours, paying $50+ per hour, and includes bonuses for high-quality work. #J-18808-Ljbffr DataAnnotation
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $20 per hour

    A data services company is seeking an RCM Analyst to assist in training AI models in New York. The successful candidate will need expertise in healthcare...  ...or healthcare-related degree. Bonuses are available for exceptional quality of work. #J-18808-Ljbffr DataAnnotation
    Training
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $50 - $60 per hour

     ...technology company is seeking a Corporate Development Analyst to leverage finance expertise for training AI tools. This unique role is flexible, allowing for...  ...Compensation starts at $50-$60 per hour, based on project selection and quality. #J-18808-Ljbffr DataAnnotation
    Training
    Remote job
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Quality Analyst (AI Training & Evaluation). Be the first to apply!