AI Trainer and Evaluator

Role Overview

Train and evaluate next-generation AI systems by scoring model outputs, annotating real-world content, and delivering clear, actionable feedback that improves model accuracy and reasoning across diverse domains.

About the company

micro1 is an AI data lab that converts subject matter expertise into high-quality training data and evaluations for frontier models. Experts contribute knowledge across fields such as finance, healthcare, STEM engineering, and more, producing the annotations and feedback loops that help AI systems learn and perform better.

Key Responsibilities

• Evaluate and score AI-generated responses using well-defined rubrics and metrics across diverse subject areas.
• Annotate and categorize datasets to improve model accuracy and reliability.
• Review content for relevance, coherence, and factual accuracy with exceptional attention to detail.
• Provide clear, actionable feedback on AI performance to inform model improvements.
• Collaborate with customer teams to interpret guidelines and help refine evaluation rubrics.
• Document findings and maintain meticulous records of annotations and evaluations.
• Engage in critical reading and analysis of complex subject matter, including business, finance, marketing, healthcare, and legal topics.

Qualifications

• Bachelor’s degree required.
• Exceptional attention to detail and accuracy in data annotation and content evaluation.
• Strong critical reading and analytical skills, with demonstrated ability to interpret and apply rubrics.
• Proficiency in written and verbal communication, able to articulate nuanced feedback clearly.
• Experience evaluating or scoring large volumes of content against detailed criteria.
• Experience with AI training, machine learning data annotation, or related tasks is highly valued.
• Ability to work independently and collaboratively in a fully remote environment.

Preferred Qualifications

• Background in business, finance, legal, marketing, healthcare, or research fields.
• Prior experience in human-in-the-loop AI systems or quality assurance for AI-generated content.
• Familiarity with industry-standard annotation tools or AI evaluation platforms.

Work Terms

• Engagement type, contractor.
• Location, fully remote.
• Work is performed independently and collaboratively with remote teams.

Compensation

• Hourly pay range, $20 to $80 per hour.

Eligibility

• Bachelor’s degree is required.
• Applicants must be able to work as independent contractors under the stated remote engagement.