Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analyst (AI Evaluation)

$100 per hour
Part-time

micro1

pay

Required Skills
Data Analysis
Data Review
Attention to detail
Handling ambiguity
Error spotting
About micro1
micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems learn, reason, and perform.

Our platform identifies and vets top talent through an AI recruiter, enabling high-quality expert contributions at scale. We aim to enable 1 billion people to do meaningful work by applying their expertise to AI. As our global expert network grows, micro1 is building the human intelligence layer for frontier AI.

Role Title: Data Analyst (AI Evaluation)

Role Type: Contractor

Location: Remote, US-based.

micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines.
Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions.
Apply structured rubrics and evaluation criteria consistently across large data sets.
Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear.
Escalate patterns or recurring data issues for further analysis rather than addressing them individually.
Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths.
Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments.

Preferred Qualifications

3–5+ years of experience in data review, data quality, quality assurance, or analytical roles.
Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria.
Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete.
Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work.
Strong written and verbal communication skills for documenting findings and providing feedback.
Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands-on data querying is a plus.
Experience with data annotation, labeling, or rubric-based evaluation is advantageous.
Email

By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.

Continue
or
Continue with Google
Continue with LinkedIn

Have any questions? See FAQs

Refer and Earn
$100

Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Data Analyst (AI Evaluation) in San Francisco, CA vacancy
  • $38 per hour

     ...Bridge Between Human Judgment and AI Excellence Are you an...  ...others and maintain a high bar for data integrity? Welo Data is seeking Data Quality Analysts for Project Perseus. This isn...  ...safety, compliance, or policy‑driven evaluation in a GenAI context. Premium... 
    Suggested
    Hourly pay
    Full time
    Work at office
    Shift work

    Welo Data

    San Francisco, CA
    3 days ago
  • $136.44k - $265.11k

    We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits...  ...when clean, structured scientific data and AI are built into how science gets done...  ...our work here.You’ll build the datasets, evaluations, and systems that help close that gap. You... 
    Suggested
    Work at office
    Local area
    Monday to Friday
    Shift work

    Benchling

    San Francisco, CA
    5 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation...  ...: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  •  ...the office. We are looking for a Senior Data Analyst — Hardware & Supply Chain to join our Data...  ...for reporting and for MCP/agentic AI consumption.Operations & Supply Chain PartnershipPartner...  ....Tooling & InnovationContinuously evaluate emerging tools (Unity Catalog,... 
    Suggested
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Oura

    San Francisco, CA
    1 day ago
  •  ...professional concepts in research data management and analysis. Works...  ...motivated Research Data Analyst to join a team of clinical and...  ...Reporting Products Assists with evaluation and research of data reporting...  ...scale. Predictive Analytics and AI Under direct supervision or... 
    Suggested

    University of California - San Francisco

    San Francisco, CA
    2 days ago
  • $38 per hour

     ...Data Quality Analyst Welo Data is looking for experienced, detail-oriented professionals to join...  ...You'll work closely with both people and AI systems — auditing outputs, supporting...  ...ML data workflows or human-in-the-loop evaluation environments ~ Prior experience... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    San Francisco, CA
    2 days ago
  •  ...Investigate and develop systems to enhance frontier AI capabilities. About Turing: Based in...  ...frontier research with high-quality data, advanced training pipelines, plus top AI...  ...AI labs and enterprises. Our environments evaluate and improve AI models on complex, long-... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    2 days ago
  • $88k - $95.5k

     ...of experience and success, JVS is a data-driven organization that takes a whole...  ...mobility. The Role    The Data Analyst is a core member of JVS's Evaluation and Impact team, responsible for...  ...technical users.  Experience using AI-assisted tools (such as Microsoft Copilot... 
    Work at office
    Work from home
    Relocation

    Jewish Vocational Service (San Francisco)

    San Francisco, CA
    5 days ago
  • Title: Data Analyst III (HR/ Workday/ People Analytics) Location: San Francisco, CA or Seattle...  ...and Recruiting leadership. Program Evaluation and Ad-Hoc Requests: Support end of program...  ...focused on delivering value quickly through AI, analytics, automation, and commonly... 
    Full time
    Temporary work
    For contractors
    Immediate start
    3 days per week

    Pinnacle Group

    San Francisco, CA
    8 hours ago
  •  ...Job Title: Data Analyst Location: Brookline, MA (Remote within the United States) Employment...  ...About Daice Labs Daice Labs is an AI research and product company founded by...  ...data that informs product decisions, model evaluation, and business operations. This role... 
    Full time
    Local area
    Remote work

    Daice Labs

    San Francisco, CA
    3 days ago
  • $130k - $170k

     ...Cardless is looking for a Data Analyst / Senior Data Analyst to join our team and help shape...  ...new features, workflows, and policies Evaluate and optimize business processes across the...  .../Sheets, Python) ~ Experience using AI tools in a professional setting (e.g., for... 
    Work at office
    Relocation package
    Flexible hours

    Cardless

    San Francisco, CA
    4 days ago
  • $140k - $180k

     ...Data Analyst Harper is an AI-native commercial insurance company in San Francisco. We're not bolting AI onto insurance — we're rebuilding the...  ...cohort, and customer segment. Run experiment analysis. Evaluate A/B tests and campaign experiments — and turn results... 
    Relocation
    Monday to Friday
    Day shift

    Harper Group

    San Francisco, CA
    4 days ago
  •  ...employees and our community. Join us in using data, bold thinking, and a commitment to...  ...judgment to identify and mitigate riskUse AI tools fluently and stay current on new AI...  ...with us. We will use this information to evaluate your application for employment.We will only... 
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    5 days ago
  • $100k

    2027 July Analyst Strategic Insights (SF) Position: Financial Technology...  ...a member of our team you will evaluate inbound opportunities and help...  ...their financial modeling data analytics business strategy...  ...FT Partners builds the first AI native investment bank Analysts... 
    Permanent employment
    Full time
    Visa sponsorship
    Work visa

    Financial Technology Partners

    San Francisco, CA
    16 days ago
  • $26 - $28 per hour

     ...Job Description Overview Welo Data is looking for detail-oriented and...  ...to join our team as Data Labeling Analysts, supporting speech and voice AI systems. This is a high-impact production...  ...is more execution-focused than evaluation-heavy roles, it still requires... 
    Full time
    Work experience placement
    Remote work
    Visa sponsorship

    Welocalize

    San Francisco, CA
    5 days ago
  • $65k - $68k

     ...architecture Familiarity with Workday data structures Experience...  ...or similar survey and evaluation tools, executive reporting or...  ...as needed Technologies: AI Excel Support Tableau...  ...seeking a detail-oriented Data Analyst III for a temporary leave-of-absence... 
    Hourly pay
    Full time
    Temporary work
    Local area
    3 days per week

    Pinnacle Technical Resources

    San Francisco, CA
    8 days ago
  • $100 per hour

     ...Document Review Spot Checks Data Privacy eDiscovery About...  ...1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  .... Role Title: Data Privacy Analyst Role Type: Contractor... 
    Contract work
    For contractors
    Remote work

    micro1

    San Francisco, CA
    16 hours ago
  •  ...Analyze ML datasets to evaluate and improve system performance. About...  ...accelerator for frontier AI labs and a trusted partner for...  ...frontier research with high-quality data, advanced training pipelines,...  ...looking for experienced Data Analysts (MLE Bench) to contribute to... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    2 days ago
  • $150k - $200k

     ...employer. Overview The Compliance & Data Science Consultant supports the Lab’s...  ...:Support the design, implementation, and evaluation of client compliance programs.Conduct compliance...  ...remediation roadmaps.Continue to develop AI-driven workflows to derive efficiency on... 

    Ropes & Gray

    San Francisco, CA
    3 days ago
  •  ...candidate will have a foundational understanding of machine learning, data annotation, quality assurance, and natural language processing....  ...processes using internal tools and command-line interfaces. Evaluate the performance of trained models to gauge their efficacy and... 
    Full time

    Welocalize

    San Francisco, CA
    2 days ago
  • $60k - $85k

     ...About Hive Hive is the leading provider of cloud-based AI solutions to understand, search, and generate content, and is...  ...out if you are interested in joining the future of AI! Data Operations Analyst We are looking for an eager and motivated Data Operations... 
    Work experience placement

    Hive

    San Francisco, CA
    2 days ago
  •  ...gathering analyzing and interpreting a wide variety of research data. Designs and conducts research including selecting data samples...  ...and data analysis for internal constituents and supports the evaluation and research of data reporting products. The position uses data... 
    Full time

    University of California, San Francisco

    San Francisco, CA
    15 days ago
  •  ...at the core of how the next generation of AI models learns to work in spreadsheets. #...  ...directly elevate the quality of the training data behind the most advanced Large Language...  ...write accurate, well-structured solutions. Evaluate Excel tasks and solutions and provide... 
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Analyze data and write Python code to enhance AI model performance. About Turing: Turing is one of the...  ...seeking talented Data Scientists & Analysts proficient in Python to join our ambitious...  ...optimize AI models. Conduct evaluations (Evals) to benchmark model... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    2 days ago
  • $175k - $330k

    Perplexity is AI for people who expect more. On the data team, that means building the systems that make our data...  ...systems.Shape tooling decisions - evaluate build-versus-buy tradeoffs, manage...  ...by agents as well as analysts.High leverage - better models, pipelines... 
    Local area

    Perplexity AI

    San Francisco, CA
    4 days ago
  • $93.6k - $117k

     ...visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service...  ...and support you need to grow your career.Data at BrexThe Data organization develops...  ..., and Operations. Our Data Scientists, Analysts, and Engineers work together to make data—... 
    Work at office
    Remote work
    Work from home

    Brex

    San Francisco, CA
    1 day ago
  •  ...analytics function — and operates in accordance with the Finance Data Strategy governance framework to drive rapid P2P process transformation...  ...(ZIP, SAP, NetSuite, expense platform, BrickBuy) — including AI/LLM-assisted triage, auto-routing, data enrichment, exception... 
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  • $114.2k - $142.7k

     ...sectors. We are both a space company and data company all rolled into one.Customers and...  ...Netherlands.About the Role:We are seeking a Data Analyst to join our Data Team. The ideal candidate...  ...personal information as described therein.AI in Our Interviewing Process: Planet is... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs

    San Francisco, CA
    5 days ago
  • $122.5k

     ...August 11, 2026 for consideration. The Data Analyst Role This role is open to candidates...  ...• Interest or familiarity in using AI coding tools Application Requirements...  ...allegations of manipulation of financial markets, evaluation of fair merger prices, securities... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship

    Cornerstone Research

    San Francisco, CA
    2 days ago
  • $34 per hour

     ...Data Labeling Associate Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data...  ...annotation role. You'll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analyst (AI Evaluation). Be the first to apply!