Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analyst (AI Evaluation)

micro1

Role Title: Data Analyst (AI Evaluation) Role Type: Contractor Location: Remote, US-based. micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you’ll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines. Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions. Apply structured rubrics and evaluation criteria consistently across large data sets. Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear. Escalate patterns or recurring data issues for further analysis rather than addressing them individually. Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths. Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments. Preferred Qualifications 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles. Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria. Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely. Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete. Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work. Strong written and verbal communication skills for documenting findings and providing feedback. Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands-on data querying is a plus. Experience with data annotation, labeling, or rubric-based evaluation is advantageous. #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Analyst (AI Evaluation) in New York, NY vacancy
  • $50 - $80 per hour

     ...The work You will help evaluate how well AI handles real-world business analysis tasks. The work combines data privacy review, analytical quality checks, and clear scoring standards...  ...: At least three years as a business analyst or data analyst working with large business... 
    Suggested
    Hourly pay
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  •  ...rubrics. This fully remote contractor role runs for about 4–6 weeks with weekly payments. Start date is immediate; you will work independently, producing human-built input workbooks and onboarding tasks. AI/evaluation concepts are central to the process. #J-18808-Ljbffr... 
    Suggested
    Weekly pay
    For contractors
    Immediate start
    Remote work

    Aptura

    New York, NY
    4 days ago
  • $10k

     ...Disease (BCD) oversees surveillance and investigations of more than 70 reportable diseases. This Communicable Diseases Data Analyst and Program Evaluation Specialist position sits in BCD’s Investigation and Response Unit. DUTIES WILL INCLUDE BUT NOT BE LIMITED TO: The... 
    Suggested
    Full time
    Traineeship
    Work at office
    Work from home
    2 days per week

    City of New York

    New York, NY
    2 days ago
  •  ...The New York City Department of Health and Mental Hygiene seeks a Communicable Diseases Data Analyst and Program Evaluation Specialist to join the Bureau of Communicable Disease's Investigation and Response Unit. The role uses data to evaluate surveillance and investigation... 
    Suggested
    Work at office

    City of New York

    New York, NY
    2 days ago
  •  ...AI Trainer Jobs is seeking a Market Research Evaluation Specialist for a remote contractor role. You will review AI outputs, reproduce derivations, and document correct methods to train the modeling team. The position emphasizes scientific and technical domain expertise... 
    Suggested
    For contractors
    Remote work

    AuraOne

    New York, NY
    4 days ago
  • $80 per hour

     ...working with a leading foundational AI lab to find experienced business intelligence analysts who can help train their latest...  ...tasks. We're looking for BI and data analytics professionals with 4+ years...  ...business narratives to create, evaluate, and refine AI-generated... 
    Immediate start
    Remote work
    Flexible hours

    Ethos

    New York, NY
    3 days ago
  •  ...Jobright is your personal AI job search agent that transforms the way you do job search...  ...to the best job outcomes. The New Grad Data Analyst will help product teams make better...  ...dashboards, and self-service reports Design and evaluate product experiments Investigate changes... 
    Internship
    Remote work

    jobright.com

    New York, NY
    12 hours ago
  •  ...Welocalize, Inc. is hiring a Data Labeling Associate (Italian speakers) to work onsite in the United States. You will evaluate AI outputs, provide structured feedback, and audit data quality for real-world model behavior. This role emphasizes clear judgment, strict... 

    Welocalize

    New York, NY
    5 days ago
  •  ...USA Government agency is seeking a Social Science Research Analyst to advance program evaluation by designing studies, collecting data, and delivering insights that improve outcomes for unaccompanied children and related programs. You will prepare briefings, explain findings... 

    Austincc

    New York, NY
    2 days ago
  • $195k - $275k

     ...financial industry experience to join a data analytics and artificial intelligence team...  ...expanding its capabilities in quantitative AI, combining advanced statistical methods...  ...advanced statistical approaches to support evaluation, monitoring, and continuous improvement... 
    Temporary work

    474 MS Services Group, Inc.

    New York, NY
    2 days ago
  • $98k - $122k

     ...business. We solve HR issues. We’re data-driven and never stop...  ...You're forward-thinking about AI and automation, but apply critical...  ...a CS Performance Insights Analyst, how results are achieved is paramount...  ...LLMs or similar AI models to evaluate unstructured data (e.g.,... 
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    4 days ago
  •  ...Mercor is seeking a Software / AI / IT / data Evaluator for remote, contract work. You will assess AI-generated artifacts against quality rubrics, identify factual and presentation errors, and provide structured feedback to improve model outputs. Ideal candidates have... 
    Contract work
    Remote work

    Mercor Inc

    New York, NY
    12 hours ago
  •  ...Talent Hackers is seeking a detail-oriented AI Data Quality Reviewer to ensure data quality for AI training and evaluation projects. You will review text and video submissions, apply guidelines, and provide clear feedback to contributors to maintain dataset integrity.... 
    Full time

    Talent Hackers

    New York, NY
    5 days ago
  •  ...SaidGig is seeking a detail-oriented data reviewer to help improve AI systems by analyzing large business datasets, ensuring accuracy, privacy,...  ...findings and recommendations to support model training and evaluation while adhering to strict PII protocols. Remote work... 
    Remote work

    SaidGig

    New York, NY
    2 days ago
  •  ...professional to conduct primary research on selected companies, AI platforms, industry sectors, and countries to understand the factors...  ...company-level financial and technology market models to evaluate business performance and predict market trends, and you will prepare... 

    IDC

    New York, NY
    15 hours ago
  • $175k - $190k

     ...'re applying forWe're looking for a Sr. Data Analyst Lead to help build the data foundation that...  ...that lets you pivot with data and AI insights. These aren't buzzwords, they're...  ...analytics workflows, with the ability to evaluate, implement, and optimize tools to improve... 
    Full time
    Work at office
    Visa sponsorship
    Work visa

    Lemonade

    New York, NY
    6 days ago
  • $92k - $125k

     ...dashboarding, and translating complex data into clear business...  ...Zip As a Senior Marketing Data Analyst, you’ll sit at the center of Zip...  ...media mix, and funnel analysis to evaluate marketing effectiveness...  ...reliability of marketing data Build AI-enabled analytical agents,... 
    Casual work
    Work at office
    Remote work
    Flexible hours

    Zip Co

    New York, NY
    5 days ago
  •  ...extension. Description Job Title: Design Data Labeling Analyst Summary: As a member of our...  ...ensuring the compositional quality of AI-generated images for advertisers. The...  ...appeal. Responsibilities: • Evaluate AI-generated images to determine compliance... 
    Contract work

    Tundra Technical Solutions

    New York, NY
    4 days ago
  •  ...Position Summary The Senior Data Analyst will serve as the bridge between business stakeholders...  ...data quality, and help expand company's AI-ready data platform. They will work...  ...definitions to enhance accuracy. Assist in evaluating emerging AI capabilities that improve... 
    Full time

    ASB Resources

    New York, NY
    3 days ago
  • TELUS Digital in the AI Community seeks an Online Data Analyst to perform structured quality audits on spatial and mapping datasets. You will verify, evaluate, and validate complex geographic and business information using mapping tools and reference materials. This independent... 
    Remote job
    For contractors
    Flexible hours

    TELUS Digital

    New York, NY
    3 days ago
  • TELUS Digital AI Community is hiring an Online Data Analyst to conduct structured quality audits on spatial and mapping datasets. You will verify, evaluate, and validate geographic information using advanced mapping tools and reference materials, ensuring data quality for... 
    Remote job
    For contractors
    Flexible hours

    Island Jobs

    New York, NY
    3 days ago
  • $50k - $60k

     ...Provinces. About the Role We are seeking an Analyst to join our Data Team and conduct research and analysis...  ...exploring emerging technologies like AI. Proficiency in conducting...  ...applying to Leadership Connect we focus on evaluation based on key competencies needed for success... 
    Work at office
    Local area
    Flexible hours

    Leadership Connect, Inc.

    New York, NY
    1 day ago
  • $89k - $121.4k

     ...a part of our caring communityThe Data Protection Security Investigations Analyst 2 works with EIP stakeholders and...  ...stakeholder coordination. The analyst evaluates alerts, logs, user activity,...  ...Ability to responsibly use approved AI-enabled tools to improve investigation... 
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Home office

    Humana

    New York, NY
    7 days ago
  •  ...process improvement, technology, data storytelling, client service...  ...LPM Data & Analytics Senior Analyst supports the delivery of solutions...  ...intelligence, financial and AI-enabled technologies. A key...  ...capabilities. Research, test and evaluate new approaches and develops... 
    Work at office
    Shift work

    Ropes & Gray

    New York, NY
    6 days ago
  • $111.71k - $137.59k

     ...Eligible: NoAgency: Financial Services, Department ofTitle: Data Analyst 3Occupational Category: Other Professional CareersSalary Grade...  ...of catastrophic risk.• Advanced knowledge of frontier AI evaluation, security, and safety practices, including compute estimation... 
    Full time
    Temporary work
    Traineeship
    Internship
    Work at office
    Local area
    Remote work

    State of New York, USA

    New York, NY
    3 days ago
  • Data Quality Analyst At ICF our Digital Modernization Division is an information technology and management...  ...storage, analytics, governance, and AI/ML capabilities that enable thousands...  ...Experience designing, maintaining, and evaluating data quality rules, quality thresholds,... 
    Contract work
    Live in
    Remote work

    ICF

    New York, NY
    1 day ago
  • $61.23k - $104.09k

     ...cybersecurity, enterprise architecture, data modernization, and digital...  ..., analytics, governance, and AI/ML capabilities that enable...  ...at scale. The Data Quality Analyst defines, monitors, and reports...  ...Experience designing, maintaining, and evaluating data quality rules, quality... 
    Full time
    Contract work
    Work experience placement
    Live in
    Work at office
    Immediate start
    Remote work

    ICF International Inc

    New York, NY
    1 day ago
  •  ...CSpring At CSpring, we believe in the power of data to drive decisions and real-world impact....  ...from internal and external sources to evaluate and demonstrate effectiveness and efficiency...  ...initiatives. Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for... 
    Remote work

    CSpring

    New York, NY
    1 day ago
  • $75k - $90k

     ...Reporting Job Description Sustainability Data Analyst Location: United States - Remote About...  ...feedback from multiple stakeholders. Claude/AI fluency It Helps If You Have Experience...  ...and location. These factors will be evaluated and considered by Worldly throughout the... 
    Full time
    Contract work
    Remote work
    Work from home
    Flexible hours

    Responsible Us

    New York, NY
    3 days ago
  • $38 per hour

     ...Data Quality AnalystWelo Data is looking for experienced, detail...  ...join our team as Data Quality Analysts. This role sits at the center...  ...closely with both people and AI systems — auditing outputs, supporting...  ...or human-in-the-loop evaluation environmentsPrior experience auditing... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analyst (AI Evaluation). Be the first to apply!