Data Analyst (AI Evaluation)
micro1
Role Title: Data Analyst (AI Evaluation) Role Type: Contractor Location: Remote, US-based. micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you’ll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. Scope of Work Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines. Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions. Apply structured rubrics and evaluation criteria consistently across large data sets. Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear. Escalate patterns or recurring data issues for further analysis rather than addressing them individually. Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths. Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments. Preferred Qualifications 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles. Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria. Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely. Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete. Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work. Strong written and verbal communication skills for documenting findings and providing feedback. Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands-on data querying is a plus. Experience with data annotation, labeling, or rubric-based evaluation is advantageous. #J-18808-Ljbffr
$50 - $80 per hour
...The work You will help evaluate how well AI handles real-world business analysis tasks. The work combines data privacy review, analytical quality checks, and clear scoring standards... ...: At least three years as a business analyst or data analyst working with large business...SuggestedHourly payPart timeFor contractorsRemote work- ...rubrics. This fully remote contractor role runs for about 4–6 weeks with weekly payments. Start date is immediate; you will work independently, producing human-built input workbooks and onboarding tasks. AI/evaluation concepts are central to the process. #J-18808-Ljbffr...SuggestedWeekly payFor contractorsImmediate startRemote work
$10k
...Disease (BCD) oversees surveillance and investigations of more than 70 reportable diseases. This Communicable Diseases Data Analyst and Program Evaluation Specialist position sits in BCD’s Investigation and Response Unit. DUTIES WILL INCLUDE BUT NOT BE LIMITED TO: The...SuggestedFull timeTraineeshipWork at officeWork from home2 days per week- ...The New York City Department of Health and Mental Hygiene seeks a Communicable Diseases Data Analyst and Program Evaluation Specialist to join the Bureau of Communicable Disease's Investigation and Response Unit. The role uses data to evaluate surveillance and investigation...SuggestedWork at office
- ...AI Trainer Jobs is seeking a Market Research Evaluation Specialist for a remote contractor role. You will review AI outputs, reproduce derivations, and document correct methods to train the modeling team. The position emphasizes scientific and technical domain expertise...SuggestedFor contractorsRemote work
$80 per hour
...working with a leading foundational AI lab to find experienced business intelligence analysts who can help train their latest... ...tasks. We're looking for BI and data analytics professionals with 4+ years... ...business narratives to create, evaluate, and refine AI-generated...Immediate startRemote workFlexible hours- ...Jobright is your personal AI job search agent that transforms the way you do job search... ...to the best job outcomes. The New Grad Data Analyst will help product teams make better... ...dashboards, and self-service reports Design and evaluate product experiments Investigate changes...InternshipRemote work
- ...Welocalize, Inc. is hiring a Data Labeling Associate (Italian speakers) to work onsite in the United States. You will evaluate AI outputs, provide structured feedback, and audit data quality for real-world model behavior. This role emphasizes clear judgment, strict...
- ...USA Government agency is seeking a Social Science Research Analyst to advance program evaluation by designing studies, collecting data, and delivering insights that improve outcomes for unaccompanied children and related programs. You will prepare briefings, explain findings...
$195k - $275k
...financial industry experience to join a data analytics and artificial intelligence team... ...expanding its capabilities in quantitative AI, combining advanced statistical methods... ...advanced statistical approaches to support evaluation, monitoring, and continuous improvement...Temporary work$98k - $122k
...business. We solve HR issues. We’re data-driven and never stop... ...You're forward-thinking about AI and automation, but apply critical... ...a CS Performance Insights Analyst, how results are achieved is paramount... ...LLMs or similar AI models to evaluate unstructured data (e.g.,...Casual workWork at officeLocal area- ...Mercor is seeking a Software / AI / IT / data Evaluator for remote, contract work. You will assess AI-generated artifacts against quality rubrics, identify factual and presentation errors, and provide structured feedback to improve model outputs. Ideal candidates have...Contract workRemote work
- ...Talent Hackers is seeking a detail-oriented AI Data Quality Reviewer to ensure data quality for AI training and evaluation projects. You will review text and video submissions, apply guidelines, and provide clear feedback to contributors to maintain dataset integrity....Full time
- ...SaidGig is seeking a detail-oriented data reviewer to help improve AI systems by analyzing large business datasets, ensuring accuracy, privacy,... ...findings and recommendations to support model training and evaluation while adhering to strict PII protocols. Remote work...Remote work
- ...professional to conduct primary research on selected companies, AI platforms, industry sectors, and countries to understand the factors... ...company-level financial and technology market models to evaluate business performance and predict market trends, and you will prepare...
$175k - $190k
...'re applying forWe're looking for a Sr. Data Analyst Lead to help build the data foundation that... ...that lets you pivot with data and AI insights. These aren't buzzwords, they're... ...analytics workflows, with the ability to evaluate, implement, and optimize tools to improve...Full timeWork at officeVisa sponsorshipWork visa$92k - $125k
...dashboarding, and translating complex data into clear business... ...Zip As a Senior Marketing Data Analyst, you’ll sit at the center of Zip... ...media mix, and funnel analysis to evaluate marketing effectiveness... ...reliability of marketing data Build AI-enabled analytical agents,...Casual workWork at officeRemote workFlexible hours- ...extension. Description Job Title: Design Data Labeling Analyst Summary: As a member of our... ...ensuring the compositional quality of AI-generated images for advertisers. The... ...appeal. Responsibilities: • Evaluate AI-generated images to determine compliance...Contract work
- ...Position Summary The Senior Data Analyst will serve as the bridge between business stakeholders... ...data quality, and help expand company's AI-ready data platform. They will work... ...definitions to enhance accuracy. Assist in evaluating emerging AI capabilities that improve...Full time
- TELUS Digital in the AI Community seeks an Online Data Analyst to perform structured quality audits on spatial and mapping datasets. You will verify, evaluate, and validate complex geographic and business information using mapping tools and reference materials. This independent...Remote jobFor contractorsFlexible hours
- TELUS Digital AI Community is hiring an Online Data Analyst to conduct structured quality audits on spatial and mapping datasets. You will verify, evaluate, and validate geographic information using advanced mapping tools and reference materials, ensuring data quality for...Remote jobFor contractorsFlexible hours
$50k - $60k
...Provinces. About the Role We are seeking an Analyst to join our Data Team and conduct research and analysis... ...exploring emerging technologies like AI. Proficiency in conducting... ...applying to Leadership Connect we focus on evaluation based on key competencies needed for success...Work at officeLocal areaFlexible hours$89k - $121.4k
...a part of our caring communityThe Data Protection Security Investigations Analyst 2 works with EIP stakeholders and... ...stakeholder coordination. The analyst evaluates alerts, logs, user activity,... ...Ability to responsibly use approved AI-enabled tools to improve investigation...Full timeTemporary workApprenticeshipWork at officeRemote workHome office- ...process improvement, technology, data storytelling, client service... ...LPM Data & Analytics Senior Analyst supports the delivery of solutions... ...intelligence, financial and AI-enabled technologies. A key... ...capabilities. Research, test and evaluate new approaches and develops...Work at officeShift work
$111.71k - $137.59k
...Eligible: NoAgency: Financial Services, Department ofTitle: Data Analyst 3Occupational Category: Other Professional CareersSalary Grade... ...of catastrophic risk.• Advanced knowledge of frontier AI evaluation, security, and safety practices, including compute estimation...Full timeTemporary workTraineeshipInternshipWork at officeLocal areaRemote work- Data Quality Analyst At ICF our Digital Modernization Division is an information technology and management... ...storage, analytics, governance, and AI/ML capabilities that enable thousands... ...Experience designing, maintaining, and evaluating data quality rules, quality thresholds,...Contract workLive inRemote work
$61.23k - $104.09k
...cybersecurity, enterprise architecture, data modernization, and digital... ..., analytics, governance, and AI/ML capabilities that enable... ...at scale. The Data Quality Analyst defines, monitors, and reports... ...Experience designing, maintaining, and evaluating data quality rules, quality...Full timeContract workWork experience placementLive inWork at officeImmediate startRemote work- ...CSpring At CSpring, we believe in the power of data to drive decisions and real-world impact.... ...from internal and external sources to evaluate and demonstrate effectiveness and efficiency... ...initiatives. Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for...Remote work
$75k - $90k
...Reporting Job Description Sustainability Data Analyst Location: United States - Remote About... ...feedback from multiple stakeholders. Claude/AI fluency It Helps If You Have Experience... ...and location. These factors will be evaluated and considered by Worldly throughout the...Full timeContract workRemote workWork from homeFlexible hours$38 per hour
...Data Quality AnalystWelo Data is looking for experienced, detail... ...join our team as Data Quality Analysts. This role sits at the center... ...closely with both people and AI systems — auditing outputs, supporting... ...or human-in-the-loop evaluation environmentsPrior experience auditing...Full timeContract workRemote workVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analyst (AI Evaluation). Be the first to apply!
- senior data analyst New York, NY
- lead data analyst New York, NY
- data entry analyst New York, NY
- senior data governance analyst New York, NY
- data analyst intern New York, NY
- provider data analyst New York, NY
- salesforce data analyst New York, NY
- sas data analyst New York, NY
- data analyst internship New York, NY
- information security analyst New York, NY




