Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analyst (AI Evaluation)

Full-time

jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Analyst (AI Evaluation) based in the United States.

This is a remote contractor opportunity for a detail-oriented data professional contributing directly to the development and evaluation of next-generation AI systems. You will review datasets and task outputs to assess accuracy, completeness, consistency, and adherence to detailed evaluation criteria. Your analytical judgment will help identify errors, inconsistencies, and recurring quality issues that can influence how AI models learn and perform. The role combines structured data review with critical thinking, requiring you to make well-reasoned decisions when guidelines are incomplete or situations are ambiguous. You will work with high volumes of data while maintaining exceptional attention to detail and consistency. Clear documentation and actionable feedback will be essential to helping improve data quality and evaluation processes. No previous AI experience is required, making this an opportunity to apply your existing analytical expertise to an emerging technology environment.

Accountabilities:

  • Review datasets and detailed task outputs systematically to assess accuracy, completeness, consistency, and compliance with established guidelines.
  • Identify, document, and flag errors, inconsistencies, omissions, and outputs that do not meet specified requirements.
  • Apply structured evaluation rubrics and quality criteria consistently across large volumes of data and review assignments.
  • Use sound analytical judgment to evaluate ambiguous cases, interpret available guidance, and make defensible decisions when instructions are incomplete.
  • Provide clear written and verbal feedback that precisely identifies issues, explains their impact, and recommends appropriate resolution paths.
  • Identify recurring patterns, systemic data-quality issues, and trends that require escalation or further investigation rather than isolated correction.
  • Maintain a high level of accuracy and consistency while completing repetitive, high-volume data review tasks.
  • Follow detailed procedures and quality standards carefully while adapting to evolving project requirements and evaluation guidelines.

Requirements:

  • Bring 3–5+ years of experience in data analysis, data review, data quality, quality assurance, or another analytical discipline.
  • Demonstrate proven experience reviewing, validating, auditing, or critiquing data, deliverables, or other structured outputs against defined criteria.
  • Possess an exceptional ability to follow detailed written instructions and apply complex evaluation rubrics accurately and consistently.
  • Demonstrate strong analytical reasoning and the ability to make well-supported decisions in situations where guidelines may be incomplete or ambiguous.
  • Have excellent attention to detail and a proven ability to identify subtle errors, inconsistencies, and quality issues across high-volume work.
  • Possess strong written and verbal communication skills, particularly for documenting findings, explaining rationale, and providing actionable feedback.
  • Be highly organized and capable of maintaining consistent quality and productivity across repetitive assignments.
  • Demonstrate strong independent judgment, reliability, and the ability to work effectively in a remote environment.
  • Have baseline proficiency with spreadsheets, including sorting, filtering, and simple formulas.
  • Experience with SQL, data querying, or other analytical tools is a plus.
  • Prior experience working with artificial intelligence or machine learning is not required; strong domain expertise and analytical judgment are the primary focus.

Benefits:

  • Remote contractor opportunity with flexible participation in AI-focused data quality projects.
  • Opportunity to apply existing data and analytical expertise to the development and evaluation of next-generation AI systems.
  • Direct contribution to improving how AI models learn, reason, and perform through high-quality real-world data and evaluation.
  • No prior artificial intelligence experience required.
  • Opportunity to work on emerging AI initiatives while leveraging established professional expertise.
  • Competitive and attractive compensation package.
  • The contractor nature of the role provides an opportunity to contribute to project-based work remotely.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Analyst (AI Evaluation) in United States vacancy
  • $70 - $120 per hour

     ...Role Overview Apply your data judgment to help evaluate and improve advanced AI systems. Your professional standards and subject-matter expertise will inform the reference criteria used to assess AI-generated analysis. This is an ongoing talent-pool listing for analytics... 
    Suggested
    Hourly pay
    Immediate start
    Remote work

    SaidGig

    United States
    17 days ago
  • $30 - $60 per hour

     ...Role Overview Help improve next generation AI systems by applying analytical judgment to high quality data reviews and evaluations. This remote, US based contract role focuses on assessing real world data and task outputs so AI models can learn, reason, and perform more... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    Remote
    4 days ago
  •  ...ambitious Product bets: building an AI-powered product that transforms how clients interact with data. This initiative sits at the...  ...As a Senior Data Product Analyst, you will play a pivotal role...  ...products, LLM-based agents, or evaluation frameworks is a strong plus.... 
    Suggested
    Remote work
    Visa sponsorship
    Flexible hours

    YipitData

    United States
    2 days ago
  • $65k - $70k

    Per Scholas is looking for a Data & Evaluation Analyst to manage and analyze learner data effectively. The ideal candidate will be responsible for designing and maintaining Salesforce reports and dashboards, as well as responding to data requests across the organization... 
    Suggested
    Full time

    Per Scholas

    Columbus, OH
    2 days ago
  • $95k - $120k

     ...Description Enterprise Knowledge (EK) is hiring a full-time AI and Data Product Analyst to join our growing Semantic Engineering and AI Practice....  ...your information with third parties only as necessary to evaluate your application or comply with legal requirements. If we... 
    Suggested
    Full time
    For contractors
    Internship
    H1b
    Work at office
    3 days per week

    Enterprise Knowledge

    Arlington, VA
    a month ago
  • $35 - $42 per hour

    Test & Evaluation Lab Tech - Civil, Electrical, & Mechanical Engineering...  .... Conducts tests, analyzes data and documents results; participates...  ...#3 by Staffing Industry Analysts (SIA, 2024) One of the Largest...  ..., you agree to receive calls, AI-generated calls, text messages... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work experience placement
    Immediate start
    Worldwide
    Flexible hours

    MassGenics, Inc.

    Seattle, WA
    1 day ago
  •  ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise... 
    Hourly pay
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    21 hours ago
  •  ...detail-oriented Business Intelligence / Data Analyst basis to support our data analytics, customer...  ...Conduct customer case study research to evaluate operational performance and customer...  ...and product engagement modeling Using AI models to generat e verify and confirm financial... 
    Contract work

    Buckstop Industries Inc.

    Washington DC
    2 days ago
  •  ...specializing in evidence-based policy, data and information systems. For...  .... DevTech seeks a Data Analyst and Visualization Specialist...  ...(FAO) Bureau’s Data and AI team in support of the Department...  ...basis for any subsequent employee evaluations. Incumbents will follow any... 
    Contract work
    For contractors
    Work at office
    Remote work

    DevTech Systems, Inc.

    Washington DC
    a month ago
  • $80 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Analyst / Insights Experts Type: Contract...  ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously... 
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    New York, NY
    3 days ago
  • $50k - $53.92k

     ...Requisition No: 883784 Agency: Department of Health Working Title: Data and Evaluation Analyst - 64034493 Pay Plan: Career Service Position Number: 64034493 Salary: $50,000.00 - $53,916.98 Posting Closing Date: 10/12/2026 Total Compensation... 
    Full time
    Work at office
    Flexible hours

    State of Florida

    Tallahassee, FL
    1 day ago
  • $20k

     ...a Titan? ServiceTitan is looking for a Data Quality Analyst to join our Data Engineering department...  ...will work directly with a customer when evaluating new software to review the data in its...  ...together. Come be human, with us. Use of AI Technology: We use technology,... 
    Minimum wage
    Local area
    Flexible hours
    Shift work

    ServiceTitan

    Oregon State
    12 hours ago
  • $27 per hour

     ...passionate about technology, language, and data quality? We're seeking Hungarian...  ...individuals may support data quality, content evaluation, and AI-related initiatives that help improve...  ...technology programs. Data Quality Analyst - Hungarian Language Specialist... 
    Weekly pay
    Contract work
    Remote work
    Flexible hours

    Experis/Manpower Group

    Redmond, WA
    3 days ago
  •  ...Description We are seeking an experienced MDM Data Quality Analyst to support Master Data Management...  ...from internal and external sources to evaluate and demonstrate effectiveness and...  ...initiatives. ·        Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering... 
    Remote work

    CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

    Frisco, TX
    a month ago
  • $38 per hour

     ...Project Details Job Title: Data Quality Analyst Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale...  ...guidelines and priorities ~ Experience in AI/ML data workflows or human-in-the-loop evaluation environments ~ Prior experience auditing or reviewing... 
    Full time
    Contract work
    Visa sponsorship

    Welo Data

    Los Angeles, CA
    more than 2 months ago
  •  ...: At CSpring, we believe in the power of data to drive decisions and real-world impact....  ...information from internal and external sources to evaluate and demonstrate effectiveness and...  ...modernization initiatives. Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for... 
    Remote work

    CSpring

    Springfield, IL
    a month ago
  •  ...foundational understanding of machine learning, data annotation, quality assurance, and...  ...rating guidelines. Model Training and Evaluation: Initiate model training processes using...  ...provider of translation, localization, and AI-driven content solutions, helping... 
    Full time

    Welocalize

    San Francisco, CA
    4 days ago
  •  ...investment funds. LBA is hiring a Data Applications & Analytics Analyst to support the business applications...  ...IT. Reporting, integrations, and AI / automation work are part of the role...  ...and reporting productivity. Help evaluate and implement AI-enabled tools where... 
    Full time
    Work experience placement
    Work at office

    LBA Logistics | LBA Properties

    Irvine, CA
    more than 2 months ago
  • $85k - $184k

     ...The Data Quality Analyst will monitor and ensure data integrity and accuracy across the Advana platform...  ...quality principles and practices, and evaluate data quality tools for potential...  ...Please send your request to ****@*****.***.ai. Avalore is an Equal Opportunity Employer... 
    Full time
    Contract work
    Temporary work
    Work at office
    Visa sponsorship
    Work visa

    Avalore.ai

    Arlington, VA
    3 days ago
  •  ...technical teams Investigate data issues, validate data accuracy...  ..., and validation testing Evaluate business requirements and determine...  ...is seeking a Senior Data Analyst for a leading media and advertising...  ...similar data quality tools AI experience or leveraging AI to... 

    Insight Global

    Palmyra, MO
    2 days ago
  • $195k - $275k

     ...financial industry experience to join a data analytics and artificial intelligence team...  ...expanding its capabilities in quantitative AI, combining advanced statistical methods...  ...advanced statistical approaches to support evaluation, monitoring, and continuous improvement... 
    Full time
    Temporary work

    Morgan Stanley

    New York, NY
    more than 2 months ago
  •  ...York, NY   Our client seeks a Senior Data Operations Analyst to maintain and improve a centralized...  ...utilizes artificial intelligence (AI) tools as part of its initial application...  ...of the position. All AI-assisted evaluations and responses are reviewed by human recruiters... 
    Hourly pay
    Contract work
    Local area

    Eliassen Group

    West Hollywood, CA
    13 days ago
  • Welo Data is looking for a Data Labeling Associate in San Francisco to evaluate AI systems' handling of Arabic nuances. The role requires professional-level proficiency in Arabic and 2 years of AI safety experience. Responsibilities include critiquing Arabic AI outputs... 

    Welo Data

    San Francisco, CA
    1 day ago
  • Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance... 
    Remote job
    Full time

    Rex.zone

    Seattle, WA
    21 hours ago
  • $46.8 - $57.19 per hour

     ...is a San Diego, California, USA-based AI company creating transformative core technology...  .... Position Overview The Senior Data Operations Analyst owns the hands-on work behind our...  ...& Initiative Support Apply data to evaluate and improve operational workflows, identifying... 
    Hourly pay
    Temporary work
    Work experience placement
    Work at office
    Immediate start
    Flexible hours
    Night shift

    BRAIN CORP

    San Diego, CA
    2 days ago
  • About The Role Hippocratic AI is looking for a Senior Product Data Analyst to shape product strategy and measure the clinical, operational, and financial...  ...what already exists. Design analytical approaches to evaluate product changes and program impact, including in real... 
    Work at office

    Hippocratic AI

    Menlo Park, CA
    3 days ago
  • $77.5k - $176k

    Data Analyst, LeadThe Opportunity:As data analyst, you love diving into data and turning it into...  ...through collection, interpretation, evaluation, and analysis of large data sets.Contribute...  ...identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work
    Worldwide

    Booz Allen Hamilton

    Tallahassee, FL
    4 days ago
  •  ...Koch Engineered Solutions is seeking a Data Product Analyst for the ET&S data delivery team. The role...  ...work. Partner with stakeholders to evaluate, document, and prioritize new governance...  ...organizations. Experience leveraging generative AI to streamline workflows and improve... 
    Flexible hours

    Koch Engineered Solutions

    Wichita, KS
    4 days ago
  •  ...world. We are looking for a Senior Product Data Analyst to join the Product DA team, partnering...  ...and analytical toolkits Design and evaluate A/B experiments end-to-end: hypothesis...  ...related to Blockchain, Machine Learning and AI Bilingual English/Mandarin is... 
    Full time
    Work experience placement
    Work from home
    Overseas

    Binance

    Remote
    5 days ago
  •  ...client has an opportunity for a Product Data Analyst to support Stock Plan Services Customer...  ...Group utilizes artificial intelligence (AI) tools as part of its initial application...  ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human... 
    Hourly pay
    Local area

    Eliassen Group

    Westlake, TX
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analyst (AI Evaluation). Be the first to apply!