Data Analyst (AI Evaluation)
jobgether
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Analyst (AI Evaluation) based in the United States.
This is a remote contractor opportunity for a detail-oriented data professional contributing directly to the development and evaluation of next-generation AI systems. You will review datasets and task outputs to assess accuracy, completeness, consistency, and adherence to detailed evaluation criteria. Your analytical judgment will help identify errors, inconsistencies, and recurring quality issues that can influence how AI models learn and perform. The role combines structured data review with critical thinking, requiring you to make well-reasoned decisions when guidelines are incomplete or situations are ambiguous. You will work with high volumes of data while maintaining exceptional attention to detail and consistency. Clear documentation and actionable feedback will be essential to helping improve data quality and evaluation processes. No previous AI experience is required, making this an opportunity to apply your existing analytical expertise to an emerging technology environment.
Accountabilities:
- Review datasets and detailed task outputs systematically to assess accuracy, completeness, consistency, and compliance with established guidelines.
- Identify, document, and flag errors, inconsistencies, omissions, and outputs that do not meet specified requirements.
- Apply structured evaluation rubrics and quality criteria consistently across large volumes of data and review assignments.
- Use sound analytical judgment to evaluate ambiguous cases, interpret available guidance, and make defensible decisions when instructions are incomplete.
- Provide clear written and verbal feedback that precisely identifies issues, explains their impact, and recommends appropriate resolution paths.
- Identify recurring patterns, systemic data-quality issues, and trends that require escalation or further investigation rather than isolated correction.
- Maintain a high level of accuracy and consistency while completing repetitive, high-volume data review tasks.
- Follow detailed procedures and quality standards carefully while adapting to evolving project requirements and evaluation guidelines.
Requirements:
- Bring 3–5+ years of experience in data analysis, data review, data quality, quality assurance, or another analytical discipline.
- Demonstrate proven experience reviewing, validating, auditing, or critiquing data, deliverables, or other structured outputs against defined criteria.
- Possess an exceptional ability to follow detailed written instructions and apply complex evaluation rubrics accurately and consistently.
- Demonstrate strong analytical reasoning and the ability to make well-supported decisions in situations where guidelines may be incomplete or ambiguous.
- Have excellent attention to detail and a proven ability to identify subtle errors, inconsistencies, and quality issues across high-volume work.
- Possess strong written and verbal communication skills, particularly for documenting findings, explaining rationale, and providing actionable feedback.
- Be highly organized and capable of maintaining consistent quality and productivity across repetitive assignments.
- Demonstrate strong independent judgment, reliability, and the ability to work effectively in a remote environment.
- Have baseline proficiency with spreadsheets, including sorting, filtering, and simple formulas.
- Experience with SQL, data querying, or other analytical tools is a plus.
- Prior experience working with artificial intelligence or machine learning is not required; strong domain expertise and analytical judgment are the primary focus.
Benefits:
- Remote contractor opportunity with flexible participation in AI-focused data quality projects.
- Opportunity to apply existing data and analytical expertise to the development and evaluation of next-generation AI systems.
- Direct contribution to improving how AI models learn, reason, and perform through high-quality real-world data and evaluation.
- No prior artificial intelligence experience required.
- Opportunity to work on emerging AI initiatives while leveraging established professional expertise.
- Competitive and attractive compensation package.
- The contractor nature of the role provides an opportunity to contribute to project-based work remotely.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
$70 - $120 per hour
...Role Overview Apply your data judgment to help evaluate and improve advanced AI systems. Your professional standards and subject-matter expertise will inform the reference criteria used to assess AI-generated analysis. This is an ongoing talent-pool listing for analytics...SuggestedHourly payImmediate startRemote work$30 - $60 per hour
...Role Overview Help improve next generation AI systems by applying analytical judgment to high quality data reviews and evaluations. This remote, US based contract role focuses on assessing real world data and task outputs so AI models can learn, reason, and perform more...SuggestedHourly payContract workFor contractorsRemote work- ...ambitious Product bets: building an AI-powered product that transforms how clients interact with data. This initiative sits at the... ...As a Senior Data Product Analyst, you will play a pivotal role... ...products, LLM-based agents, or evaluation frameworks is a strong plus....SuggestedRemote workVisa sponsorshipFlexible hours
$65k - $70k
Per Scholas is looking for a Data & Evaluation Analyst to manage and analyze learner data effectively. The ideal candidate will be responsible for designing and maintaining Salesforce reports and dashboards, as well as responding to data requests across the organization...SuggestedFull time$95k - $120k
...Description Enterprise Knowledge (EK) is hiring a full-time AI and Data Product Analyst to join our growing Semantic Engineering and AI Practice.... ...your information with third parties only as necessary to evaluate your application or comply with legal requirements. If we...SuggestedFull timeFor contractorsInternshipH1bWork at office3 days per week$35 - $42 per hour
Test & Evaluation Lab Tech - Civil, Electrical, & Mechanical Engineering... .... Conducts tests, analyzes data and documents results; participates... ...#3 by Staffing Industry Analysts (SIA, 2024) One of the Largest... ..., you agree to receive calls, AI-generated calls, text messages...Hourly payFull timeContract workTemporary workWork experience placementImmediate startWorldwideFlexible hours- ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise...Hourly payWork at officeRemote work
- ...detail-oriented Business Intelligence / Data Analyst basis to support our data analytics, customer... ...Conduct customer case study research to evaluate operational performance and customer... ...and product engagement modeling Using AI models to generat e verify and confirm financial...Contract work
- ...specializing in evidence-based policy, data and information systems. For... .... DevTech seeks a Data Analyst and Visualization Specialist... ...(FAO) Bureau’s Data and AI team in support of the Department... ...basis for any subsequent employee evaluations. Incumbents will follow any...Contract workFor contractorsWork at officeRemote work
$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Analyst / Insights Experts Type: Contract... ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously...Contract workSummer workRemote workFlexible hours$50k - $53.92k
...Requisition No: 883784 Agency: Department of Health Working Title: Data and Evaluation Analyst - 64034493 Pay Plan: Career Service Position Number: 64034493 Salary: $50,000.00 - $53,916.98 Posting Closing Date: 10/12/2026 Total Compensation...Full timeWork at officeFlexible hours$20k
...a Titan? ServiceTitan is looking for a Data Quality Analyst to join our Data Engineering department... ...will work directly with a customer when evaluating new software to review the data in its... ...together. Come be human, with us. Use of AI Technology: We use technology,...Minimum wageLocal areaFlexible hoursShift work$27 per hour
...passionate about technology, language, and data quality? We're seeking Hungarian... ...individuals may support data quality, content evaluation, and AI-related initiatives that help improve... ...technology programs. Data Quality Analyst - Hungarian Language Specialist...Weekly payContract workRemote workFlexible hours- ...Description We are seeking an experienced MDM Data Quality Analyst to support Master Data Management... ...from internal and external sources to evaluate and demonstrate effectiveness and... ...initiatives. · Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering...Remote work
$38 per hour
...Project Details Job Title: Data Quality Analyst Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale... ...guidelines and priorities ~ Experience in AI/ML data workflows or human-in-the-loop evaluation environments ~ Prior experience auditing or reviewing...Full timeContract workVisa sponsorship- ...: At CSpring, we believe in the power of data to drive decisions and real-world impact.... ...information from internal and external sources to evaluate and demonstrate effectiveness and... ...modernization initiatives. Exposure to automation, AI/ML, GenAI, or LLM-assisted engineering for...Remote work
- ...foundational understanding of machine learning, data annotation, quality assurance, and... ...rating guidelines. Model Training and Evaluation: Initiate model training processes using... ...provider of translation, localization, and AI-driven content solutions, helping...Full time
- ...investment funds. LBA is hiring a Data Applications & Analytics Analyst to support the business applications... ...IT. Reporting, integrations, and AI / automation work are part of the role... ...and reporting productivity. Help evaluate and implement AI-enabled tools where...Full timeWork experience placementWork at office
$85k - $184k
...The Data Quality Analyst will monitor and ensure data integrity and accuracy across the Advana platform... ...quality principles and practices, and evaluate data quality tools for potential... ...Please send your request to ****@*****.***.ai. Avalore is an Equal Opportunity Employer...Full timeContract workTemporary workWork at officeVisa sponsorshipWork visa- ...technical teams Investigate data issues, validate data accuracy... ..., and validation testing Evaluate business requirements and determine... ...is seeking a Senior Data Analyst for a leading media and advertising... ...similar data quality tools AI experience or leveraging AI to...
$195k - $275k
...financial industry experience to join a data analytics and artificial intelligence team... ...expanding its capabilities in quantitative AI, combining advanced statistical methods... ...advanced statistical approaches to support evaluation, monitoring, and continuous improvement...Full timeTemporary work- ...York, NY Our client seeks a Senior Data Operations Analyst to maintain and improve a centralized... ...utilizes artificial intelligence (AI) tools as part of its initial application... ...of the position. All AI-assisted evaluations and responses are reviewed by human recruiters...Hourly payContract workLocal area
- Welo Data is looking for a Data Labeling Associate in San Francisco to evaluate AI systems' handling of Arabic nuances. The role requires professional-level proficiency in Arabic and 2 years of AI safety experience. Responsibilities include critiquing Arabic AI outputs...
- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model performance...Remote jobFull time
$46.8 - $57.19 per hour
...is a San Diego, California, USA-based AI company creating transformative core technology... .... Position Overview The Senior Data Operations Analyst owns the hands-on work behind our... ...& Initiative Support Apply data to evaluate and improve operational workflows, identifying...Hourly payTemporary workWork experience placementWork at officeImmediate startFlexible hoursNight shift- About The Role Hippocratic AI is looking for a Senior Product Data Analyst to shape product strategy and measure the clinical, operational, and financial... ...what already exists. Design analytical approaches to evaluate product changes and program impact, including in real...Work at office
$77.5k - $176k
Data Analyst, LeadThe Opportunity:As data analyst, you love diving into data and turning it into... ...through collection, interpretation, evaluation, and analysis of large data sets.Contribute... ...identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work...Full timeContract workPart timeWork at officeLocal areaRemote workWorldwide- ...Koch Engineered Solutions is seeking a Data Product Analyst for the ET&S data delivery team. The role... ...work. Partner with stakeholders to evaluate, document, and prioritize new governance... ...organizations. Experience leveraging generative AI to streamline workflows and improve...Flexible hours
- ...world. We are looking for a Senior Product Data Analyst to join the Product DA team, partnering... ...and analytical toolkits Design and evaluate A/B experiments end-to-end: hypothesis... ...related to Blockchain, Machine Learning and AI Bilingual English/Mandarin is...Full timeWork experience placementWork from homeOverseas
- ...client has an opportunity for a Product Data Analyst to support Stock Plan Services Customer... ...Group utilizes artificial intelligence (AI) tools as part of its initial application... ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human...Hourly payLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analyst (AI Evaluation). Be the first to apply!
- logistics data analyst United States
- remote data analyst intern United States
- sales reporting analyst United States
- jr data analyst United States
- senior healthcare data analyst United States
- lead data analyst United States
- data analyst no experience United States
- data analyst intern United States
- data analyst United States
- senior data analyst United States



