Data Analysis Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model outputs. Collaborate with subject matter experts to ensure consistency and rigor in evaluations. Work...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY20 days ago$200k - $300k
...River Trading (HRT) is seeking a Research Data Expert to join our Data team. Data is a... ...business forward through rigorous data analysis and delivery. You will also manage the full... ...with the sourcing team to identify and evaluate new data procurement opportunitiesAnalyze...SuggestedWork at officeLocal areaImmediate startHudson River Trading
New York, NY20 hours ago$70 - $120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Analysis Expert Type: Contract Compensation: $70–$120/hour Location: Remote Role Responsibilities Write analysis...SuggestedContract workSummer workRemote workMercor
New York, NY25 days ago- Product Hackers busca un Digital Analyst remoto para liderar la estrategia de experimentación y análisis de datos en cuentas de gran volumen, apoyándote en Adobe (Target, Analytics y Launch). Facilitarás decisiones de negocio por medio de insights y gestión de tests, manteniendo...SuggestedRemote job
$80 per hour
...tools Track record of turning data into reports stakeholders act... ...About Ethos Ethos is a new expert network built by a McKinsey/SoftBank... ...a dashboard versus a one-off analysis? A dashboard metric needs to... ...on real domain judgment (evaluating outputs, correcting errors,...SuggestedHourly payPermanent employmentRemote workFlexible hoursEthos
New York, NY1 day ago$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Legal Expert — Data Privacy and Cybersecurity Type: Contract Compensation... ...agreements, consent and notice design, and cross-border transfer analysis. Conduct incident response reviews, each involving 10-100...Contract workSummer workRemote workMercor
New York, NY5 days ago$120 - $170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation:... ...testing , metric definition, SQL/Python analysis, and communicating findings to... ...Prior experience with AI training , evaluation, or human-data projects. Application...Contract workSummer workRemote workMercor
New York, NY27 days ago$150 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract Compensation:... ...work , machine learning pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria...Remote jobContract workSummer workMercor
New York, NY10 days ago$55 - $60 per hour
...transformative online education in data science, UI/UX design,... ...with fellow students, industry-expert mentors, student advisors,... ...Excel, statistics, financial analysis, visualization, reporting, SQL... ...analytics workflows, including evaluation of AI-generated outputs for...$60 - $90 per hour
..., Larry Summers , and Jack Dorsey . Position: Data Science & Quantitative Analysis Expert Type: Contract Compensation: $60–$90/hour... ...involve spot checks and provide clear recommendations. Evaluate model performance on tasks, ensuring statistics and...Contract workSummer workRemote workMercor
New York, NY15 days ago$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies... ...over 500,000 AI training and domain experts. As a Web Search Evaluator you... ..., search engine evaluation, or data analysis is a plus, but not essential. Surf...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY3 days ago- Judi Health seeks a Senior Business Analyst to gather and document business and reporting requirements aligned with state and federal guidelines. You will analyze complex problems, produce specification documents, and support QA and validation activities across government...
- ...Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials... ...validation Citation review Quantitative analysis Materials science Science and advanced mathematics AI evaluation Rubric writing Expert review Work model Remote — US-eligible....Hourly payFor contractorsRemote work10 hours per week
AuraOne, Inc.
New York, NY20 hours ago $50 - $60 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Analysts & Spreadsheet Specialists (Must own MacBook) Type:... ...week Role Responsibilities Complete and narrate real data analysis and spreadsheet tasks on your Mac to create high-quality training...Full timeContract workSummer workInternshipImmediate startRemote workMercor
New York, NY16 days ago$80 - $160 per hour
...Dorsey . Position: Analyst / Insights Experts Type: Contract Compensation:... ...analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously... ...flexible hours. Enhance document analysis using Excel , PowerPoint , and Word...Contract workSummer workRemote workFlexible hoursMercor
New York, NY27 days ago- ...Scheming Behavior Risk Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft... ...language attack testing. Skills Adversarial prompting Red-team analysis Policy taxonomy Failure documentation Scheming Behavior Risk...Hourly payFor contractorsRemote work10 hours per week
AuraOne, Inc.
New York, NY2 hours ago - ...Job Description Job Description Senior Data Specialist Employment Type: Full-Time,... ...checks of loads. - Develops, evaluates and modifies methodologies and procedures... ..., database loads and retrieval, and data analysis. Our Commitment: Contact Government...Full timeFor contractorsFlexible hours
Contact Government Services, LLC
New York, NY13 days ago $20 - $50 per hour
...Help refine and improve quality processes, checklists, and evaluation criteria. Collaborate asynchronously with a distributed team... ...and a quiet, focused workspace. Preferred Familiarity with data annotation, content review, or evaluation workflows. Experience...Contract workSummer workRemote workMercor
New York, NY24 days ago- ...source handling, reasoning, and uncertainty. Strong communication and analytic rigor are essential to advance evaluation methodologies. The position emphasizes all-source analysis, structured techniques, and the ability to articulate model limitations. #J-18808-Ljbffr...For contractorsRemote work
Executive Staff Recruiters / ESR Healthcare
New York, NY3 days ago $22 - $27 per hour
...daily tasks, overall responsibilities, and required experience for this opportunity by scrolling down now. We're looking for a Data Migration Assistant to help move our teams' work from into Airtable. You'll take years of product, licensing, and production records...Hourly payTemporary workPart timeCultureFly
New York, NY11 days ago$30 per hour
...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems... .... Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical roles....Remote jobHourly payContract work- A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring performance, and providing feedback. Qualified candidates will have deep expertise in soccer, strong analytical and communication skills...Contract work
- Remotebridge is seeking a Tamil bilingual expert for a remote contractor role focused on... ...knowledge will help train models by evaluating Tamil audio, assessing pronunciation and... ...position emphasizes careful linguistic analysis, clear documentation, and collaboration...Remote jobContract workFor contractors
$125.1k - $208.5k
Evaluator, Securitized Products page is loaded## Evaluator, Securitized... ...Gdynia, and Costa Rica. Our expert evaluators apply consistent... ...incorporating observable market data and standard market... ...client statements, research, risk analysis, and portfolio value.**Responsibilities...Part timeInternship- ...remote, hourly contractor role, you will evaluate AI-generated financial content and develop... ...scenarios, including cross-referencing data across balance sheets, reports, and operational... ...practical financial operations and data analysis, including Excel-based evaluation tasks...Remote jobHourly payFull timeFor contractors
- ...Description Job Description Job Title Prompt Evaluator Location Hybrid / Remote... ...engineers, prompt engineers, product teams, and data scientists to optimize AI system... ...LangSmith, Promptfoo) Spreadsheet and data analysis tools (Excel, Google Sheets) Data visualization...Full timeRemote work
Ova Technologies
New York, NY7 days ago $30 - $49 per hour
AI Generalist Digital Workflow Evaluator Review AI-generated outputs and workflow screenshots, apply project guidelines, and write clear... ...to $80 per hour and requires professional defense or conflict analysis experience. Review AI-generated ground-combat scenarios,...Hourly payContract workPart timeFor contractorsRemote workFlexible hours$77k - $214k
...SummaryThe OpportunityAs a Tax Innovation - Data Governance Senior Associate, you will... ...facilitate efficient data processing and analysis. You will be responsible for developing and... ...closely with team members. We evaluate these factors thoughtfully to establish a...Full timeH1bPwC
New York, NY2 days ago$77k - $202k
...Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to... ...their strategic goals.In Deals; data analysis at PwC, you will focus on utilising advanced... ...analytics and emerging technologies to evaluate investment opportunities, assess risk, and...Full timeH1bPwC
New York, NY1 day ago$81.15k - $137.95k
Title: Senior Transportation Data SpecialistLocation: Washington, DC or New... ...planning, research, policy analysis, outreach, training, and program evaluation for Federal, State, and local governments... ...staff, and internal and external experts in their field of expertise....Full timeContract workWork experience placementWork at officeLocal areaICF
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
Related searches
- data associate New York, NY
- data conversion specialist New York, NY
- data visualization specialist New York, NY
- data migration specialist New York, NY
- oncology data specialist New York, NY
- data science associate New York, NY
- data integration specialist New York, NY
- data management associate New York, NY
- data management specialist New York, NY
- data operations specialist New York, NY