Data Analysis Expert - Evaluator
$80 - $120 per hourPart-time
Mercor
Role Description
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while enhancing domain quality.
Qualifications
- 5+ years of relevant professional experience in Data analysis / quantitative readouts.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides.
- Advanced degree (Master's or higher) from a reputable institution (preferred).
Company Description
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in Remote vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work- Join to apply for the Data Evaluator/Analyst role at MELE Associates, Inc. MELE Associates, Inc. is seeking to add an experienced Data Evaluator... ...econometrics and statistical modeling, including regression analysis, panel data methods, and causal inference techniques....SuggestedContract workFor contractorsWork at officeRemote work
$40 per hour
...join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems... ...Evaluate AI-generated cybersecurity content, including threat analysis, vulnerability assessments, and offensive security techniques...SuggestedHourly payFull timePart timeRemote workDataAnnotation
Virginia, MN2 days ago$20 - $80 per hour
...real-world input. Key Responsibilities: Evaluate and score AI-generated responses using... ...subject areas. Annotate and categorize data sets to improve AI model accuracy and... ...evaluations. Engage in critical reading and analysis of complex subject matter ranging from...SuggestedHourly payContract workRemote workSaidGig
United States22 hours ago$40 per hour
...development firm in Michigan is seeking experienced quantitative professionals to evaluate AI-generated analyses and contribute to the evolution of AI models. Candidates should have a background in data science, statistics, or similar fields, with at least 2 years of...SuggestedHourly payRemote workDataAnnotation
Lansing, MI2 days ago$40 per hour
...A forward-thinking AI team is seeking quantitative professionals to evaluate and improve cutting-edge AI systems. The role involves working on AI-generated analyses and providing critical feedback for model enhancement. Candidates should have a strong quantitative background...Hourly payRemote workFlexible hoursDataAnnotation
Helena, MT3 days ago$40 per hour
...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated analysis and solve complex technical problems. Ideal candidates will have 2+ years in quantitative roles, knowledge of statistical methods, and experience with analytical...Hourly payRemote workFlexible hoursDataAnnotation
Oklahoma City, OK2 days ago$60 per hour
...work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems, and providing feedback that directly shapes how these systems reason about data, models, and scientific problems. Whether your background...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Kansas City, MO2 days ago$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analyses and design quantitative problems for AI training. This fully remote role offers flexibility in project selection and scheduling, with competitive pay starting...Hourly payRemote workDataAnnotation
Juneau, AK2 days ago$40 per hour
...A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis and provide impactful feedback. This fully remote role allows for flexible scheduling and competitive pay starting at $40 per hour. Candidates...Hourly payRemote workFlexible hoursDataAnnotation
Honolulu, HI3 days ago- ...San Francisco is looking for a Digital Forensic Analyst to focus on the preservation and collection of mobile device and cloud-stored data. The role is for full-time, mid-level professionals who have strong skills in forensic technologies. Successful candidates should be...Full timeRemote work
$40 per hour
...solutions company is seeking experienced quantitative professionals to evaluate AI-generated analyses and contribute to the development of... ...will have at least 2 years of experience in fields such as data science or statistics and strong coding skills. Join us to directly...Hourly payRemote workFlexible hoursDataAnnotation
Lincoln, NE2 days ago$60 per hour
...A tech-driven AI company is seeking experienced quantitative professionals to evaluate AI-generated analyses and improve AI reasoning capabilities. The role offers flexible remote work options and competitive hourly pay of up to $60 USD. Candidates should have 2+ years...Hourly payRemote workFlexible hoursDataAnnotation
Raleigh, NC2 days ago$40 per hour
...company is seeking experienced quantitative professionals to evaluate AI-generated analysis and provide technical feedback. This remote role allows... ...including the US. Ideal candidates will have a background in data science or related fields with coding experience....Hourly payRemote workDataAnnotation
Providence, RI22 hours ago$60 per hour
...ll work closely with state-of-the-art AI models on tasks like evaluating AI-generated security content, solving technical security problems... ...AI-generated cybersecurity content — including threat analysis, vulnerability assessments, and offensive security techniques...Remote jobHourly payFull timeFlexible hours$40 per hour
...development company is seeking experienced quantitative professionals to contribute to AI advancements. This fully remote role involves evaluating AI-generated analyses and ensuring they are technically accurate and valid in real-world scenarios. Candidates should have over 2...Hourly payRemote workFlexible hoursDataAnnotation
Santa Fe, NM3 days ago$14.5 per hour
Welo Data works with technology companies to provide datasets that... ...0,000 AI training and domain experts. Key Responsibilities... ...insights on relevance and quality. Evaluate and rate the effectiveness of... ...engine evaluation, or data analysis is a plus, but not essential....Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours$30 per hour
...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems... .... Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical roles....Remote jobHourly payContract work$50 - $60 per hour
...help train AI systems for finance professionals. This remote role offers flexible scheduling and requires expertise in financial analysis and reasoning. Ideal candidates should possess advanced degrees in finance and experience in areas such as investment banking or corporate...Remote jobHourly payPart timeFlexible hours- ...up to 29 hours per week, maintaining quality standards and meeting SLAs while using your online research skills. This role requires careful, data-driven analysis, adherence to an NDA, and the ability to work independently from a home office. #J-18808-Ljbffr aitrainerRemote jobPart timeWork from homeHome office
- Welocalize is seeking a Data Quality Associate in New York to evaluate AI model outputs and provide structured feedback. This full-time position requires native-level language proficiency and a university degree. You will contribute to improving evaluation frameworks while...Full timeRemote work
$56k - $84k
...mission is to serve the people of our communities. The Quality Evaluator is responsible for designing, implementing, and overseeing... .... The Quality Evaluator plays a critical role in data audit, analysis, and monitoring in order to interpret and inform agency leadership...Temporary workWork at officeLocal areaRemote work$40 per hour
...technology company seeks experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to advancing AI... .... Ideal candidates will have hands-on experience in fields like data science or statistics, with proficiency in coding and statistical...Hourly payRemote workDataAnnotation
Annapolis, MD3 days ago$40 per hour
...company is seeking experienced quantitative professionals to evaluate AI-generated quantitative analysis and solve technical problems. This fully remote role... .... The ideal candidate will have hands-on experience in data science, statistics, or similar fields, along with...Hourly payRemote workDataAnnotation
New York, NY2 days ago$40 per hour
A cutting-edge AI technology firm is looking for experienced quantitative professionals to evaluate AI-generated quantitative analyses and provide critical feedback that shapes future AI systems. This fully remote role allows for a flexible schedule and offers competitive...Hourly payRemote workFlexible hoursDataAnnotation
Phoenix, AZ2 days ago$40 per hour
...firm is seeking experienced quantitative professionals to evaluate AI-generated analysis, develop statistical methods, and provide insights. This remote... ...problem-solving and technical writing. Ideal for those in data science, statistics, or related fields, with a bachelor's...Hourly payRemote workFlexible hoursDataAnnotation
Phoenix, AZ2 days ago$40 per hour
...leading AI development firm is seeking experienced quantitative professionals to join their remote team. You will evaluate AI-generated quantitative analysis and solve complex problems to ensure technical accuracy. The ideal candidate should have at least 2 years of...Hourly payRemote workFlexible hoursDataAnnotation
Denver, CO1 day ago$71.6k - $119.4k
## Data Discovery and Enrichment Expert IIApplylocations: Raleigh, NCtime type: Full timeposted on: Posted... ...practices for creating training data and evaluating output of AI models and can execute... ...** * Performing legal research and analysis* Communicating actionable feedback...Full timeLocal areaRemote workFlexible hours$60 per hour
...A leading AI development company seeks experienced quantitative professionals to evaluate AI-generated analyses and solve quantitative problems. This fully remote position offers flexibility, competitive pay of up to $60 USD/hour, and the opportunity to shape the future...Remote workDataAnnotation
Phoenix, AZ2 days ago$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate and enhance AI systems remotely. Candidates will work on statistical analyses, predictive modeling and provide critical feedback to shape AI reasoning. A bachelor's degree in...Hourly payRemote workFlexible hoursDataAnnotation
Helena, MT3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
Related searches