Analytical Evaluator - AI Feedback - AI Trainer
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply strict attention to detail and accurate application of structured evaluation guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools .
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...defensible scores. Incorporate structured feedback from senior reviewers and iterate quickly... ...Work independently and asynchronously to evaluate and improve AI model performance ....SuggestedContract workSummer workRemote work$110.7k - $218.3k
...relationships with customers through innovative strategies, advanced analytics, Generative AI, transformative technologies, and creative design. We can... ...data, dashboards, automations, and logic for enterprise feedback programs.Building secure integrations between Qualtrics and...SuggestedLocal area$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... ...ETL pipelines , data warehouses , analytics platforms , and distributed data systems...SuggestedContract workSummer workRemote work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate the quality, correctness, and... .... Provide clear, rubric-based written feedback to improve AI model performance . Review...SuggestedContract workSummer workRemote work- ...Brothers , America's leading luxury home builder, seeks an Data Analytics Engineer to join our team at our Corporate office in Fort... ...models, interactive applications built with Streamlit or React, and AI-powered capabilities that make governed enterprise data more accessible...SuggestedWork at officeLocal areaShift work3 days per week
- ...Data Analytics Engineer Toll Brothers, America's leading luxury home builder, seeks a Data Analytics Engineer to join our team at our... ...models, interactive applications built with Streamlit or React, and AI-powered capabilities that make governed enterprise data more...Work at officeShift work3 days per week
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Media / journalism / communications Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback. Work independently and asynchronously...Contract workSummer workWork at officeRemote work$41 per hour
...for 2026 by Forbes, ranking among the top 200 in the nation. Visit CooperHealth.org to learn more.Short DescriptionThe Financial Analytics Developer will create reports, data visualizations and analytical solutions that deliver actionable information to business leaders...$52 per hour
...Employers for 2026 by Forbes, ranking among the top 200 in the nation. Visit CooperHealth.org to learn more.Short DescriptionThe Advanced Analytics Developer will lead the creation of innovative analytical solutions that deliver actionable information to business leaders. He/...- ...Job Description Job Description Job: Analytics Engineer II Duration: 6+ Months Location: Philadelphia, Pennsylvania (Remote... ...analytical and problem-solving skills, with the ability to evaluate tradeoffs and recommend optimal modeling approaches. Preferred...Remote work
- ...immediate everyday needs with products ranging from snacks and ice cream to household goods and beer, at the click of a button. As an Analytics Engineer at Gopuff, you'll build and maintain the bridge between our data and the rest of the organization. This role sits on the...Full timeImmediate start
$100k - $125k
...to household goods and beer, at the click of a button. As an Analytics Engineer at Gopuff, you'll build and maintain the bridge between... ...systems such as JustEnough or Kinaxis. Comfort working with AI-assisted development tools. We use assistants like Claude in our...Temporary workImmediate startFlexible hours$118.3k - $219.8k
Principal Analytics Engineer - Global Reporting & AnalyticsAbout the TeamThe Global Reporting and Analytics team sits within the Clinical... ...time. Champion opportunities to bring more coding, automation, and AI tooling into the analytics team's work — prototyping new...Full timeLocal areaImmediate startWork from homeFlexible hours$55 - $80 per hour
...jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...meet deadlines and improve AI model performance.Provide structured feedback to elevate training data quality and downstream performance....Contract workSummer work$40 - $125 per hour
...Job Description Remote AI Trainer, Data Science Contract | Part... ...by running your tasks and evaluating the analyses, code, models,... ...science experience preferred (analytics, ML, statistical modeling, experimentation... ..., office hours, expert feedback, and a path into reviewer...Remote jobHourly payFull timeContract workPart timeWork at officeFlexible hours- ...supports a suite of internal CX analytical tools. These Data Science... ...Python packages, integration of AI into code (both in... ...using quantified measures to evaluate text, developing models around... ...Packages that include telemetry feedback, safeguards, secure credentialing...Full timeWork experience placement
$176k - $179.5k
...on the global Life Sciences AI team, fully integrated with QuantumBlack... ...an environment where feedback is clear, actionable, and... ...create differentiated advanced analytics and agentic solutions that address... ..., design agentic flows, evaluate agentic outputs, write optimized...ApprenticeshipWorldwideEasy work$124k - $280k
...SummaryThe OpportunityAs an AI & GenAI Data Scientist - Senior... ...you will leverage advanced analytics, statistical modeling, and data... ...scalable solution delivery- Evaluating model performance, testing assumptions... ...based on findings and client feedback- Communicating analytic...Full timeH1b- ...pipelines and data models on AWS that make high-quality, analytics-ready data available to our AI and Analytics teams. This role will own ingestions,... ...training and scoring, production monitoring, and business feedback loops.Key Responsibilities: Design, implement, and...For subcontractorFlexible hours
$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate the functionality and performance of Premiere... ...improve AI model performance . Provide feedback on Premiere usability and integration...Contract workSummer workRemote work$176k - $179.5k
...20Apply: be on the global Life Sciences AI team, fully integrated with QuantumBlack,... ...grow while creating an environment where feedback is clear, actionable, and focused on your... ...deliver, and deploy differentiated advanced analytics and agentic solutions that address high-...ApprenticeshipEasy workShift work- ...Engineering, Data Science, and Strategic Analytics. Data Science owns the modeling work that... ...customer-facing surfaces, and tightening the feedback loops between our credit-reporting... ...it cleanly without your involvement. AI Policy Each application is carefully...Odd jobFull timeWork at office
$116.2k - $229.1k
Position Summary Data-driven organizations need modern cloud analytics solutions that turn information into insight and action. As a Sr... ...Work you'll do As a Sr Consultant, GCP Cloud Analytics on the AI & Data team, you will be responsible for: Designing and...Local areaVisa sponsorship$119k - $299.93k
...Opportunity As part of the AI Engineering team within the... ...streams and teams for testing and evaluation of AI-enabled systems,... ...with clients and incorporate feedback into project development Directing... ...following fields of study: Analytics/Data Science, Artificial...H1b$99k - $232k
...SectorNot ApplicableSpecialismData, Analytics & AIManagement... ...SummaryThe OpportunityAs an AI Data Governance Engineer- Manager... ...and client decision-making- Evaluating data readiness for AI applications... ...members, providing specific feedback on methods, documentation, and...Full timeH1b- ...Employee Resource Groups (ERGs) to support employees. Data Engineer / AI Engineer (Co-op) We are seeking a motivated and curious Data... ...or enhance data retrieval processes. AI Training: Provide feedback to enhance and optimize the output of agents. Prompt...Temporary workInternshipImmediate start
$131.2k - $240.5k
...forecasting across finance and other functions. Using advanced, scalable data and tech platforms, we also generate actionable insights and analytics, streamline decision making and enable data driven profitable growth. Manages risk and opportunities associated with diverse and...Local area$13 - $17 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality... ...and accuracy. Provide structured feedback to improve AI model performance and training...Contract workSummer workImmediate startRemote work$46 - $68 per hour
Skylark Works, a clean energy software company based in Philadelphia, PA, is hiring an Analytics Engineer (2 openings). You will build the pipelines and models that turn raw data into answers the whole company trusts. This role is on-site in our Philadelphia office. What...Hourly payFull timeWork at office$95k - $120k
...Description Job Title: Senior Analytics Engineer Location: Philadelphia, PA Health Union powers the first and largest community-based... ...in a modern stack built on dbt and Snowflake, along with AI tools like Claude. We’re looking for a Senior Analytics Engineer...Full timeSummer workWork at officeFlexible hours2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback - AI Trainer. Be the first to apply!





