Analytical Evaluator - AI Feedback
$70 per hourPart-time
Mercor
Role Description
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs.
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Company Description
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Remote vacancy
$28.26 - $42.4 per hour
Role Description The Evaluator applies expertise in the relevant content area to review students... ...Evaluator provides accurate and helpful feedback on assessments to help students develop... ...Technology, Software Development, Data Analytics, Information Systems, Computer...SuggestedPart timeWork experience placementFlexible hoursAfternoon shiftWestern Governors University
Remote3 days ago$40 per hour
...professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content,... ...problems, and provide feedback to improve how AI systems reason about... ...bilingual level) ~ Strong writing and analytical skills ~ A bachelor’s degree is...SuggestedHourly payFull timePart timeRemote workDataAnnotation
Madison, WI1 day ago$14.5 per hour
...scalable to supercharge their AI models. As a Welocalize brand... ...our team as a Web Search Evaluator and help shape the future of... ...relevant information. Provide feedback to improve search engine... ...Career Growth: Develop your analytical, research, and quality assessment...SuggestedBi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hoursKanz.us
Jacksonville, FL1 day ago$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results.... ...analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical skills and familiarity with online search...SuggestedHourly payPart timeRemote workFlexible hoursWelo Data
New York, NY1 day ago$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology... ...of attention to detail, strong analytical skills, and a passion for quality.... ...they meet user expectations. Offer feedback and recommendations to improve algorithm...SuggestedHourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY1 day ago$60 per hour
...A leading AI development company is looking for experienced quantitative professionals to evaluate AI-generated analyses and provide critical feedback. This remote position allows for flexible scheduling... ...' reasoning about data and analytics, working closely with cutting...Hourly payRemote workFlexible hoursDataAnnotation
New York, NY2 days ago$60 per hour
...contribute to developing cutting-edge AI systems, while enjoying the... ...of performing complex analytical and scientific reasoning — but... ...-art AI models on tasks like evaluating AI-generated quantitative... ...technical problems, and providing feedback that directly shapes how...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Topeka, KS1 day ago$40 per hour
A leading AI development company in the United States is seeking... ...systems. The role involves evaluating AI-generated quantitative... ...systems, and providing impactful feedback. Ideal candidates will have... ...quantitative role and strong coding and analytical skills. Work is fully remote...Hourly payRemote workDataAnnotation
Springfield, IL2 days ago$60 per hour
...A leading AI development company invites experienced quantitative... .... Responsibilities include evaluating AI-generated analyses,... ...problems, and providing impactful feedback on AI models. Candidates should... ...us to shape the future of AI analytics and contribute your expertise...Hourly payRemote workDataAnnotation
Iowa, LA1 day ago$60 per hour
...A forward-thinking AI development company is seeking experienced... ...professionals to evaluate AI-generated work, solve complex... ...problems, and provide critical feedback. This fully remote position allows... ...AI systems that reason about data and analytics. #J-18808-Ljbffr...Remote workDataAnnotation
Salt Lake City, UT1 day ago$60 per hour
...A leading AI development company is seeking quantitative professionals... .... Responsibilities include evaluating AI-generated work, designing... ...problems, and providing feedback for AI model development.... ...qualifications. Join to help shape the future of AI analytics! #J-18808-Ljbffr...Hourly payRemote workFlexible hoursDataAnnotation
Honolulu, HI2 days ago$40 per hour
A remote AI development company is looking for quantitative professionals to evaluate AI-generated work and provide feedback. This role allows for a flexible schedule and competitive hourly... ..., coding experience, and strong analytical capabilities. Responsibilities include...Hourly payRemote workFlexible hoursDataAnnotation
Brooklyn, NY2 days ago$60 per hour
A leading AI development company is seeking experienced quantitative... ...their remote team. You'll evaluate AI-generated quantitative... ...for AI training, and provide feedback that shapes AI systems. Ideal... ...a related field, with strong analytical skills. Enjoy a flexible schedule...Hourly payRemote workFlexible hoursDataAnnotation
Virginia, MN1 day ago$60 per hour
A leading AI development firm is seeking quantitative professionals to evaluate AI-generated work and design quantitative problems. This role is... ...evaluating technical accuracy, writing analytical code, and providing impactful feedback. Competitive hourly pay up to $60,...Hourly payRemote workDataAnnotation
Salt Lake City, UT1 day ago- A leading AI research company is seeking quantitative professionals to evaluate AI-generated analysis and provide feedback on their systems. This fully remote role offers the flexibility... ...us to help shape AI systems that reason about data and analytics. #J-18808-LjbffrRemote work
DataAnnotation
New York, NY1 day ago $30 - $45 per hour
...Contribute to the advancement of AI systems as a Web Browsing Evaluator, where your expertise will help shape how models learn and perform. This role... ...searching. Provide clear written documentation and feedback on the browsing process, highlighting any anomalies or...Remote jobHourly payFor contractorsSaidGig
Remote19 days ago$80 - $120 per hour
...regulatory response within the financial services sector to evaluate and assess AI-generated work products. Your primary responsibility will... ...presentation errors. Provide clear, structured written feedback on evaluations. Qualifications ~5+ years of relevant professional...Remote jobHourly payWork at officeSaidGig
United States22 days ago$80 - $120 per hour
...leverage your expertise in Humanities, arts, and culture to evaluate and assess AI-generated work products, including documents, spreadsheets,... ...presentation errors. Provide clear, structured written feedback. Qualifications ~5+ years of relevant professional experience...Remote jobHourly payWork at officeSaidGig
United Statesa month ago$40 per hour
...cybersecurity firm is looking for experienced professionals to evaluate AI-generated security content and solve technical cybersecurity... ...at $40 per hour. Ideal candidates will possess strong analytical and writing skills and have a bachelor's degree. Cybersecurity...Hourly payRemote workFlexible hoursDataAnnotation
Wisconsin4 days ago- ...the United States to participate in an exciting Google Pixel AI evaluation project. Join our FREE Virtual Enrollment Event: ~Available... ...the project over 14 consecutive days. ~Share your feedback to help improve AI technology. Compensation Receive $2...Temporary work
Productive Playhouse
Remote22 hours ago $80 - $120 per hour
Role Description ~Evaluate AI-generated artifacts against domain-specific quality rubrics. ~Identify factual, aesthetic, and presentation errors. ~Provide clear, structured written feedback. ~Apply deep subject-matter expertise to grade outputs. ~Review and...Part timeWork at officeRemote workMercor
Remote7 days ago- ...the United States to participate in an exciting Google Pixel AI evaluation project. What You'll Do: ~Use the Google Pixel as your primary... ...the project over 14 consecutive days. ~Share your feedback to help improve AI technology. Compensation: Receive $25...Temporary work
Productive Playhouse
Remote22 hours ago $40 per hour
...company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. The... ...have 2+ years of hands-on experience in cybersecurity, strong analytical skills, and preferred coding experience. Paid projects start...Hourly payFull timePart timeRemote workFlexible hoursDataAnnotation
New York, NY2 days ago$80 - $120 per hour
...leverage your expertise in general finance and accounting to evaluate and assess AI-generated work products, including documents, spreadsheets,... ...presentation errors. Provide clear, structured written feedback. Qualifications ~5+ years of relevant professional...Remote jobHourly payWork at officeSaidGig
United Statesa month ago$80 - $120 per hour
...Role Overview As an Evaluator specializing in Training, Onboarding, and Learning & Development... ...crucial role in reviewing and assessing AI-generated work products such as documents... ...Provide clear and structured written feedback to enhance quality. Qualifications ~...Remote jobHourly payWork at officeSaidGig
United Statesa month ago$80 - $120 per hour
...Role Overview As an expert Evaluator in Education / school, you will play a crucial role in reviewing and assessing AI-generated work products, including documents, spreadsheets... .... Provide clear, structured written feedback. Qualifications ~5+ years of relevant...Remote jobHourly payWork at officeSaidGig
United Statesa month ago$80 - $120 per hour
...Role Overview As a Healthcare / Clinical Evaluator, you will leverage your expertise to review and assess AI-generated work products, ensuring their accuracy, rigor... ..., and slide decks, providing critical feedback on their content. Key Responsibilities Evaluate...Hourly payWork at officeRemote workSaidGig
United States5 days ago$11.5 per hour
...position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No... ..., based on task completion, with a supportive community of contributors involved in AI advancements. #J-18808-Ljbffr...Hourly payPart timeRemote workUniversity of Delaware
New York, NY4 days ago$60 per hour
...experienced quantitative professionals to contribute to cutting-edge AI development. You will evaluate AI-generated quantitative work, design problems for AI training, and provide valuable feedback. Ideal candidates have 2+ years of experience in quantitative roles. This...Remote workFlexible hoursDataAnnotation
Virginia, MN1 day ago$60 per hour
...A technology company specializing in AI seeks experienced quantitative professionals to evaluate and validate AI-generated analyses. Responsibilities include solving complex problems and providing feedback on the systems. Candidates should have 2+ years in a quantitative...Hourly payRemote workDataAnnotation
Cheyenne, WY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
