Analytical Evaluator - AI Feedback - AI Trainer
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Ensure consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback - AI Trainer in Seattle, WA vacancy
$103.28k - $191.25k
...using quantitative methods and approved AI capabilities. The role converts fragmented... ...located within the US.Responsibilities Include:Analytical Design and Data FusionFrame ambiguous... ...release, field activation, and feedback.Capture recommendation disposition, seller...SuggestedFull timeTemporary workWork at officeRemote workWork from homeHome officeFlexible hoursNTT DATA
Seattle, WA4 days ago$179k - $203k
Join to apply for the Sr. Analytics Engineer role at The Nuclear Company Join to apply for the... ...Engineer role at The Nuclear Company Get AI-powered advice on this job and more... ...Conduct code reviews, provide constructive feedback, and contribute to the continuous improvement...SuggestedFull time- ...Description Job Description Senior AI Trainer Role Type: Contractor, Remote Location... ...in quality reviews and incorporate feedback to maintain standards. Required Qualifications... ...in a remote environment. Analytical and problem-solving mindset. Preferred...SuggestedFor contractorsRemote work
YO AI Labs
Seattle, WA11 days ago $136k - $184k
...and translate business problems into data science or analytical problems- Design, develop, and evaluate highly innovative statistics and ML models- Guide and... ...performance experience- 1+ years of working with or evaluating AI systems experience- Experience applying theoretical...SuggestedFull timeTemporary workSeasonal workFlexible hoursAmazon
Bellevue, WA2 days ago- ...The Data Analytics Engineer will help enable critical decision-making by engineering reliable data pipelines, preparing high-quality datasets, and delivering advanced analytics and reporting capabilities within a secure environment. Responsibilities Build, test, and deploy...SuggestedFor contractors
DataJobs.com
Seattle, WA16 minutes ago $110k - $160k
Data Scientist-Build Analytics About Forged Fiber At Forged Fiber, our mission is bold but simple: deliver fast, reliable, future-proof connectivity... ...(one or multiple) o Looker BI reporting o LLM training o AI/ML experience o Agentic AI development Experience building...For contractorsLocal area$189.4k - $256.2k
...Principal Data Scientist, AWS Analytics Engineering (AAE) Job ID: 10501433 | Amazon.com Services LLC Do you want to define the multi... ...products? Do you want to influence the AWS investment in Cloud and AI technology and see how your recommendations influencing AWS VP...Flexible hoursAmazon
Seattle, WA1 day ago- Prime Video seeks a data engineer to design and scale data infrastructure powering reporting, analytics and AI-enabled insights. You will build robust ETL/ELT pipelines, integrate data across marketing, finance, and operations, and strengthen data governance and instrumentation...
- ...seeking Junior to Senior Level Data Scientists in locations such as Washington, DC Metropolitan and San Diego, CA. You will develop analytics applications to transform raw data into actionable information and apply data mining, NLP, and machine learning to large datasets....For contractors
- Spear AI delivers advanced AI solutions for maritime defense and national security. We seek a Data Engineer to build robust, secure data infrastructure powering analytics for a Sensitive IC Task Force in Washington, DC. You will design resilient pipelines and collaborate...
- Logic20/20 is seeking a Lead Data Scientist to join our AI & Analytics practice in Seattle. You will lead the development of innovative data science solutions using ML, analytics, and data-driven decision-making to solve complex business challenges. The ideal candidate...
$130.4k - $176.3k
...looking for a Sr. Business Intelligence Engineer to join the AWS Analytics Engineering (AAE) team supporting Amazon Quick. Formerly Amazon... ...evolved from a standalone BI service into a comprehensive, generative-AI-powered business intelligence platform that combines traditional...Work at officeFlexible hoursAmazon
Seattle, WA3 days ago$154.6k - $209.1k
...Job ID: 10564331 | Amazon.com Services LLC The AWS Analytics Engineering (AAE) organization is the analytics backbone of AWS — we build... ...and Lambda. The candidate should have hands-on experience with AI/ML technologies, including LLMs, and a strong understanding of designing...Temporary workFlexible hours- ...SQL/Python/PySpark transformations, and manage Redshift/S3 storage with governance and security in mind. Lead the data engineering effort, mentor junior teammates, and collaborate with analytics to deliver reliable BI using QuickSight/Tableau. #J-18808-Ljbffr Ascendion
- DoorDash is seeking an Analytics Engineer to build and scale the data foundations enabling fast, reliable insights. You’ll partner with Data Engineers, Scientists, and Product teams to deliver trusted metrics and analytics across the company. You’ll own canonical datasets...
- About The Team The Analytics Engineering team at DoorDash is embedded within the Analytics and Data Engineering Orgs, and is responsible for building internal data products that scale decision-making across business teams and drive efficiency in our operations. Data is...Hourly payWork at officeLocal areaRemote workFlexible hours
- Trupanion seeks a Senior Analytics Engineer, Finance Data to design scalable, governed data models for financial reporting and analytics.... ...environment, building scalable models, and enabling automation and AI-enabled capabilities. Hybrid work in Seattle area is available....
$200k - $240k
As an Analytics Engineer, you will be an early member of the Data Science & Analytics team building the foundation to scale analytics across... ...the company's mission of building helpful, honest, and harmless AI Expertise in building multi-step ETL jobs through tooling like...Work experience placementWork at officeHome officeVisa sponsorshipRelocation package$120k - $130k
...encouraged to be themselves. Job Description We are seeking a Senior Analytics Engineer, Finance Data to design and build scalable, governed... ...to take greater advantage of Databricks, automation, and AI-enabled capabilities. This is a highly hands-on role for someone...Full timeCasual workWork at officeImmediate startRemote workWork visa3 days per week$45 - $65 per hour
...educational institutions. Handshake AI works directly with frontier AI lab researchers to create evaluations, publish benchmarks, and... ...Role As an AI Model Policy Trainer focused on mental health, you... ...and provide evidence-based peer feedback Identify ambiguous examples...Hourly payFull timeImmediate startRelocationMonday to FridayFlexible hoursHandshake
Seattle, WA17 days ago$30 - $85 per hour
...educational institutions. Handshake AI works directly with frontier AI lab researchers to create evaluations, publish benchmarks, and... ...Role As an AI Model Policy Trainer, Generalist, you will turn... ...evaluations, and incorporate feedback into future work. Help improve...Hourly payFull timeMonday to FridayFlexible hoursHandshake
Seattle, WA26 days ago$212k - $265k
Staff Data Scientist, Product Analytics Join us to build the decision engine for better mental... ...you will influence what we build, how we evaluate it, and how we scale what works. This... ...areas like matching, ranking, or applied AI experiences, build measurement approaches...Work from homeFlexible hours- Mutual of Enumclaw Insurance Company seeks an experienced P&C Insurance Industry Data Analytics Engineer to bridge raw data and business insights across underwriting, actuarial, claims, product, distribution, and finance, supporting all lines of business. You will design...
$174k
...product discovery for our millions of daily customers, so the scale and impact of our work is massive! Within S&D, the Data Science, Analytics, and Data Engineering team analyzes customer data to determine how our Search models should be designed. This includes assessing...Temporary workFlexible hoursCoupang
Seattle, WA1 day ago$120k - $185k
...grind and share the joy of day-to-day life and activities with colleagues, friends, and family. WHAT WE DO Our Data and Analytics consultants work with clients at all levels of the organization, from the C-suite to the shop floor, helping them to deliver on...Permanent employmentSEI
Seattle, WA1 day ago- ...documents. Assess and provide structured feedback on legal texts for clarity, accuracy,... .... Role Title: BigLaw lawyers AI Trainer Role Type: Contract Location: Remote... ...with quality assurance and rubric-based evaluation of legal documents is a plus. Demonstrated...Remote jobContract work
$133.98k - $241.62k
...software engineering, and big data, building AI and ML systems that directly impact our... ..., and a strong build-measure-learn feedback culture. The work you do will directly shape... ...working within big data architecture, modern analytical data platforms, and large-scale data...Full timeTemporary workPart timeWork experience placementLocal areaFlexible hoursT-Mobile
Bellevue, WA1 hour ago$120 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate the accuracy and depth of AI-generated content... .... Provide clear, structured feedback to AI research teams to improve training...Contract workSummer workRemote workMercor
Seattle, WA3 days ago- ...technically skilled builder to lead the development, implementation, and maintenance of the tools and systems that power our HR workflows and AI initiatives. Our People team helps support Samsara by providing accessible, business-oriented HR guidance—achieved through creative...Full time
Samsara
Seattle, WA2 days ago - ...iterative pilot-to-production delivery cycles with structured feedback incorporation Communicate model outputs and business impact... ...loss prevention , exception-based reporting, or shrinkage analytics Exposure to Power BI or Fabric-native reporting for operationalizing...Remote work2 days per week
AITA Consulting Services, Inc.
Seattle, WA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback - AI Trainer. Be the first to apply!
