Analytical Evaluator - AI Feedback - AI Trainer
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback - AI Trainer in Boston, MA vacancy
- Overview In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects. Basic Qualifications Bachelor's degree from a top-500...Suggested
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...creative direction / marketing collateral Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback to improve AI model outputs . Apply...SuggestedContract workSummer workWork at officeRemote work- ...as a Data Engineer - Corporate Technology Data Engineering & Analytics, where you'll play a pivotal role in driving the execution of... ...integrity, high quality, clean data asset. Executes and provides feedback for data modeling policies, procedure, processes, and...SuggestedFull time
$40 per hour
...contribute to developing cutting-edge AI systems, while enjoying the... ...of performing complex analytical and scientific reasoning — but... ...-art AI models on tasks like evaluating AI-generated quantitative... ...technical problems, and providing feedback that directly shapes how...SuggestedHourly payFull timeRemote workFlexible hoursDataAnnotation
Boston, MA1 day ago$145k - $175k
...with real users, build working AI prototypes in days, prove... ...preparation, campaign and audience analytics, and distribution reporting —... ...with users through short feedback loops, stopping or redirecting... ...guardrails with appropriate evaluations and human oversight.Base Pay...SuggestedFull timeLive inImmediate start$40 per hour
A leading AI development company is seeking experienced quantitative professionals to evaluate AI-generated analyses and provide critical feedback. This remote role offers flexibility in your schedule... ...strong quantitative skills, analytical coding experience, and a...Remote jobHourly pay$110k - $140k
...an exceptional team that embodies a true startup mindset. The Analytics Engineering Team at ABCorp partners closely with Product... ...events, manufacturing operations, billing systems, and customer feedback to power automation, enrichment, and operational workflows. Collaborate...Worldwide$40 per hour
...professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content,... ...problems, and provide feedback to improve how AI systems reason about... ...bilingual level) ~ Strong writing and analytical skills ~ A bachelor’s degree is...Hourly payFull timePart timeRemote workDataAnnotation
Boston, MA1 day ago- ...Overview Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply for the Python and Kubernetes Software Engineer... ...path Confidence to respectfully speak up, exchange feedback, and share ideas without hesitation Track record of going...Local areaWork from home
Canonical
Boston, MA1 day ago $150k - $175k
...behavior across the full lifecycle, design and evaluate experiments, and translate insights into... ...repeatedly used A/B testing and product analytics to drive real business outcomes, not just... ...and existing product features Leverage AI-assisted tools and ML techniques (e.g.,...Work experience placementLocal areaRemote workWork from homeGrabJobs
Boston, MA4 days ago$40 per hour
A leading AI training company is seeking experienced cybersecurity... .... This remote role involves evaluating AI-generated security content... ..., and providing crucial feedback for AI systems' improvement.... ...coding experience, and strong analytical skills. This position offers...Remote jobHourly pay$166k - $220k
...sold. Anduril’s family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into... ...to the military in months, not years.ABOUT THE TEAMThe People Analytics team is at the forefront of transforming how we understand and optimize...Full timeWork experience placementImmediate start$127k - $160.55k
...experts - driving real, measurable results for clients.At Zelis, AI is woven into the fabric of how we work. Every associate is... ...shape who you are.Position OverviewZelis is seeking a Marketing Analytics Engineer, Data Products & Activation to help build the next generation...Full timeWork at officeLocal areaVisa sponsorshipFlexible hours$100k - $215k
...looking for a full-stack Software Engineer to join our Investment Analytics Engineering team. In this role, you will build and enhance... ...tools and source control systems such as GitLab.Experience using AI-assisted development tools such as Claude Code or similar tools....Full timeLocal area$125k - $175k
...WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives. We are hiring an Analytics Engineer II to join our Analytics Engineering team. This role will focus on building and maintaining scalable, well-tested data...Full time$70 per hour
Mercor is seeking a Generalist Expert to improve AI model performance by evaluating AI-generated responses and providing structured feedback. This remote position requires strong analytical and written communication skills, along with a Bachelor's degree from a top-500...Remote jobContract work$112k - $168k
...the TeamData is at the heart of every decision at Klaviyo. Our Analytics Engineering team sits within a hub-and-spoke model, partnering closely... ...and supported with generous benefits, we hope you’ll join us.AI fluency at Klaviyo includes responsible use of AI (including...- ...every step of the way. The Analytics Engineering team at Forward plays... ...raw data into trusted, AI‑ready insights. Our team builds... ...review, pairing, and design feedback - accelerating their growth into... ...is on the critical path Evaluate and operationalize high‑value...
$210k - $245k
...lives. We are looking for a Senior Manager, Analytics Platform to lead and scale our Analytics... ...including semantic modeling and AI-ready data infrastructure. RESPONSIBILITIES... ...industry trends and tooling developments; evaluate and introduce technologies that improve team...Full time$160k - $185k
...Risk AnalyticsOur Quantitative and Risk Analytics group is hiring a Senior Quantitative Analyst... ...change—including the adoption of AI and automation in investment workflows—the... ...scenario analysis, and presentation of results.Evaluate and integrate AI-enabled capabilities to...Full timeLocal area- ...including NGS, proteomics, and spatial transcriptomics datasets). Drug target discovery: implement an analytical workflow to support early target identification and evaluation. Communicate scientific results and conclusions clearly. Proactively communicate project...Remote job
$100k - $140k
...Description Job Description DEPARTMENT OVERVIEW: Baseball Analytics is the quantitative research and data science group within... ...Scientist for the club’s Baseball Analytics department to develop, evaluate, and optimize predictive models that enhance decision-making...Full time- ...offer a tech‑enabled Medicare navigation platform that combines an AI‑driven technology with local Medicare experts to help people... ...First. Description Connie Health is seeking an experienced Senior Analytics Engineer to own our data transformation layer end‑to‑end. You...Work at officeLocal areaWork from home
Connie Health
Boston, MA4 days ago $100.2k - $150.2k
...Enterprise Data & Engineering team! We're looking for a Senior Analytics Engineer to help shape how data is transformed, modeled, and... ...structures. Experience supporting advanced analytics or AI-enabled use cases is a plus. We are an Equal Opportunity / Affirmative...Hasbro
Boston, MA4 days ago$92.6k - $177.4k
...We are seeking a talented and highly motivated Analytics Engineer to join our dynamic team at Global Partners. You are an analytics... ...Conceptualize and implement data architecture for projects, evaluating design and operational trade-offs. Define data assets, data...Permanent employmentSummer workLocal areaGlobal Partners
Newton, MA3 days ago- ...Analytics Engineer TL;DR - We're seeking an Analytics Engineer to own the data foundations that fuel the GTM teams: building reliable... ...comfort working in ambiguity. Nice to have: experience with AI/LLM products, instrumentation, experimentation, or early-stage startups...Shift work
Lovable
Boston, MA1 day ago - ...experience, many have been successful at Vanta without it. As a Senior Analytics Engineer, you’ll be responsible for laying the foundation for a... ...over large-scale, heterogeneous data warehouses. Enable AI tooling with semantic layers and observability, guiding...Work experience placementWork at officeImmediate startRemote workFlexible hours
GrabJobs
Boston, MA14 hours ago - ...have the receipts to prove it. Description We are looking for an Analytics Engineer to join our mission-driven team. As an integral part... ...within our modern data stack. This role will synthesize feedback from teams across the business and help translate data needs into...Work at officeFlexible hours3 days per week
Purple Carrot
Dedham, MA3 days ago $165.56k - $188.09k
...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who strive for more, and the company's values - Act Sustainably, Celebrate the Wins, Fight on Together, Love Athletes and Stand for...Local areaRemote workRelocationUnder Armour
Boston, MA14 hours ago- Somerville, MAHybridFull Time$145k - $165kJob DescriptionAn innovative robotics company is hiring a Senior Analytics Engineer to help transform operational and robotic system data into actionable insights that drive product performance, customer success, and fleet optimization...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback - AI Trainer. Be the first to apply!
