Analytical Evaluator - AI Feedback - AI Trainer [Remote]
$70 per hourMercor
Boston, MA
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback - AI Trainer [Remote] in Boston, MA vacancy
$130 per hour
Prolific is seeking AI Trainers - Clinicians in Boston to train and evaluate AI models. The role involves reviewing AI responses against clinical scenarios and providing structured feedback. Required qualifications include verified clinician status and strong attention...SuggestedHourly paySelf employmentFlexible hours- ...Job Title: Senior Data Engineer - Analytics Essential Functions: Collaborate with... ...you are responsible for Provide feedback and participate in pair programming exercises... ...teams and Customers are empowered with AI assisted insights without dependency on engineering...SuggestedContract workWork experience placement
RevSpring
Boston, MA14 hours ago - ...Data Engineer II Analytics Essential Functions: Design and implement changes to our... ...sessions. Review and provide constructive feedback on peer pull requests (PRs) to maintain... ...teams and customers are empowered with AI assisted insights without dependency on engineering...SuggestedWork experience placement
Kyruus
Boston, MA1 day ago $134.4k - $176.4k
...as a Data Engineer - Corporate Technology Data Engineering & Analytics, where you'll play a pivotal role in driving the execution of... ...integrity, high quality, clean data asset. Executes and provides feedback for data modeling policies, procedure, processes, and...SuggestedRemote workMassachusetts Mutual Life Insurance Company
Boston, MA3 days ago$125k - $135k
...Senior Data Engineer (Applied AI/ML) to join our Boston, MA... ...applied machine learning, and analytical consulting. Senior Data Engineers... ...subject‑matter experts. They evaluate modeling strategies,... ...engineers, providing technical feedback and guidance on design, modeling...SuggestedWork at office$153k - $222k
...Big Data" technologies or concepts (e.g., analytics warehousing, data processing, data... ...customer challenges and provide a critical feedback loop to unblock customers and influence... ...from use case identification, technical evaluation, and through customer ramp. Combine business...Full time- ...ABCorp Senior Analytics Engineer From our nation's earliest days, ABCorp has been a trusted force in security and innovation. In 1... ...events, manufacturing operations, billing systems, and customer feedback to power automation, enrichment, and operational workflows....Worldwide
ABCorp
Boston, MA6 hours ago - Position: Senior Data Engineer - Analytics Location: Remote Job Id: 1049 # of Openings: 1... ...product you are responsible for Provide feedback and participate in pair programming exercises... ...teams and customers are empowered with AI assisted insights without dependency on...Contract workWork experience placementRemote work
- ...receipts to prove it. Description We are looking for an Analytics Engineer to join our mission-driven team. As an integral part... ...within our modern data stack. This role will synthesize feedback from teams across the business and help translate data needs into...Work at officeFlexible hours3 days per week
Purple Carrot
Dedham, MA4 days ago - ...We are seeking a talented Corporate Analytics Developer who is passionate about data and has experience in data analysis and report development... ...and optimize existing reports and dashboards based on user feedback and evolving business requirements. Drive the adoption of...Temporary workLocal areaRemote work
RxBenefits
Boston, MA4 days ago $80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...creative direction / marketing collateral Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI-generated work products....Remote jobContract workSummer workWork at officeMercor
Boston, MA2 days ago$190k - $235k
.... Zus is building a clinical data‑first analytics foundation for providers with a particular... ...shape how data engineering enables BI, AI, and agentic systems at Zus by producing... ...model training, feature engineering, and feedback loops; partner with AI and Data Science teams...Remote work- ...Overview Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply for the Python and Kubernetes Software Engineer... ...path Confidence to respectfully speak up, exchange feedback, and share ideas without hesitation Track record of going...Local areaWork from home
Canonical
Boston, MA13 days ago $80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at officeMercor
Boston, MA2 days ago$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Contract workSummer workWork at officeRemote work$153.8k - $192.3k
...senior individual contributor and technical leader on the Customer Analytics team. This role leads the development and delivery of customer-... ...into production-grade analytics, machine learning, and AI capabilities that improve product outcomes and client value....Temporary workWork experience placementSummer workWork from homeWorldwideFlexible hoursCambridge Mobile Telematics
Cambridge, MA14 hours ago- ...have over 10 years of experience in quantitative analysis, deep knowledge in causal methods, and a strong background in healthcare analytics, particularly within the Medicare value-based care landscape. This role involves risk stratification, economic modeling, and...Remote work
Tech Stars Group LLC
Boston, MA3 days ago $153.8k - $192.3k
...Back to jobs Principal Data Scientist, Customer Analytics Cambridge, MA The Principal Data Scientist is a senior individual contributor and... ...into production-grade analytics, machine learning, and AI capabilities that improve product outcomes and client value. CMT...Contract workTemporary workFor contractorsWork experience placementFor subcontractorSummer workWork at officeLocal areaWork from homeWorldwideWork visaFlexible hoursCambridge Mobile Telematics
Cambridge, MA3 days ago- YO IT Consulting is seeking a Visual Evaluation Specialist to evaluate and annotate visual... ...role focuses on providing detailed feedback for improving AI training and requires proven... ...exceptional written English skills, strong analytical abilities, and a commitment to working...Remote job
- YO IT Consulting is seeking a Generalist Expert to evaluate AI-generated responses and provide structured feedback. This remote role is ideal for sharp, analytical thinkers who can contribute to impactful AI research projects. Required qualifications include a Bachelor...Remote jobFor contractors
- Turing is looking for individuals to evaluate the quality of AI responses for small business use cases... ...chatbots, and providing structured feedback. The ideal candidate should understand... ...business operations and possess strong analytical and critical thinking skills. Enjoy a...Remote jobFlexible hours
$152k - $228k
...A leading technology company in Boston is seeking a Senior Software Engineer for its AI & Analytics Data Enablement team. In this role, you will design scalable data pipelines, lead engineering projects, and collaborate on defining data strategies. The ideal candidate...Klaviyo
Boston, MA2 days ago- ...Our client, a leading global pharma company, is seeking a Senior Data Scientist (AD) to lead the development of advanced analytics and AI solutions that drive strategic decisions across Marketing, Sales, Medical, and Market Access . This role focuses on Marketing...
Analytic Recruiting Inc.
Cambridge, MA1 day ago - ...Analyst / Engineer to manage the data infrastructure that supports AI initiatives and decision-making processes. The role involves... ...candidate will have 3-5 years of experience in data engineering and analytics, with skills in Microsoft Azure, SQL, and data visualization....
$170k - $210k
...Quantitative Researcher - Analytics Boston Virtu is looking for a detail-oriented quantitative researcher to join our Financial Engineering team in Boston. The emphasis of this position is on the research, development and maintenance of our industry-leading mathematical...Virtu Financial
Boston, MA14 hours ago- McKinsey & Company is looking for a data scientist in Boston to create data and analytics solutions that provide impactful insights for clients in the life sciences sector. You will leverage healthcare data, design scalable solutions, and collaborate with diverse teams...
- A leading AI development company is seeking a Securities Analyst to enhance AI training for financial principles while enjoying the... ...opportunity allows you to contribute part-time or full-time and evaluate AI's understanding of finance. Candidates should have experience...Remote jobHourly payFull timePart time
- ...solutions, establishing robust pipelines, and collaborating with various teams on impactful Corporate Technology initiatives. The ideal candidate will have extensive experience in data analytics and SQL, along with strong skills in Python and Spark framework. #J-18808-Ljbffr...
MassMutual
Boston, MA2 days ago $60 per hour
...contribute to developing cutting‑edge AI systems, while enjoying the... ...of performing complex analytical and scientific reasoning — but... ...‑art AI models on tasks like evaluating AI‑generated quantitative... ...technical problems, and providing feedback that directly shapes how...Hourly payFull timeRemote workFlexible hours$1,150 - $1,450 per month
...Mercor is partnering with leading AI labs to engage experienced... ...and insurance regulation to evaluate and enhance AI performance on... ...review) Provide structured feedback on AI accuracy in areas such... ...actuarial credentials) Strong analytical thinking and ability to...Remote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback - AI Trainer [Remote]. Be the first to apply!
Related searches
- quality evaluator Boston, MA
- evaluator Boston, MA
- social media evaluator Boston, MA
- ai trainer Boston, MA
- remote nonprofit Boston, MA
- remote financial analyst Boston, MA
- remote real estate Boston, MA
- remote design intern Boston, MA
- remote legal internship Boston, MA
- embedded software engineer remote Boston, MA