Baseball Expert - AI Evaluator
$100 - $120 per unitMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Baseball Fan – Live MLB Game AI Evaluator (US)
Type: Contract
Compensation: $100–$120 per task
Location: Remote
Commitment: Event-based
Role Responsibilities
- Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis.
- Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns.
- Capture share links and full screenshots of every conversation.
- Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice.
- Work independently and asynchronously during game windows on scheduled game days.
Qualifications
Must-Have
- Based in the United States.
- 1+ year of professional work experience.
- Solid baseball knowledge: rules, teams, players, and postseason structure.
- Comfortable using AI chat assistants and web search.
- Strong written English and sharp attention to detail.
Preferred
- Being an avid MLB fan or a general sports enthusiast.
- Prior AI rating or evaluation experience.
Start Date
- As early as Saturday, October 3
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Baseball Expert - AI Evaluator in New York, NY vacancy
$30 - $50 per hour
Review and improve AI answers written in Polish so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the chart what good looks like. What you will do Rate Polish AI responses for accuracy, fluency, tone and instruction...SuggestedRemote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- Vettedlance seeks a bilingual reviewer to rate Spanish AI responses for accuracy, fluency and instruction-following. You will rewrite or correct weak answers, fact-check claims, and flag unsafe or invented content while maintaining clear tone. The role is remote, part-...SuggestedRemote jobHourly payWeekly payContract workPart time10 hours per week
- micro1 is seeking VA-accredited Veterans Service Officers to help evaluate and improve AI systems on veterans benefits topics. You’ll use your claims experience to check that questions sound like real veterans and families and that answers are correct and useful. Accuracy...SuggestedRemote jobFor contractors
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity, usefulness, and technical accuracy, with a focus on JSON structure and formatting. The role combines language fluency, customer service judgment,...SuggestedFor contractorsRemote workFlexible hours
$18 - $45 per hour
..., and project requirements Help Shape the Future of AI in Finance Are you a finance professional specializing... ...experienced Finance - Fixed Income Subject Matter Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets of Mainland China...SuggestedExtra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours- Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This part-time role emphasizes concise feedback and strong written communication. Applicants should be fluent in English and have...Remote jobPart time
$30 per hour
...About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote workWork from homeFlexible hoursProlific
New York, NY3 days ago$30 per hour
Vetto is building a global AI wellness platform and is recruiting professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing...Hourly pay$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$40 - $65 per hour
Crossing Hurdles is seeking a British English Voice Expert to evaluate short British English audio recordings and assess naturalness, pronunciation... ...per hour. You will provide structured feedback to support AI training and evaluation projects and ensure consistency with project...Remote jobHourly payContract work- AI Trainer Jobs in the United States seeks a graduate-level physicist to review AI-generated solutions to university- and graduate-level physics problems across mechanics, electromagnetism, thermodynamics, and beyond. You will read a model's step-by-step reasoning, identify...
$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote workMercor
New York, NYa month ago- YO AI Labs is seeking an experienced Photography and Cinematography Expert to evaluate professional photo and video content for a specialized project. This remote, worldwide role requires expertise in photography, cinematography, camera operation, and video production....Remote jobWorldwide
- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and...Full timeContract workSummer workImmediate startRemote workFlexible hours
Mercor
New York, NY13 days ago - Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models....Remote jobContract workFreelance10 hours per weekFlexible hours
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...curated global community of over 500,000 AI training and domain experts. As a Web Search Evaluator you will play a key role in...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY3 days ago- ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available...Full timePart timeImmediate start
Braintrust
New York, NY2 days ago $24 per hour
...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part...Part timeFreelanceRemote workBraintrust
New York, NY1 day ago$1,350 per unit
...Bring your expertise to the problems today’s most advanced AI agents still struggle to solve. We’re looking for experienced systems engineering or hardware engineering professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own...Braintrust
New York, NY2 days ago$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux...Braintrust
New York, NY3 days ago$1,350 per unit
...Help test AI systems on realistic creative and technical workflows. We’re looking for experienced specialists in music, audio, speech and linguistics, or visual design and graphics. What you’ll work on Create practical benchmarks using workflows from your specialty...Braintrust
New York, NY3 days ago- Innodata is seeking a detail-oriented Voice Specialist for a 3-month, W2, full-time contract in the United States. You will evaluate two AI models through real-time conversations, comparing responses and providing structured feedback across defined criteria. Responsibilities...Full timeContract work
$25 - $35 per hour
Compare original and AI-generated images, spot visual defects, and write precise feedback that improves image models. This part-time... ...quality standards consistently and prioritize accurate evaluations. What it pays and takes Experience in visual work can help, but...Hourly payContract workPart timeFor contractorsRemote work- Mercor is hiring bilingual Ukrainian-English speakers to help make advanced AI models safer. You will write expert-level prompts in Ukrainian and apply structured guidelines to classify prompts and conversations. No prior AI/ML experience is required — training will be...Part time
- Volga Partners seeks an experienced Senior Investment Research & Capital Markets SME to support AI model development, evaluation, and improvement in finance. This project-based contractor role requires evaluating AI-generated financial analyses, validating reasoning, and...For contractorsRemote work
- AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows and firm policies. You will grade tone, escalation logic, and stakeholder fit using a structured rubric. Flexible US-based remote contractor...Remote jobFor contractors10 hours per weekFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Baseball Expert - AI Evaluator. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- fulfillment expert New York, NY
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY