Baseball Expert - AI Evaluator

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Baseball Fan – Live MLB Game AI Evaluator (US)
Type: Contract
Compensation: $100–$120 per task
Location: Remote
Commitment: Event-based

Role Responsibilities

• Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis.
• Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns.
• Capture share links and full screenshots of every conversation.
• Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice.
• Work independently and asynchronously during game windows on scheduled game days.

Qualifications

Must-Have

• Based in the United States.
• 1+ year of professional work experience.
• Solid baseball knowledge: rules, teams, players, and postseason structure.
• Comfortable using AI chat assistants and web search.
• Strong written English and sharp attention to detail.

Preferred

• Being an avid MLB fan or a general sports enthusiast.
• Prior AI rating or evaluation experience.

Start Date

• As early as Saturday, October 3

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.