Baseball Expert AI Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Baseball Fan Live MLB Game AI Evaluator (US)



Type: Contract



Compensation: $100$120 per task



Location: Remote



Commitment: Event-based

Role Responsibilities

• Follow live MLB postseason games and ask AI assistants real fan questions about live scores win probability player and team stats rules challenges schedules broadcasts highlights and expert-style analysis.
• Run the same question on two AI products side by side either as a single question or in a multi-turn conversation of 2 to 10 turns.
• Capture share links and full screenshots of every conversation.
• Rate each response for helpfulness factual accuracy and presentation. Choose which product performed better and write a clear rationale for your choice.
• Work independently and asynchronously during game windows on scheduled game days.

Qualifications

Must-Have

• Based in the United States.
• 1 year of professional work experience.
• Solid baseball knowledge: rules teams players and postseason structure.
• Comfortable using AI chat assistants and web search.
• Strong written English and sharp attention to detail.

Preferred

• Being an avid MLB fan or a general sports enthusiast.
• Prior AI rating or evaluation experience.

Start Date

• As early as Saturday October 3

Application Process (Takes 2030 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information please check:
• For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.