Baseball Expert - AI Evaluator
$100 - $120 per unitMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Baseball Fan – Live MLB Game AI Evaluator (US)
Type: Contract
Compensation: $100–$120 per task
Location: Remote
Commitment: Event-based
Role Responsibilities
- Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis.
- Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns.
- Capture share links and full screenshots of every conversation.
- Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice.
- Work independently and asynchronously during game windows on scheduled game days.
Qualifications
Must-Have
- Based in the United States.
- 1+ year of professional work experience.
- Solid baseball knowledge: rules, teams, players, and postseason structure.
- Comfortable using AI chat assistants and web search.
- Strong written English and sharp attention to detail.
Preferred
- Being an avid MLB fan or a general sports enthusiast.
- Prior AI rating or evaluation experience.
Start Date
- As early as Saturday, October 3
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$40 per hour
Review and improve AI answers written in Maltese so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the model what good looks like. What you will do Rate Maltese AI responses for accuracy, fluency, tone and instruction...SuggestedRemote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- Vettedlance is seeking a meticulous Polish language reviewer to enhance AI answers. You will rate Polish responses for accuracy, fluency, and tone, rewrite weak answers, and ensure factual correctness. You will also fact-check claims, flag unsafe content, and craft prompts...SuggestedRemote jobHourly payPart timeFlexible hours
- Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This part-time role emphasizes concise feedback and strong written communication. Applicants should be fluent in English and have...SuggestedRemote jobPart time
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work$175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Flexible part-time hours Role Responsibilities Evaluate AI answers to ophthalmology questions for clinical accuracy and...Full timeContract workPart timeSummer workImmediate startRemote workFlexible hours- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and...Full timeContract workSummer workImmediate startRemote workFlexible hours
- Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models....Remote jobContract workFreelance10 hours per weekFlexible hours
$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $... ...Work independently and asynchronously to evaluate and improve AI model performance ....Contract workSummer workRemote work$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...curated global community of over 500,000 AI training and domain experts. As a Web Search Evaluator you will play a key role in...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available...Full timePart timeImmediate start
$24 per hour
...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part...Part timeFreelanceRemote work$1,350 per unit
...Help test AI systems on realistic creative and technical workflows. We’re looking for experienced specialists in music, audio, speech and linguistics, or visual design and graphics. What you’ll work on Create practical benchmarks using workflows from your specialty...$1,350 per unit
...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux...- OpenTrain AI, Inc. seeks an experienced 211 Specialist to evaluate AI answers for government services. This part-time, remote role focuses on reviewing questions, writing rubrics, and giving precise feedback to improve accuracy and usefulness. You will assess AI responses...Remote jobPart timeFlexible hours
$30 per hour
Mercor, a San Francisco-based company connecting elite AI talent, is seeking an AI Chat Generalist for remote, contract work. The role requires about 10 hours per week and pays $30 per hour, with weekly payments via Stripe Connect. You will write short, realistic prompts...Remote jobHourly payWeekly payContract workPart time10 hours per week$30 - $50 per hour
OpenTrain AI, Inc. is seeking an AI Privacy, Safety and Evaluation Specialist for a six-week, part-time project based in the United States. You will test personal AI agents and review responses for privacy risks, with pay of $30 to $50 per hour. This remote contract offers...Remote jobHourly payContract workPart timeRelocationFlexible hours- AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You will compare paired outputs, label issues, and provide structured feedback to help retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation experience...Remote jobFor contractors
- Volga Partners seeks an experienced Senior Investment Research & Capital Markets SME to support AI model development, evaluation, and improvement in finance. This project-based contractor role requires evaluating AI-generated financial analyses, validating reasoning, and...For contractorsRemote work
- Prolific is seeking Materials Science Specialists to join its Expert Network for AI training and evaluation. You’ll complete a short test and, if selected, contribute to paid AI tasks requiring one hour of uninterrupted work. Researchers with a background in materials science...Work from home
- ...constructive feedback digital delivery platforms ai-driven tools familiarity independent... ...models and agents. We provide frontier evaluations and reinforcement learning environments... ...recruiting agent sources and vets domain experts for our data platform that enables rapid...For contractorsRemote workShift work
- Handshake is seeking Tamil-speaking evaluators based in Singapore or Malaysia to help personalize AI responses. This is not a traditional role; you’ll evaluate and rank AI replies to improve future models, working remotely on a flexible, asynchronous, part-time basis....Remote jobPart timeFlexible hours
- Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and...Remote jobWeekly payFor contractorsFlexible hours
- Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You...Remote jobFor contractorsFreelanceFlexible hours
- Invisible Technologies is seeking a Spanish (Latin America) language specialist to help shape the future of AI by evaluating and challenging language models. You will engage with the model on phonetics, morphology, syntax, semantics, pragmatics, and sociolinguistics, documenting...Remote jobContract work
- AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against AuraOne's rubric, labeling edge cases, and providing structured feedback to retrain prompts. You will compare...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Baseball Expert - AI Evaluator. Be the first to apply!
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- fulfillment expert New York, NY
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY




