Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Baseball Expert - AI Evaluator

$100 - $120 per unit

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Baseball Fan – Live MLB Game AI Evaluator (US)
Type: Contract
Compensation: $100–$120 per task
Location: Remote
Commitment: Event-based

Role Responsibilities

  • Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis.
  • Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns.
  • Capture share links and full screenshots of every conversation.
  • Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice.
  • Work independently and asynchronously during game windows on scheduled game days.

Qualifications

Must-Have

  • Based in the United States.
  • 1+ year of professional work experience.
  • Solid baseball knowledge: rules, teams, players, and postseason structure.
  • Comfortable using AI chat assistants and web search.
  • Strong written English and sharp attention to detail.

Preferred

  • Being an avid MLB fan or a general sports enthusiast.
  • Prior AI rating or evaluation experience.

Start Date

  • As early as Saturday, October 3

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Baseball Expert - AI Evaluator in New York, NY vacancy
  • $40 per hour

    Review and improve AI answers written in Maltese so they read naturally and get the facts right. You rate responses, fix weak ones and write examples that show the model what good looks like. What you will do Rate Maltese AI responses for accuracy, fluency, tone and instruction... 
    Suggested
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    3 days ago
  • Vettedlance is seeking a meticulous Polish language reviewer to enhance AI answers. You will rate Polish responses for accuracy, fluency, and tone, rewrite weak answers, and ensure factual correctness. You will also fact-check claims, flag unsafe content, and craft prompts... 
    Suggested
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Vettedlance

    New York, NY
    2 days ago
  • Synthires is seeking a Film & Video Craft Expert to remotely evaluate AI-generated videos across lighting, framing, color, and performance. This part-time role emphasizes concise feedback and strong written communication. Applicants should be fluent in English and have... 
    Suggested
    Remote job
    Part time

    Synthires

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    28 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    a month ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    28 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    New York, NY
    a month ago
  • $175 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...Flexible part-time hours Role Responsibilities Evaluate AI answers to ophthalmology questions for clinical accuracy and... 
    Full time
    Contract work
    Part time
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    16 days ago
  •  ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...hour Location: Remote Role Responsibilities Evaluate AI answers to anesthesiology questions for clinical accuracy and... 
    Full time
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    16 days ago
  • Welo Data, part of Welocalize, is seeking Mandarin-speaking experts to join a remote, project-based evaluation effort. You will assess AI-generated responses for accuracy, grammar, and cultural relevance, and produce refined Mandarin content to improve language models.... 
    Remote job
    Contract work
    Freelance
    10 hours per week
    Flexible hours

    Welo Global

    New York, NY
    6 days ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $...  ...Work independently and asynchronously to evaluate and improve AI model performance .... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    3 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are...  ...curated global community of over 500,000 AI training and domain experts. As a Web Search Evaluator you will play a key role in... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    1 day ago
  •  ...Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people who already use Gemini, Instinct, or Muse and can assess prompts and responses in English. A part-time commitment of 20 hours per week is available... 
    Full time
    Part time
    Immediate start

    Braintrust

    New York, NY
    6 hours ago
  • $24 per hour

     ...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part... 
    Part time
    Freelance
    Remote work

    Braintrust

    New York, NY
    4 days ago
  • $1,350 per unit

     ...Help test AI systems on realistic creative and technical workflows. We’re looking for experienced specialists in music, audio, speech and linguistics, or visual design and graphics. What you’ll work on Create practical benchmarks using workflows from your specialty... 

    Braintrust

    New York, NY
    1 day ago
  • $1,350 per unit

     ...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise to design realistic problems, define verifiable outcomes and evaluate proposed solutions for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux... 

    Braintrust

    New York, NY
    1 day ago
  • OpenTrain AI, Inc. seeks an experienced 211 Specialist to evaluate AI answers for government services. This part-time, remote role focuses on reviewing questions, writing rubrics, and giving precise feedback to improve accuracy and usefulness. You will assess AI responses... 
    Remote job
    Part time
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • $30 per hour

    Mercor, a San Francisco-based company connecting elite AI talent, is seeking an AI Chat Generalist for remote, contract work. The role requires about 10 hours per week and pays $30 per hour, with weekly payments via Stripe Connect. You will write short, realistic prompts... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    10 hours per week

    mercor

    New York, NY
    6 days ago
  • $30 - $50 per hour

    OpenTrain AI, Inc. is seeking an AI Privacy, Safety and Evaluation Specialist for a six-week, part-time project based in the United States. You will test personal AI agents and review responses for privacy risks, with pay of $30 to $50 per hour. This remote contract offers... 
    Remote job
    Hourly pay
    Contract work
    Part time
    Relocation
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a remote evaluator to review food delivery AI response evaluations. You will compare paired outputs, label issues, and provide structured feedback to help retrain the model according to AuraOne's rubric. Ideal candidates have prior annotation experience... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    2 days ago
  • Volga Partners seeks an experienced Senior Investment Research & Capital Markets SME to support AI model development, evaluation, and improvement in finance. This project-based contractor role requires evaluating AI-generated financial analyses, validating reasoning, and... 
    For contractors
    Remote work

    Volga Partners

    New York, NY
    6 days ago
  • Prolific is seeking Materials Science Specialists to join its Expert Network for AI training and evaluation. You’ll complete a short test and, if selected, contribute to paid AI tasks requiring one hour of uninterrupted work. Researchers with a background in materials science... 
    Work from home

    Prolific Academic Ltd

    New York, NY
    5 days ago
  •  ...constructive feedback digital delivery platforms ai-driven tools familiarity independent...  ...models and agents. We provide frontier evaluations and reinforcement learning environments...  ...recruiting agent sources and vets domain experts for our data platform that enables rapid... 
    For contractors
    Remote work
    Shift work

    Micro1

    New York, NY
    4 days ago
  • Handshake is seeking Tamil-speaking evaluators based in Singapore or Malaysia to help personalize AI responses. This is not a traditional role; you’ll evaluate and rank AI replies to improve future models, working remotely on a flexible, asynchronous, part-time basis.... 
    Remote job
    Part time
    Flexible hours

    Handshake

    New York, NY
    5 days ago
  • Appsierra Group is seeking an AI Session Annotator for a fully remote, independent contractor role. You will review recorded AI sessions, compare responses to visuals, and provide precise written feedback using a detailed rubric. Strong English, attention to detail, and... 
    Remote job
    Weekly pay
    For contractors
    Flexible hours

    Recruitment Room

    New York, NY
    4 days ago
  • Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You... 
    Remote job
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    5 days ago
  • Invisible Technologies is seeking a Spanish (Latin America) language specialist to help shape the future of AI by evaluating and challenging language models. You will engage with the model on phonetics, morphology, syntax, semantics, pragmatics, and sociolinguistics, documenting... 
    Remote job
    Contract work

    Invisible Technologies Inc.

    New York, NY
    5 days ago
  • AuraOne, Inc. is seeking an AI Data Reviewer for the Misinformation Context AI Evaluator track. This remote contractor role involves reviewing model outputs against AuraOne's rubric, labeling edge cases, and providing structured feedback to retrain prompts. You will compare... 
    Remote job
    For contractors

    AuraOne, Inc.

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Baseball Expert - AI Evaluator. Be the first to apply!