Baseball Expert - AI Evaluator
$100 - $120 per unitMercor Inc
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position Baseball Fan – Live MLB Game AI Evaluator (US) Type Contract Compensation $100–$120 per task Location Remote Commitment Event-based Role Responsibilities Follow live MLB postseason games and ask AI assistants real fan questions about live scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and expert-style analysis. Run the same question on two AI products side by side, either as a single question or in a multi-turn conversation of 2 to 10 turns. Capture share links and full screenshots of every conversation. Rate each response for helpfulness, factual accuracy, and presentation. Choose which product performed better and write a clear rationale for your choice. Work independently and asynchronously during game windows on scheduled game days. Must-Have Qualifications Based in the United States. 1+ year of professional work experience. Solid baseball knowledge: rules, teams, players, and postseason structure. Comfortable using AI chat assistants and web search. Strong written English and sharp attention to detail. Preferred Being an avid MLB fan or a general sports enthusiast. Prior AI rating or evaluation experience. Start Date As early as Saturday, October 3 #J-18808-Ljbffr
- ...seeking experienced chemistry professionals to participate in remote, AI-moderated sessions. You will review advanced prompts, explain... .... Sessions are remote and asynchronous, offering flexible scheduling and expert contributions on a per-task basis. #J-18808-Ljbffr...SuggestedRemote workFlexible hours
$160 per unit
...review prompts, explain mechanisms, and provide expert feedback. Strong domain knowledge and clear communication... ...-fields are essential. Participants will join AI-moderated sessions, review materials, and contribute to evaluating and improving scientific models. Compensation is...SuggestedRemote job$30 per hour
...Vetto is building a global AI wellness platform and is recruiting professionals to review real-world wellness scenarios used to train AI wellness assistants. As a reviewer, you will identify risks, contraindications, and behavior patterns to upgrade scenarios for testing...SuggestedHourly pay$30 per hour
...About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...SuggestedRemote workWork from homeFlexible hours- Alignerr Corp. is seeking a Chinese Language Expert (AI Training) to help evaluate and improve AI systems for Chinese language learning. You will apply linguistic insight and teaching experience to shape how AI understands, assesses, and teaches Chinese. The role is remote...SuggestedHourly payContract workRemote workFlexible hours
$65 per hour
...Prolific is seeking Registered Nurses to help train and evaluate AI models. If you have clinical experience, we’ll test your skills and, if successful, invite you to join as a Domain Expert participant, where you’ll be paid to contribute. Researchers may pay up to $65/...Remote workWork from homeFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work- ...Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
- ...Mercor, in collaboration with a leading AI research lab, is seeking Legal Experts to evaluate AI-generated outputs on complex legal prompts. You will compare responses, assess reasoning, and ground judgments in case law, contracts, and regulation. Part-time role, 10...Part timeImmediate start10 hours per week
- ...Join a growing network of industry experts supporting AI research and development. Overview We\'re building a select group of experienced healthcare professionals to help evaluate and improve how AI systems understand and reason about healthcare topics. You\'ll...Contract workPart timeRemote work10 hours per weekFlexible hours
$35 per hour
...Speech Collection Evaluator (Arabic-Saudi Arabia_MSA) Saudi Arabia AI Trainers - Domain Experts – Data Collection / Independent Contractor - Project Based / Remote We're looking for native Modern Standard Arabic speakers in Saudi Arabia. You'll record voice commands using...For contractorsRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work- We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate...
$18 per hour
...Description Interact with an AI assistant in Malayalam. Translate English prompts into Malayalam and use them to interact with the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality...Hourly payFreelanceImmediate startRemote workFlexible hours$18 per hour
...RWS TrainAI is seeking AI Linguistic Evaluators to assess Gujarati language performance for a short collaboration. This remote freelance role requires immediate start and offers flexible scheduling for approximately 10-15 total hours (about 5 hours per day) at a rate...FreelanceImmediate startRemote workFlexible hours- ...Mercor is seeking experienced musicians to evaluate generative music AI models, working in Bengali and English. You will assess AI-generated lyrics across genres and rate them against detailed quality standards. Responsibilities include comparing lyrics to published songs...Part timeImmediate startFlexible hours
- ...RWS Group is seeking a Speech AI Evaluation Specialist to support AI content improvement in Vietnamese (USA). This freelance, part-time role is remote from the USA, with a flexible schedule and immediate start. You will rate AI responses for relevance, accuracy, and clarity...Part timeFreelanceImmediate startRemote workFlexible hours
- ...Crossing Hurdles is seeking Medical Experts to audit AI-generated medical content for clinical accuracy, safety, and relevance on a remote, contractor assignment basis. This part-time role demands 20–40 hours per week with at least 4 hours overlap during PST business hours...Part timeFor contractorsRemote work
- ...AuraOne is seeking a Primary Care Physician (MD) for a remote Clinical Documentation & AI Evaluation track. Review AI outputs, assess differential diagnosis, dosing logic, and adherence to guidelines, and document corrected clinical reasoning. This contractor role requires...For contractorsRemote work
$100 - $160 per hour
...hour equivalent, paid per accepted task • 100% remote • Part-time • Fully flexible schedule Work on the cutting edge of legal AI, on your own schedule, and get paid for the litigation judgment you already have. The AI systems everyone is talking about are...Hourly payPart timeFor contractorsRemote workFlexible hours$50 per hour
...Mercor is seeking a Spanish (Mexico) Audio Generalist Evaluator for a contract role. The position is remote and requires 10–20 hours per... ...You will transcribe, evaluate, and provide feedback to improve AI language tasks in Spanish and English. The role focuses on developing...Contract workRemote work10 hours per week- ...SaidGig seeks a remote contractor to evaluate AI-generated legal and technical content. You will assess clarity, tone, and instruction compliance, and provide detailed rationales. This role emphasizes independent work and meeting deadlines without giving legal advice....Contract workFor contractorsRemote work
- ...Obsidian is seeking expert Evaluators in Personal finance / consumer planning to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement designed for seasoned professionals who apply deep domain knowledge...Hourly payRemote work
$15 per hour
...SaidGig is seeking a role that applies Punjabi music expertise to evaluate generative AI music and lyrics. You will assess AI-generated content in Punjabi and English across a wide range of genres, checking quality, originality, and prompt adherence while considering...Hourly payImmediate startRemote workFlexible hours- ...Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses. - Location:... ...data for frontier AI models. We’re looking for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate...Part timeFor contractorsRemote work
- ...Gramian Consultancy is seeking Thai native-level evaluators to assess Thai audio content for fluency, nativeness and linguistic authenticity... ...You will provide well-reasoned English feedback to help improve AI language understanding and generation. No prior AI experience is...
$18 per hour
...Description Interact with an AI assistant in Bengali. Translate English prompts into Bengali and use them to test the AI application. Evaluate AI-generated responses according to project guidelines. Assess linguistic accuracy, naturalness, localization quality, and cultural...Hourly payTemporary workFreelanceImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Baseball Expert - AI Evaluator. Be the first to apply!
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- subject matter expert work from home New York, NY
- program evaluator New York, NY
- quality evaluator New York, NY
- nurse evaluator New York, NY
- evaluator New York, NY



