JSON Evaluator - AI Trainer
$50 - $175 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: JSON-fluent & Rubrics Expert
Type: Contract
Compensation: $50–$175/hour
Location: Remote
Commitment: 20–40 hours/week
Role Responsibilities
- Evaluate JSON-formatted AI model outputs against defined grading rubrics.
- Read and understand written task descriptions and rubrics.
- Parse, read, and assess JSON-based outputs, grading them against provided rubrics.
- Ensure attention to detail and consistency in applying rubric criteria.
- Work independently to meet tight deadlines within 12-24 hours .
Qualifications
Must-Have
- Available to start today, July 24 , running to July 27-28 .
- Comfortable reading and interpreting JSON files .
- Based in the US .
- Access to a desktop or laptop computer (no Chromebooks).
Preferred
- Prior Mercor experience, especially in applying detailed rubrics and evaluation criteria consistently.
Start Date
- Today, July 24
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the JSON Evaluator - AI Trainer in Seattle, WA vacancy
$50 - $175 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: JSON-fluent & Rubrics Expert Type: Contract... ...40 hours/week Role Responsibilities Evaluate JSON-formatted AI model outputs against...SuggestedContract workSummer workStart working todayRemote work- Alignerr is seeking a Population Health Informaticist to help shape AI systems that interpret population-level health data. You will evaluate health analytics, identify discrepancies, and provide expert feedback on health informatics concepts. Remote, hourly contract work...SuggestedRemote jobHourly payContract workFlexible hours
- ...Outlier connect subject matter experts with AI training projects Outlier is one of the world’s largest expert platforms, connecting a network of over 700,000 MAs, PhDs, and college graduates worldwide to improve AI models by providing expert human feedback. Experts...SuggestedWeekly payWorldwide
Outlier AI
Seattle, WA16 hours ago - YO IT Consulting is seeking a Legal AI Trainer to perform comprehensive legal analysis on US topics, conduct in-depth research, and draft or edit memoranda, opinions, and contracts. The role emphasizes clarity, accuracy, and strong legal writing, with remote collaboration...SuggestedRemote job
- YO IT Consulting seeks a BigLaw lawyers AI Trainer to perform comprehensive analysis of US law topics, conduct in-depth legal research, and draft, review, and edit complex legal content. The role emphasizes structured feedback, rigorous quality assurance, and meticulous...SuggestedRemote jobContract work
$98.81k - $148.22k
...platform that powers reporting, analytics, and AI across the enterprise. This hands-on role... ..., contribute to design reviews, and help evaluate new tools and patterns. Contribute to code... ...databases, SAP, flat files, REST APIs (JSON/XML), and SaaS applications. Experience implementing...Full timeTemporary workWork at office- Alignerr is seeking a Health Policy & Management AI Data Trainer to work remotely, applying public health expertise to train AI systems used for health information. As an MPH/MSPH professional, you will design disease-outbreak and health-equity scenarios, author evidence...Remote jobContract workFlexible hours
$126.98k - $200.68k
...collaboration. This role builds data science solutions, applying LLMs/AI to process, structure, and contextualize health data, and... ...modeling. A variety of data formats and markup languages (e.g. XML, JSON, RMarkdown). Unix/Linux and distributed computing....Hourly payRelocation packageFred Hutchinson Cancer Center
Seattle, WA2 days ago$130k - $185k
...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with CEOs,... ...and ETL design for structured and semi-structured data (CSV, JSON, APIs, Flat Files). Understand schema, data quality, and transformation...Work experience placementSummer holidayWork at officeFlexible hoursEY
Seattle, WA16 hours ago$28.95 - $34.74 per hour
Job Title Location 611 12th Avenue South, Seattle, WA, 98104, United States Base Pay $28.95 - $34.74 / Hour Employee Type FT Non-Exempt Required Degree 4 Year Degree Description Requirements Seattle Indian Health Board- Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools while contributing to the future of AI. You will evaluate model responses, review output quality, and provide...Remote jobFull timeContract work
- mpathic.ai in Seattle is seeking AI Safety Experts for a temporary project to evaluate and improve the safety, reliability, and real-world behavior of frontier AI systems. This role suits professionals with expertise in human behavior, policy, education, healthcare, or...Temporary work
- CXG is on the lookout for a Luxury Brand Evaluator in the United States. In this role, you will assess customer experiences with premium brands through various methods, including in-store evaluations and online assessments. Your observations will be pivotal in shaping brand...Flexible hours
- CXG in the United States connects premium brands with a global network of evaluators. As a luxury brand evaluator, you will discreetly assess in-store and online experiences and provide actionable feedback to help brands refine service quality. Assignments are flexible...Flexible hours
- Public Health - Seattle & King County seeks two Psychiatric Evaluation Specialists to perform mental status/diagnostic evaluations, manage evidence-based interventions, and conduct suicide risk assessments for jail residents. Responsibilities include chart reviews, training...
- Alignerr is seeking Korean language experts to evaluate and improve AI systems built for Korean language learning and instruction. Your linguistic insight and teaching experience will shape how AI understands, assesses, and communicates in Korean — making a real impact...Remote jobHourly payContract work
- Signify Health is seeking a Full Time Clinician (NP or PA) to provide in-home health evaluations, engaging with patients in the comfort of their homes. You will bridge gaps in care and build trusted relationships, delivering personalized health assessments with a national...Full time
- ...automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands...Contract workWorldwideFlexible hours
- We are seeking qualified candidates for the position of Evaluator. This Evaluator will help develop, refine, and implement an evaluation framework to be utilized for measuring and assessing the impact of all Doors Open related programming. Measurement of additional 4Culture...
- CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across boutiques, online channels, and product returns. You’ll provide feedback that helps brands refine service in fashion, beauty, jewelry, and automobiles. You’ll visit stores (about 20...Flexible hours
- ...family that loves them, a feeling of community, and opportunities to learn, build self-esteem, and have fun. Help Believe in Me evaluate and improve programs serving underserved youth and young people across scholarships, community partnerships, iLevelUP, Cougs 4 Kids...Remote job
$46.03 - $99.14 per hour
...Health, part of CVS Health®, is seeking a Part-time Clinician (Nurse Practitioner or Physician Assistant) to provide in-home health evaluations in Seattle. This role involves conducting evaluations that last about 45 minutes, including medication reviews and physical...Hourly payPart timeWork from homeFlexible hours- Signify Health, part of CVS Health, is seeking a Part-time Clinician (NP or PA) to provide in-home health evaluations. Visits last about 45 minutes, including health and medication review, with a focus on bridging gaps in care. Opportunities to travel locally and conduct...Part time
$52.79 - $81.94 per hour
...and RDBMS fundamentals. Knowledge of semi/unstructured data (JSON/Parquet) and API integrations. Familiarity with open-source ELT... ...performance tuning, Streams/Tasks, Snowpark), plus knowledge of Snowflake AI features. Streamlit for lightweight internal apps and...Minimum wageFull timeWork at officeLocal areaRemote workShift workProvidence
Renton, WA12 days ago- ...or transformation drift. Lead technical working sessions to evaluate and recommend best-fit technologies, tools, and practices for managing... ..., enrichment, dynamic routing, and format conversions (e.g., JSON ↔ CSV, XML, Logfmt) to prepare data for downstream analytics...Contract work
InterSources
Bellevue, WA16 hours ago - ...be based near a Mercer office in the United States and requires three days in the office weekly. You will lead Medicaid program evaluations (including 1115 waivers), work with CMS, analyze data, and deliver reports. A Master’s degree and 3-5+ years in Medicaid evaluation...Work at office
- Upwork is looking for Home Consultants to support Airbnb’s Luxe program in Seattle. Consultants will perform in-person home assessments, document property conditions, and create detailed reports to maintain luxury hospitality standards. This role offers flexible scheduling...Flexible hours
- ...·basedinUSorEurope ABOUT PROXY FOODS Proxy Foods is an advanced AI-powered product development and recipe formulation platform trusted... ...and structured datasets Exposure to relational databases, APIs, JSON/CSV files, and basic data modeling concepts Strong attention to...Full time
- Mindful Way Therapy PLLC in Washington is seeking a passionate therapist to provide psychotherapy and evaluations for ADHD and Autism. The role involves administering therapy with a focus on neurodivergent clients, conducting assessments under supervision, and maintaining...Remote jobFlexible hours
- A community health organization in Seattle seeks an Involuntary Treatment Court Facilitator to perform clinical assessments and collaborate with medical professionals. The ideal candidate will have a Master’s degree in a relevant field, considerable experience with psychiatric...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to JSON Evaluator - AI Trainer. Be the first to apply!
