JSON Evaluator - AI Trainer
$50 - $175 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: JSON-fluent & Rubrics Expert
Type: Contract
Compensation: $50–$175/hour
Location: Remote
Commitment: 20–40 hours/week
Role Responsibilities
- Evaluate JSON-formatted AI model outputs against defined grading rubrics.
- Read and understand written task descriptions and rubrics.
- Parse, read, and assess JSON-based outputs, grading them against provided rubrics.
- Ensure attention to detail and consistency in applying rubric criteria.
- Work independently to meet tight deadlines within 12-24 hours .
Qualifications
Must-Have
- Available to start today, July 24 , running to July 27-28 .
- Comfortable reading and interpreting JSON files .
- Based in the US .
- Access to a desktop or laptop computer (no Chromebooks).
Preferred
- Prior Mercor experience, especially in applying detailed rubrics and evaluation criteria consistently.
Start Date
- Today, July 24
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the JSON Evaluator - AI Trainer in Seattle, WA vacancy
$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model...SuggestedContract workSummer workRemote work- ...Job Description Job Description Senior AI Trainer Role Type: Contractor, Remote Location: North America, Latin America, Europe, UK, Oceania We're seeking Senior AI Trainers to support a customer project focused on improving AI systems through expert-level...SuggestedFor contractorsRemote work
YO AI Labs
Seattle, WA7 days ago $157.4k - $236k
...capabilities.You will work with data and AI engineers, business systems analysts, product... ...data, including relational data, JSON, XML, CSV, Excel, and document metadata.Develop... ...data products for model grounding, evaluation, and responsible use.Help establish repeatable...SuggestedFull timeTemporary workH1bBill & Melinda Gates Foundation
Seattle, WA5 days ago$98.81k - $148.22k
...platform that powers reporting, analytics, and AI across the enterprise. This hands-on role... ..., contribute to design reviews, and help evaluate new tools and patterns. Contribute to code... ...databases, SAP, flat files, REST APIs (JSON/XML), and SaaS applications. Experience implementing...SuggestedFull timeTemporary workWork at officeWeyerhaeuser
Seattle, WA3 days ago- ...quality experiences, and expanding meaningful opportunities for underserved youth and young people. We are seeking a volunteer Program Evaluator to develop practical, ethical evaluation plans for digital learning, mentoring, scholarships, and community partnerships....SuggestedRemote jobWorldwide
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Spreadsheet QA / workbook maintenance Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote workMercor
Seattle, WA15 days ago- YO AI Labs seeks a Senior AI Trainer to support a customer project by reviewing robotic-arm footage, tagging events, and producing precise annotations to support model training. This remote, contractor role emphasizes meticulous data labeling and timeline-based annotations...Remote jobFor contractors
- Mercor is recruiting Economics Research Experts for a research project with a leading foundational model AI lab. You are a great fit if you: Have at least 1 year of experience working at top institutions in economics research (e.g. World Bank, IMF, Fed, Graduate Schools...Odd job10 hours per week
- Acentra Health is seeking a PASRR Clinical Evaluator - PRN to join our growing team. This role conducts PASRR evaluations, makes level of care recommendations, and ensures that the quality of care provided meets industry standards and complies with government regulations...ReliefFlexible hours
- Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools while contributing to the future of AI. You will evaluate model responses, review output quality, and provide...Remote jobFull timeContract work
- Acentra Health is seeking a PASRR Clinical Evaluator to perform PASRR Level II assessments, make level-of-care recommendations, and ensure the quality of care meets regulatory standards across Yakima, Washington. This full-time position is a hybrid role combining telehealth...Full time
- ...Health in Washington state is seeking a Part-time Clinician (Nurse Practitioner or Physician Assistant) to perform in-home health evaluations for members in their own homes. Visits last about 45 minutes and include history, med review, physical exam, and optional tests...Part time
- Signify Health, part of CVS Health, seeks a Part Time Clinician (Nurse Practitioner or Physician Assistant) to perform in-home health evaluations for plan members, engaging with them in their own homes. You will travel locally, conduct visits about 45 minutes, review...Part time
$52.79 - $81.94 per hour
...and RDBMS fundamentals. Knowledge of semi/unstructured data (JSON/Parquet) and API integrations. Familiarity with open-source ELT... ...performance tuning, Streams/Tasks, Snowpark), plus knowledge of Snowflake AI features. Streamlit for lightweight internal apps and...Minimum wageFull timeLocal areaRemote workShift workProvidence Health & Service
Seattle, WA16 hours ago- ...KQL to extract meaningful data Generate various report and dashboard Skills: Experience in PowerShell (5.1 and later), JSON Kusto and ADX report Hands on writing/handling complex KQL, knowledge of SQL Data orchestration using ADF, lens reporting...
TCS USAAvance Consulting
Bellevue, WA4 days ago - ...Knowledge of and 5-8 years of experience in the following development concepts: CI/CD, DevOps, Agile, Pair Programming, Git, GitHub, JSON, Object Oriented Programming(OOP) and trunk based development Understanding of ETL processes, data warehousing and data modeling...Full time
Keylent Inc
Seattle, WA4 days ago - ...the ProSidian website at Job Description ProSidian Seeks a Lead Evaluator | DOL ILAB Monitoring, Evaluation, Learning (MEL), and Data... ...The Lead Evaluator is responsible for verifying the accuracy of AI-assisted analysis or content prior to inclusion in any deliverable...Full timeContract workInterim roleWork at officeFlexible hours
- YO AI Labs is seeking a Creative & Design Specialist (Contractor) to support projects across graphic design, multimedia production, UI/UX, and motion graphics. You will review AI-generated outputs, provide high-quality human feedback, and help refine creative workflows...Remote jobFor contractors
- ProSidian is seeking a Lead International Development Program/Project Evaluator for DOL ILAB MEL and Data Services. The role is contract contingent (1099) with hybrid work options near Washington, DC, and potential CONUS/OCONUS assignments. You will lead evaluation planning...Contract workTemporary work
$65 - $75 per hour
...hourly Remote Full-time About the work Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models.The goal is to test whether a model can correctly judge the misuse potential of a... $65.00-$75.00 hourly Remote Full-time...Remote jobHourly payFull timeWork from home$170k - $280k
...maintain the data pipelines that feed Sesame's AI models. You'll collaborate directly with... ...right shape, at the right time to train, evaluate, and ship models. Sesame's data is rich... ...unstructured and semi‑structured data — audio, text, JSON logs — not just clean relational tables....Full timeContract workFlexible hours- We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions... ...using Python and modern API patterns such as REST, OpenAPI, JSON/YAML schemas, webhooks, and event-driven integrations.Experience...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Seattle, WA2 days ago $75 - $125 per hour
DataAnnotation is hiring a Web Designer - AI Trainer in Bellevue, WA (onsite) to assess frontier AI outputs on real-world visual design... ...design expertise Feed briefs into frontier AI design tools and evaluate results against the standards you would apply to a colleague...Hourly payContract workFor contractorsWork at office- DataAnnotation is seeking a Designer to evaluate how models translate into UX and visual design, identifying flows that hinder usability and proposing stronger critique. You’ll review AI design work across user flows, layout, and typography, catch polish failures, and...Remote job
- R3 Continuum LLC is seeking an independently licensed Neuropsychologist to expand our evaluation services in Washington. This role provides an opportunity for flexible scheduling and office evaluations for concierge-level clients. Ideal candidates will have a Doctorate...Private practiceWork at officeFlexible hours
$125 per hour
...Way Therapy PLLC, we are seeking a passioante and experienced therapist to join our team in providing outpatient psychotherapy and evaluations for ADHD and Autism. This role is ideal for a clinician who is dedicated to supporting neurodivergent clients with compassion,...Hourly payFull timePart timeRemote workFlexible hours- Mindful Way Therapy PLLC is seeking a therapist to provide outpatient psychotherapy and comprehensive ADHD and Autism assessments. You will work under supervision, focusing on neurodivergent affirming care and supporting clients through diagnosis and treatment in a compassionate...Remote work
$116.2k - $229.1k
...and network-design models.· Build and integrate analytical solutions using Python, SQL, data pipelines, and enterprise systems.· Evaluate scenarios and trade-offs to quantify impacts on service, cost, capacity, working capital, lead time, and resilience.· Support solution...Local areaDeloitte
Seattle, WA3 days ago$77k - $202k
...LevelSenior AssociateJob Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist-Senior Associate you will leverage... ...proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace...Full timeH1bShift workPwC
Seattle, WA4 days ago- ...questions into rigorous experimental designs, and define clear specifications so engineers can implement your methods in production. AI-Native Workflow: Strong AI Sense — extensive hands-on experience with AI coding tools (Claude Code, OpenClaw, or similar)....Full time
ByLabs
Seattle, WA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to JSON Evaluator - AI Trainer. Be the first to apply!
