JSON Evaluator - AI Trainer
$50 - $175 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: JSON-fluent & Rubrics Expert
Type: Contract
Compensation: $50–$175/hour
Location: Remote
Commitment: 20–40 hours/week
Role Responsibilities
- Evaluate JSON-formatted AI model outputs against defined grading rubrics.
- Read and understand written task descriptions and rubrics.
- Parse, read, and assess JSON-based outputs, grading them against provided rubrics.
- Ensure attention to detail and consistency in applying rubric criteria.
- Work independently to meet tight deadlines within 12-24 hours .
Qualifications
Must-Have
- Available to start today, July 24 , running to July 27-28 .
- Comfortable reading and interpreting JSON files .
- Based in the US .
- Access to a desktop or laptop computer (no Chromebooks).
Preferred
- Prior Mercor experience, especially in applying detailed rubrics and evaluation criteria consistently.
Start Date
- Today, July 24
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the JSON Evaluator - AI Trainer in Washington DC vacancy
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote workFlexible hours$25 per hour
...DataAnnotation We are looking for a Bilingual Copyeditor (Chinese/English) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need...SuggestedHourly payFull timeContract workPart timeRemote workDataAnnotation
Washington DC4 days ago- .... Learn More About ProSidian Consulting at DescriptionProSidian Seeks a Enterprise Assessment Protection System Performance Test Evaluator (SCA Code: -) in CONUS - Mid Atlantic Washington Metropolitan Area (Northern Virginia | Washington DC | Maryland) to support an engagement...SuggestedFull timeTemporary workFor contractorsWork at officeFlexible hours
- ...Transportation, Federal and State Government Agencies. Learn More About ProSidian Consulting at DescriptionProSidian Seeks a External Evaluator | Evaluation Support [DOEOP049054] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract...SuggestedFull timeContract workTemporary workFor contractorsH1bWork at officeFlexible hours
$100 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...SuggestedContract workSummer workRemote workMercor
Washington DCa month ago$25 per hour
...Japanese/English) We are looking for a Remote Interpreter (Japanese/English) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need...Hourly payFull timeContract workPart timeRemote workDataAnnotation
Washington DC4 days ago$104k - $208k
...UK, Ireland, Australia, or New Zealand. Responsibilities: We design and solve a wide range of coding challenges used to train AI systems. We write clear, high-quality code samples along with thorough explanations. We assess AI-generated code for correctness...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC15 days ago$54 - $93 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...-style mathematics problems to challenge frontier AI models. Evaluate AI-generated solutions for correctness, clarity, and style. Identify...Weekly payContract workSummer workRemote workMercor
Washington DCa month ago$40 per hour
...We are looking for a Clinical Researcher to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of biology...Hourly payFull timeContract workPart timeRemote workDataAnnotation
Washington DC3 days ago$104k - $166k
...environment that feeds the program’s agentic AI engine.Experience with FAA, NAS, Aviation... ..., AI-enabled workflows, or model/output evaluation Experience supporting human-in-the-loop... ...execution data Familiarity with APIs, JSON, Parquet, data pipelines, ETL/ELT concepts...Contract workShift work- ...data engineering pipelines, automation workflows, and analytical outputs· Apply programming and data analysis techniques using Python, JSON, C++, Java, R, or Scala· Support deployment and operation of solutions using Kubernetes and Docker· Support integration of cyber...Contract workWork at officeWorldwideMonday to FridayWeekend workAfternoon shift
$99k - $225k
...for good. Join us. The world can’t wait. You Have: Experience working with AI/ML technologies and data systemsExperience working with multiple file types including geospatial file formats, JSON, and XMLExperience doing quantitative analysis, developing visualizations,...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Outlier connect subject matter experts with AI training projects Outlier is one of the world’s largest expert platforms, connecting a network of over 700,000 MAs, PhDs, and college graduates worldwide to improve AI models by providing expert human feedback. Experts...Weekly payWorldwide
Outlier AI
Washington DC9 hours ago $60 per hour
...the DataAnnotation team and contribute to developing cutting‑edge AI systems, while enjoying the flexibility of remote work and... ...Write clear, high‑quality code snippets and detailed explanations. Evaluate AI‑generated code for accuracy, performance, and clarity. Provide...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC1 day ago- ...including GitHub / GitLab. · Experience with Java, architecting ETL data pipelines supporting data-driven applications, utilizing REST and JSON.· Familiarity with systems for data routing and transformation such as NiFi.· Systems-level understanding of Machine Learning...
$104k - $208k
...UK, Ireland, Australia, or New Zealand. Responsibilities: We design and solve a wide range of coding challenges used to train AI systems. We write clear, high-quality code examples and thorough explanations. We review AI-generated code for correctness, efficiency...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC15 days ago- ...within scope) Position Responsibilities : ~ Experience working with AI/ML technologies and data systems ~ Experience working with multiple file types including geospatial file formats, JSON, XML, etc. ~3+ years of experience doing quantitative analysis, developing...Immediate start
Allen Integrated Solutions
Washington DCa month ago $50 - $75 per hour
...the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and... ...clear, high‑quality code snippets and detailed explanations. Evaluate AI‑generated code for accuracy, performance, and clarity. Provide...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC1 day ago$25 per hour
A remote technology company is seeking a Remote Interpreter (Japanese/English) to train AI models by evaluating chatbot interactions and improving their logic. Candidates must be fluent in both languages, detail-oriented, and have a good command of grammar. This is a flexible...Hourly payRemote workFlexible hoursDataAnnotation
Washington DC4 days ago$148.2k - $263k
...environments in AWS, Azure, GCP, or Oracle. ~ Strong written and analytic skills Preferred Skills: Proficiency in Python, JSON, C++, or Java and containerization (Kubernetes/Docker). Effective communication skills, presenting relevant technical information...Hourly payContract workTemporary workWork experience placementWork at officeLocal areaRemote workManTech International Corporation
Washington DC2 days ago- ...Home Inspector/Home Evaluator - Northern Virginia Posted 1 month ago About the Role Birdwatch exists to simplify the lives of modern homeowners. We put people at the center of all we do – our clients, our staff, and our communities. It’s a recipe for success. Our one‑of...Immediate startFlexible hours
Social Leverage
Washington DC9 hours ago $40 per hour
...the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and... ...you'll work closely with state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving technical problems,...Hourly payFull timeRemote workFlexible hoursDataAnnotation
Washington DC4 days ago- ...Home Evaluation Specialist Birdwatch exists to simplify the lives of modern homeowners. We put people at the center of all we do – our clients, our staff, and our communities. It's a recipe for success. Our one-of-a-kind service takes the hassle out of homeownership...Part timeImmediate startMonday to FridayFlexible hours
Birdwatch
Washington DC3 days ago - CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across boutiques, online stores, and product returns. You will provide firsthand feedback to help premium brands refine their services, all while enjoying flexible missions and the freedom...Flexible hours
- Join the HJF Team! HJF is seeking a Program Evaluator II - Pre- and Post-Crash Care to conduct and provide technical assistance for research and evaluation activities, as well as operations and logistics support. The position will be in support of National Institute for...Hourly payFor contractorsWork at office
$38 - $45 per hour
...Masters Social Worker (LMSW) are welcome to apply as supervision will be provided. We are hiring for a Full-time, Behavioral Health ED Evaluator for the following shift: Day shift (7:00 am to 7:30 pm) Night shift (7:00 pm to 7:30 am) Must be flexible with the schedule....Hourly payFull timeFlexible hoursShift workNight shiftDay shift- CXG group is seeking a luxury brand evaluator to assess customer experiences with premium brands. This role offers the flexibility to choose assignments that suit your interests, from visiting stores to online evaluations, ensuring your input shapes the future of luxury...Flexible hours
- Overview Become a Luxury Brand Evaluator in Washington, DC - Apply Now. Join CXG as a Luxury Brand Evaluator to discreetly assess customer experiences for luxury brands and provide feedback that helps refine services. What you will do Choose your assignments — align your...Full timeContract workFlexible hours
- A global leader in customer experience is seeking luxury brand evaluators to provide feedback on customer experiences with premium brands. Join a community of evaluators to assess the quality of service, both in-store and online, for leading luxury brands like Louis Vuitton...Flexible hours
- ...automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands...Contract workWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to JSON Evaluator - AI Trainer. Be the first to apply!
