AI Output Evaluator - JSON & Coding Specialist
Meridial
Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will assess language fluency, customer service judgment, and coding knowledge, focusing on JSON structure, formatting accuracy, and response quality. Responsibilities include reviewing responses for clarity and accuracy, reading and validating JSON, identifying formatting issues, and applying clear written communication while adhering to project guidelines. #J-18808-Ljbffr Meridial
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality. You will review responses for clarity, accuracy, and technical soundness, ensuring alignment with project guidelines...SuggestedContract workFor contractorsRemote work
- ...seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity... ...technical accuracy, with a focus on JSON structure and formatting. The role... ...fluency, customer service judgment, and coding knowledge, and includes completing JSON...SuggestedFor contractorsRemote workFlexible hours
- Anyone AI is seeking multilingual evaluators to assess AI-generated responses for clarity, usefulness, and JSON accuracy. This independent contractor, part-time role is remote and can... ...AI systems. Strong language skills and coding knowledge are essential. Experience with...SuggestedRemote jobPart timeFor contractorsFlexible hours
- Meridial is seeking independent contractor experts to review AI-generated coding and technical outputs for accuracy and clarity. You will validate JSON, assess structure, and ensure alignment with project guidelines in French and English contexts. The role emphasizes precise...SuggestedFor contractorsRemote work
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs, with a focus on JSON structure, formatting accuracy, and response quality... ...language fluency, customer-service judgement, and coding knowledge. Assessments include language fluency tasks...SuggestedFor contractors
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs for technical and customer-facing content. The role requires keen attention to JSON structure, formatting, and response quality. You will review responses for clarity, verify JSON validity...For contractors
- Help shape the future of AI by evaluating the technical accuracy, language quality... ...for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate AI-generated technical... ...role, you’ll assess whether outputs are clear, helpful, natural, technically...Part timeFor contractorsRemote work
- Meridial is seeking independent contractor experts to evaluate AI-generated outputs across technical and customer-facing content. The... ...merges language fluency, customer service judgment, and coding knowledge to ensure JSON structure, formatting accuracy, and response quality...For contractors
$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community resources to evaluate AI answers,... ...to $45 per hour. Review AI-generated videos, compare outputs, and explain which result is stronger using your editing...Hourly payContract workPart timeFor contractorsRemote workFlexible hours- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$137.9k - $256.1k
Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing... ...accurate, legally sound outputs that legal professionals can trust... ...working in a Python code base and using Git, including...Full timeWork at officeLocal areaFlexible hours$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact with the AI over several turns, and rate the results against a professional standard. This is a 100% remote contract in the United...Remote jobHourly payContract work10 hours per weekFlexible hours- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires...Remote jobPart timeFreelance
$85 per hour
...technical talent with leading AI research labs. Headquartered in... .../ SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...agents to complete and evaluate complex infrastructure engineering... ...and failure modes. Compare outputs from multiple frontier models...Contract workSummer workRemote work$90 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate the quality and correctness of... ...evaluation. Assess end-to-end coding sessions produced with AI-assisted... ...feedback to improve AI model outputs . Review complex coding...Remote jobContract workSummer work$32 per hour
...highly skilled Vibecode specialists to join the Tendem... ...workflows within our hybrid AI + human system. In this... ...project. As a Vibe Code specialist, you'll handle... ...automation to fine-tuning AI outputs, you'll play a key role... ...formats (CSV, JSON, Google Sheets) with clear...Part timeFreelanceRemote work$25 - $45 per hour
Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per... ...communication Generalists welcome, domain experts preferred No coding or AI background needed Why you'll like it Get paid to use...For contractorsWork at officeWeekend work- We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project. Contractors... ...role-play scenarios, and audit AI outputs to generate clean datasets for model... ...knowledge, bilingual fluency, and basic JSON literacy. Engagement is freelance/independent...Remote jobFor contractorsFreelanceWork from home
- Remote Video Editor Specialist — AI Video Output Review is a remote review track for evaluating AI outputs across video review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so...Remote jobHourly payFor contractors10 hours per week
$8 - $65 per hour
Meridial is looking for a Coding Specialist fluent in Japanese to work on a freelance AI trainer project. This remote role involves designing coding tasks in Japanese, reviewing AI model outputs, and suggesting improvements based on your expertise. The ideal candidate...Remote jobHourly payFreelance- AuraOne Human Data is seeking a Remote Video Editor Specialist for AI Video Output Review. You will assess AI outputs for craft, constraints, and tooling adherence, grading against a structured rubric and documenting the corrected approach for model training. This contractor...Remote jobFor contractors
- AuraOne, Inc. is seeking an Independent contractor to act as an Anonymization Writer evaluator for long projects. Remote US-eligible, you will review model outputs, apply a versioned rubric, and provide structured feedback to help retrain the system. You will compare paired...Remote jobFor contractors
- AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs, label edge cases, and provide structured feedback to retrain models. This role emphasizes precise reasoning and rubric...Remote jobHourly payFor contractors
- AI Trainer Jobs is seeking a Calibration Technology Evaluation Specialist for a remote contractor role. You will review AI outputs against workflows, grade tone, policy adherence, and stakeholder fit using structured rubrics; flag risks and document next steps for training...Remote jobFor contractorsWork experience placement
- Revelo is seeking an Entertainment & Pop Culture Evaluator to help refine AI models by reviewing prompts and evaluating responses related to movies... ..., and celebrity culture. You will compare multiple AI outputs, select the best, and write concise justifications, ensuring...FreelanceFlexible hours
- The Work You will evaluate how AI models respond to sensitive questions about explosives and energetic... ...and suitable access boundaries. Check outputs for factual errors, bias, inappropriate... ...work behind artificial intelligence. Specialists review and improve model responses so...Hourly payFor contractorsRemote work
$75 per hour
Education Professional AI Response Evaluator Use your education experience to write prompts and evaluate AI-generated responses for quality, relevance... ...with professional experience are needed to judge whether AI outputs match the language, standards, and real-world needs of a...Hourly payContract workPart timeRemote workFlexible hours- Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set...Remote jobWeekly payFreelanceFlexible hours
- ...strong understanding of local cultural context to support a range of AI training and evaluation projects. You will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and correcting text, analyzing multimedia content, contributing...For contractorsLocal areaRemote workFlexible hours
- AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Output Evaluator - JSON & Coding Specialist. Be the first to apply!
- evaluator New York, NY
- work from home web search evaluator New York, NY
- web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY



