Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Output Evaluator - JSON & Coding Specialist

Meridial

Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will assess language fluency, customer service judgment, and coding knowledge, focusing on JSON structure, formatting accuracy, and response quality. Responsibilities include reviewing responses for clarity and accuracy, reading and validating JSON, identifying formatting issues, and applying clear written communication while adhering to project guidelines. #J-18808-Ljbffr Meridial

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Output Evaluator - JSON & Coding Specialist in New York, NY vacancy
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs focusing on JSON structure, formatting accuracy, and response quality. You will review responses for clarity, accuracy, and technical soundness, ensuring alignment with project guidelines... 
    Suggested
    Contract work
    For contractors
    Remote work

    Meridial

    New York, NY
    2 days ago
  •  ...seeking independent contractor experts to evaluate AI-generated outputs. You will review responses for clarity...  ...technical accuracy, with a focus on JSON structure and formatting. The role...  ...fluency, customer service judgment, and coding knowledge, and includes completing JSON... 
    Suggested
    For contractors
    Remote work
    Flexible hours

    Meridial

    New York, NY
    2 days ago
  • Anyone AI is seeking multilingual evaluators to assess AI-generated responses for clarity, usefulness, and JSON accuracy. This independent contractor, part-time role is remote and can...  ...AI systems. Strong language skills and coding knowledge are essential. Experience with... 
    Suggested
    Remote job
    Part time
    For contractors
    Flexible hours

    OpenKrill

    New York, NY
    4 days ago
  • Meridial is seeking independent contractor experts to review AI-generated coding and technical outputs for accuracy and clarity. You will validate JSON, assess structure, and ensure alignment with project guidelines in French and English contexts. The role emphasizes precise... 
    Suggested
    For contractors
    Remote work

    Meridial

    New York, NY
    2 days ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs, with a focus on JSON structure, formatting accuracy, and response quality...  ...language fluency, customer-service judgement, and coding knowledge. Assessments include language fluency tasks... 
    Suggested
    For contractors

    Meridial

    New York, NY
    2 days ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs for technical and customer-facing content. The role requires keen attention to JSON structure, formatting, and response quality. You will review responses for clarity, verify JSON validity... 
    For contractors

    Meridial

    New York, NY
    1 day ago
  • Help shape the future of AI by evaluating the technical accuracy, language quality...  ...for multilingual experts with coding knowledge and a solid understanding of JSON to evaluate AI-generated technical...  ...role, you’ll assess whether outputs are clear, helpful, natural, technically... 
    Part time
    For contractors
    Remote work

    OpenKrill

    New York, NY
    4 days ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs across technical and customer-facing content. The...  ...merges language fluency, customer service judgment, and coding knowledge to ensure JSON structure, formatting accuracy, and response quality... 
    For contractors

    Meridial

    New York, NY
    2 days ago
  • $30 - $40 per hour

    211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community resources to evaluate AI answers,...  ...to $45 per hour. Review AI-generated videos, compare outputs, and explain which result is stronger using your editing... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing... 
    Remote job

    Auraone

    New York, NY
    3 days ago
  • $137.9k - $256.1k

    Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing...  ...accurate, legally sound outputs that legal professionals can trust...  ...working in a Python code base and using Git, including... 
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    1 day ago
  • $30 per hour

    Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact with the AI over several turns, and rate the results against a professional standard. This is a 100% remote contract in the United... 
    Remote job
    Hourly pay
    Contract work
    10 hours per week
    Flexible hours

    Confidential

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires... 
    Remote job
    Part time
    Freelance

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ SRE / Cloud Engineer (Coding Agent Experience) Type: Contract...  ...agents to complete and evaluate complex infrastructure engineering...  ...and failure modes. Compare outputs from multiple frontier models... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    19 days ago
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Role Responsibilities Evaluate the quality and correctness of...  ...evaluation. Assess end-to-end coding sessions produced with AI-assisted...  ...feedback to improve AI model outputs . Review complex coding... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    7 days ago
  • $32 per hour

     ...highly skilled Vibecode specialists to join the Tendem...  ...workflows within our hybrid AI + human system. In this...  ...project. As a Vibe Code specialist, you'll handle...  ...automation to fine-tuning AI outputs, you'll play a key role...  ...formats (CSV, JSON, Google Sheets) with clear... 
    Part time
    Freelance
    Remote work

    Mind Rift

    New York, NY
    3 days ago
  • $25 - $45 per hour

    Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per...  ...communication Generalists welcome, domain experts preferred No coding or AI background needed Why you'll like it Get paid to use... 
    For contractors
    Work at office
    Weekend work

    micro1 Inc.

    New York, NY
    2 hours ago
  • We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project. Contractors...  ...role-play scenarios, and audit AI outputs to generate clean datasets for model...  ...knowledge, bilingual fluency, and basic JSON literacy. Engagement is freelance/independent... 
    Remote job
    For contractors
    Freelance
    Work from home

    Agency

    New York, NY
    2 days ago
  • Remote Video Editor Specialist — AI Video Output Review is a remote review track for evaluating AI outputs across video review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Meridial is looking for a Coding Specialist fluent in Japanese to work on a freelance AI trainer project. This remote role involves designing coding tasks in Japanese, reviewing AI model outputs, and suggesting improvements based on your expertise. The ideal candidate... 
    Remote job
    Hourly pay
    Freelance

    Meridial

    New York, NY
    1 day ago
  • AuraOne Human Data is seeking a Remote Video Editor Specialist for AI Video Output Review. You will assess AI outputs for craft, constraints, and tooling adherence, grading against a structured rubric and documenting the corrected approach for model training. This contractor... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AuraOne, Inc. is seeking an Independent contractor to act as an Anonymization Writer evaluator for long projects. Remote US-eligible, you will review model outputs, apply a versioned rubric, and provide structured feedback to help retrain the system. You will compare paired... 
    Remote job
    For contractors

    AuraOne Human Data

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a Haitian Creole Language Expert for a remote evaluation track. You will review language prompts and responses, compare outputs, label edge cases, and provide structured feedback to retrain models. This role emphasizes precise reasoning and rubric... 
    Remote job
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    2 days ago
  • AI Trainer Jobs is seeking a Calibration Technology Evaluation Specialist for a remote contractor role. You will review AI outputs against workflows, grade tone, policy adherence, and stakeholder fit using structured rubrics; flag risks and document next steps for training... 
    Remote job
    For contractors
    Work experience placement

    Auraone

    New York, NY
    2 hours ago
  • Revelo is seeking an Entertainment & Pop Culture Evaluator to help refine AI models by reviewing prompts and evaluating responses related to movies...  ..., and celebrity culture. You will compare multiple AI outputs, select the best, and write concise justifications, ensuring... 
    Freelance
    Flexible hours

    Revelo

    New York, NY
    13 hours ago
  • The Work You will evaluate how AI models respond to sensitive questions about explosives and energetic...  ...and suitable access boundaries. Check outputs for factual errors, bias, inappropriate...  ...work behind artificial intelligence. Specialists review and improve model responses so... 
    Hourly pay
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 hours ago
  • $75 per hour

    Education Professional AI Response Evaluator Use your education experience to write prompts and evaluate AI-generated responses for quality, relevance...  ...with professional experience are needed to judge whether AI outputs match the language, standards, and real-world needs of a... 
    Hourly pay
    Contract work
    Part time
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier (by Scale AI)

    New York, NY
    4 days ago
  •  ...strong understanding of local cultural context to support a range of AI training and evaluation projects. You will work across diverse task types, including evaluating prompts and AI-generated outputs, reviewing and correcting text, analyzing multimedia content, contributing... 
    For contractors
    Local area
    Remote work
    Flexible hours

    LILT

    New York, NY
    2 days ago
  • AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model... 
    Remote job

    AuraOne Human Data

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Output Evaluator - JSON & Coding Specialist. Be the first to apply!