Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Translation AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Legal Translation AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Legal Translation AI Evaluator assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Legal Translation AI Evaluator work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review
  • Localization review
  • Cultural context
  • Language evaluation
  • Legal
  • Translation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Legal Translation AI Evaluator [Remote] in Remote vacancy
  •  ...Technologies, LLC. is seeking a detail-oriented Labeler / Annotator to evaluate AI responses in French. This remote role focuses on side-by-side evaluation across real-world scenarios, not translation, requiring strong judgment and attention to detail. You will... 
    Suggested
    Remote work

    Blueprint Consulting Services

    Bellevue, WA
    2 days ago
  • $20 - $80 per hour

     ...your expertise to help train next-generation AI systems. Your work will shape how models...  ...-world input. Key Responsibilities: Evaluate and score AI-generated responses using well...  ...and finance to marketing, healthcare, and legal domains. Required Skills and Qualifications... 
    Legal
    Hourly pay
    Contract work
    Remote work

    SaidGig

    United States
    1 day ago
  • 24-Mag is offering a part-time consulting opportunity for legal professionals in New York. The role focuses on evaluating AI-generated legal responses and providing structured feedback on legal reasoning. Ideal candidates should have a J.D. or equivalent from a U.S. law... 
    Legal
    Remote job
    Part time
    Flexible hours

    24-Mag

    New York, NY
    1 day ago
  • $14.5 per hour

     ...diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...  ...? Join our team as a Web Search Evaluator and help shape the future of search engines...  ...in the digital landscape, apply today ! Legal Requirements: In compliance with federal... 
    Legal
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    3 days ago
  • A leading AI consultancy firm is seeking legal consultants for project-based opportunities involving testing and improving AI systems. Candidates should have a degree in law and at least 2 years of legal experience within US jurisdiction. Strong written English is required... 
    Legal
    Permanent employment
    Freelance
    Remote work
    10 hours per week

    Mindrift

    Kansas City, MO
    5 days ago
  • $80 - $120 per hour

    Mercor is seeking an IP / trademark / copyright law Evaluator with a strong background in relevant legal experience. This remote role involves evaluating AI-generated artifacts and collaborating with AI research teams to enhance quality. The ideal candidate has over 5... 
    Legal
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  • $25 per hour

    A leading tech company is seeking a Language Specialist to improve AI chatbots by evaluating their progress and teaching them conversational skills in English and Japanese. This role allows flexibility with remote work and the choice of projects. Candidates should have... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    1 day ago
  • $30 per hour

     ...Prolific is not just another player in the AI space – we are building the biggest pool...  ...as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple...  ...models of the future using professional legal expertise. Once you pass our assessment,... 
    Legal
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  •  ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy,...  ...Privacy law content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade...  ...Structured clinical writing Clinical review Legal reasoning Policy review Risk analysis Healthcare Compliance... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Trust and Safety Policy AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft...  ...documentation Trust and Safety Policy AI evaluation Legal reasoning Policy review Risk analysis Trust Safety... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Terms of Service AI Evaluator is a remote evaluation track for reviewing terms of service ai evaluation prompts and responses against AuraOne...  ...Inter-rater calibration Terms of Service AI evaluation Legal reasoning Policy review Risk analysis Terms... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  •  ...Description About Visalaw.ai Visalaw.ai is transforming immigration law through AI. Our platform helps immigration attorneys and legal teams automate document drafting, case research, translation, and other time-consuming legal workflows so they can focus on delivering... 
    Legal
    Full time
    Remote work
    Flexible hours

    Visalaw.Ai

    Remote
    1 day ago
  •  ...Relativity 9.0 or higher version 2+ years of legal support experience HOURS & LOCATION...  ...testimony, legal research, and foreign language translation. Unlike other eDiscovery vendors, Contact...  ...#CJ We may use artificial intelligence (AI) tools to support parts of the hiring... 
    Legal
    Remote work

    CGS Federal (Contact Government Services)

    Atlanta, GA
    5 days ago
  • $15 - $20 per hour

     ...Role Overview Assess Marathi AI-generated responses for factual accuracy, reasoning, clarity, tone, and completeness, and produce...  ...identifies strengths and specific areas for improvement. Your evaluations will be used to help create the "perfect AI-generated response"... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    4 days ago
  • $28.26 - $42.4 per hour

    Role Description The Evaluator applies expertise in the relevant content area to review students’ assessments and determine mastery of learning...  ...illness and hospital indemnity supplemental coverages. ~Legal and identity theft coverage. ~Retirement savings plan. ~... 
    Legal
    Part time
    Work experience placement
    Flexible hours
    Afternoon shift

    Western Governors University

    Remote
    22 days ago
  • $15 - $20 per hour

     ...Role Overview Evaluate AI-generated responses in Bengali, identify factual errors and areas for improvement, and produce clear English-language analyses that will help shape higher-quality model outputs. This role combines fact checking, qualitative judgment, and written... 
    Hourly pay
    Contract work
    Remote work

    SaidGig

    United States
    13 days ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks...  ...production-scale systems . Compensation & Legal ~$400 per accepted task . ~... 
    Legal
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $40 per hour

    A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Iowa, LA
    5 days ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...frontier AI coding agents to complete and evaluate complex engineering tasks. Review model...  ...mobile applications. Compensation & Legal ~$400 per accepted task ~ Typical tasks... 
    Legal
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  •  ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    MERIT Beauty

    New York, NY
    1 day ago
  • $40 per hour

     ...We are looking for a Physics Graduate Assistant to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding... 
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work

    DataAnnotation

    Charleston, WV
    5 days ago
  • $40 per hour

    A technology company specializing in AI is seeking a Physics Graduate Assistant to enhance AI models. You will evaluate AI chatbot outputs and provide complex physics problems. Ideal candidates will have a strong understanding of classical mechanics, E&M, thermodynamics... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

     ...technology company is seeking a Physics Graduate Assistant to join their team in a remote position. The role involves training AI models by evaluating their outputs and improving their quality through complex physics problems. Candidates should have a strong grasp of... 
    Hourly pay
    Contract work
    Remote work

    DataAnnotation

    Indiana, PA
    5 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    5 days ago
  • $20 per hour

    A tech company specializing in AI is looking for a Digital Web Designer to evaluate AI-generated designs and help train models for better aesthetic understanding. This is a remote position open solely to applicants in the United States. The role involves assessing UI/UX... 
    Remote work

    DataAnnotation

    Helena, MT
    1 day ago
  •  ...Seeking a PhD-level expert in Quantitative Finance, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate responses, contributing to the training of advanced AI models in a flexible contract role.... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    1 day ago
  • $40 per hour

     ...We are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Indiana, PA
    5 days ago
  • $20 per hour

    A tech company specializing in AI is seeking an Experience Designer to evaluate and enhance AI-generated UI/UX designs. This remote position allows for flexible scheduling and offers competitive pay rates starting at $20/hour for general projects and $40/hour for design... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have native or professional fluency in French and strong English comprehension. Responsibilities include performing SBS comparisons, evaluating... 
    Local area
    Remote work

    BluePrint Technologies

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Translation AI Evaluator [Remote]. Be the first to apply!