Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Translation AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Legal Translation AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Legal Translation AI Evaluator assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Legal Translation AI Evaluator work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review
  • Localization review
  • Cultural context
  • Language evaluation
  • Legal
  • Translation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Legal Translation AI Evaluator [Remote] in Remote vacancy
  • $14.5 per hour

     ...diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...  ...? Join our team as a Web Search Evaluator and help shape the future of search engines...  ...in the digital landscape, apply today ! Legal Requirements: In compliance with federal... 
    Legal
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    4 days ago
  • $80 - $120 per hour

    Mercor in New York, NY, is looking for a Legal contracts / diligence / redlines Evaluator to assess AI-generated artifacts. This role requires 5+ years of relevant experience and native or professional fluency in English. The ideal candidate will evaluate quality rubrics... 
    Legal
    Remote job

    Mercor

    New York, NY
    1 day ago
  • $190 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...RemoteCommitment:20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows,...  ...hours on prior projects. Compensation & Legal Hourly contractor. Experts added to the... 
    Legal
    Remote job
    Hourly pay
    For contractors
    Summer work
    Trial period

    United States Digital Space LLC

    New York, NY
    2 days ago
  • A leading AI consultancy firm is seeking legal consultants for project-based opportunities involving testing and improving AI systems. Candidates should have a degree in law and at least 2 years of legal experience within US jurisdiction. Strong written English is required... 
    Legal
    Permanent employment
    Freelance
    Remote work
    10 hours per week

    Mindrift

    Kansas City, MO
    1 day ago
  • $20 - $80 per hour

     ...Role Overview Train and evaluate next-generation AI systems by scoring model outputs, annotating real-world content, and delivering clear, actionable...  ..., including business, finance, marketing, healthcare, and legal topics. Qualifications Bachelor’s degree required.... 
    Legal
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    23 days ago
  • Mercor is seeking experienced Clinical Law Professors and Clinic Directors to evaluate AI-generated legal reasoning in civil legal services. Experts will blend doctrinal knowledge with practical supervision to assess AI analyses. Applicants should hold a JD with active... 
    Legal
    Remote job

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

    Litigation Legal Assistant role supporting respected Managing Partner and team, in a firm with hybrid work, great benefits and opportunities for bonuses! LOCATION: Portland, OR SALARY: $63,000-$82,000/year DOE SCHEDULE: Full-time; Monday-Friday | Hybrid (3 days in office... 
    Legal
    Remote job
    Hourly pay
    Full time
    Work at office
    Local area
    Monday to Friday
    Flexible hours

    Mercor

    Portland, OR
    2 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... 
    Legal
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Chicago, IL
    14 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ..., Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour... 
    Legal
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Chicago, IL
    14 days ago
  • $30 per hour

     ...Prolific is not just another player in the AI space - we are building the biggest pool...  ...as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple...  ...models of the future using professional legal expertise. Once you pass our assessment,... 
    Legal
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  •  ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy,...  ...Privacy law content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    26 days ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...frontier AI coding agents to complete and evaluate complex engineering tasks. Review model...  ...mobile applications. Compensation & Legal ~$400 per accepted task ~ Typical tasks... 
    Legal
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    23 days ago
  • $80 - $120 per hour

     ...Overview Assess the accuracy, rigor, and domain quality of AI-generated legal work products related to intellectual property, trademark, and...  ..., and slide decks, for legal accuracy and domain rigor. Evaluate outputs against domain-specific quality rubrics and grading... 
    Legal
    Hourly pay
    Work at office
    Local area
    Remote work

    SaidGig

    United States
    1 day ago
  • $80 - $120 per hour

     ...Role Overview Apply your legal and compliance expertise to assess AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and overall...  ...defined quality standards. Key Responsibilities Evaluate AI-generated work products against legal and... 
    Legal
    Hourly pay
    Work at office
    Remote work

    SaidGig

    United States
    1 day ago
  •  ...Trust and Safety Policy AI Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft...  ...documentation Trust and Safety Policy AI evaluation Legal reasoning Policy review Risk analysis Trust Safety... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    23 days ago
  •  ...Securities Regulation AI Evaluator is a remote evaluation track for reviewing securities regulation ai evaluation prompts and responses...  ...Inter-rater calibration Securities Regulation AI evaluation Legal reasoning Policy review Risk analysis Securities... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    17 days ago
  •  ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade...  ...Structured clinical writing Clinical review Legal reasoning Policy review Risk analysis Healthcare Compliance... 
    Legal
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    15 days ago
  •  ...Insurance Policy AI Evaluator is a remote review track for evaluating AI outputs across insurance workflows. Reviewers grade calculations...  ...review Regulatory standards Risk assessment Insurance Legal reasoning Policy review Risk analysis Policy Work... 
    Legal
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    21 days ago
  •  ...Health Prof/TechnicalFull TimeVariableVariedThe Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive,...  ...purpose and need for hospitalization.Demonstrate knowledge of all legal statuses for patients and ensure the completion of appropriate... 
    Legal

    HealthAlliance of the Hudson Valley

    Poughkeepsie, NY
    1 day ago
  •  ...prescription coverage, Rx ’n Go, and Teladoc Comprehensive dental and vision benefits Employee Assistance Program, including counseling, legal, and financial serviceFlexible spending (FSA) and health savings (HSA) accounts Life and Disability insurance benefits Education/In-... 
    Legal
    Full time
    Local area

    PAM Health

    Humble, TX
    1 day ago
  • $65 - $70 per hour

    OpenTrain AI is seeking a U.S. Sales Tax Statute AI Evaluator to review AI-generated translations of sales and use tax statutes across U.S. jurisdictions. This remote contract...  ...emphasizes statutory precision and evaluating legal translations rather than routine tax... 
    Legal
    Remote job
    Hourly pay
    Contract work

    OpenTrain AI

    Brooklyn, NY
    5 days ago
  •  ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This fully remote, flexible contract role values strong critical thinking and quality instincts, with no technical background required beyond... 
    Contract work
    Remote work
    Flexible hours

    Alignerr

    Peru, IL
    1 day ago
  •  ...Description Job Description Bilingual Licensed Psychologist Evaluator (Remote Position) Job Type: Part-Time Flexible Schedule...  ...originally focused on healthcare staffing, we’ve expanded into legal and other domains to meet evolving workforce needs across industries... 
    Legal
    Part time
    For contractors
    Remote work
    Flexible hours

    Protouch Staffing

    San Francisco, CA
    2 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    1 day ago
  •  ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong... 
    Freelance
    Remote work

    Lilt

    New York, NY
    4 days ago
  • $14.5 per hour

     ...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years...  ...performance and provide insights on relevance and quality. Evaluate and rate the effectiveness of search engine results to ensure... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Kanz.us

    Dallas, TX
    1 day ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Remote work

    BAM VENTURES LLC

    New York, NY
    5 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    5 days ago
  • $140k - $160k

     ...Reporting to : Divisional Head of Digital, AI and Insights Location : Remote (...  ...prioritizing high-impact opportunities and translating them into scalable AI solutions delivered...  ...other supplemental options, including 401k, legal, disability, and theft insurance, to... 
    Legal
    Permanent employment
    Work at office
    Remote work
    Worldwide

    Tate Access Floors Inc

    Red Lion, PA
    16 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Translation AI Evaluator [Remote]. Be the first to apply!