Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation [Remote]

$100 - $150 per hour

AuraOne Human Data

Remote
  • Remote job

Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$100–$150 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation [Remote] in Remote vacancy
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and...  ...and attention to detail, and be willing to take a skills verification test. #J-18808-Ljbffr Prolific
    Legal
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  •  ...AI systems understand, interpret, and reason about legal concepts. We are seeking experienced legal...  ...their real-world expertise by evaluating AI-generated content, providing subject...  ...multidisciplinary team of subject matter experts to improve AI performance across a variety... 
    Legal
    Part time
    Remote work
    10 hours per week
    Flexible hours

    Weekday

    Remote
    a month ago
  • $35 - $42 per hour

     ..., insurance, compliance, and legal professionals to join our growing network of on-call AI Evaluation Specialists supporting the development...  ...network of subject matter experts. As client projects become...  ...for factual accuracy, reasoning quality, and business relevance... 
    Legal
    Hourly pay
    Extra income
    Permanent employment
    Full time
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Volga Partners

    Remote
    3 days ago
  •  ...Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities...  ...) through high-quality human feedback, evaluation, and training data. Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-... 
    Suggested
    Contract work
    Temporary work
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    6 days ago
  •  ...generation of AI systems to reason about and work with...  ...to think like skilled legal professionals. Our goal...  ...to build high-quality evaluation and training datasets that...  ...researchers and legal experts shaping foundational...  ...Experience ~ Juris Doctor (J.D.) from an accredited... 
    Legal
    For contractors
    Remote work
    Flexible hours

    Turing

    Chicago, IL
    14 hours ago
  • $30 per hour

     ...and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving...  ...models of the future using professional legal expertise. Once you pass our assessment...  ...Prolific use of your personal personal information. #J-18808-Ljbffr Prolific
    Legal
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  •  ...is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role...  ...performance, and improving AI models using legal expertise. Candidates must have strong English...  ...home, making it ideal for self-employed language specialists. #J-18808-Ljbffr Prolific
    Legal
    Remote job
    Self employment
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    5 days ago
  • $70 - $75 per hour

     ...looking for a Knowledge Expert - Math for Meta. This is...  ...model performance in your legal domain. Create and maintain...  ...and detailed rubrics / evaluation frameworks to assess legal reasoning across tasks. Design challenging...  ...with the help of AI. #J-18808-Ljbffr Tundra... 
    Legal
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    Tundra Technical Solutions

    New York, NY
    4 days ago
  • $120 per hour

     ...Jack Dorsey . Position: Expert Software Engineer – Scala /...  ...Role Responsibilities Evaluate complex technical tasks using...  ...to articulate technical reasoning clearly in writing. Preferred...  .... Compensation & Legal Hourly contractor... 
    Legal
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Remote
    4 hours ago
  • $100 per hour

     ...The role We’re looking for Legal Subject Matter Experts to join our Expert Network to help train and evaluate cutting‑edge AI models using...  ...providing logical, fact‑based reasoning to support your answers. Reliability...  ...use of your personal information. #J-18808-Ljbffr Prolific
    Legal
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York State
    4 days ago
  • $60 - $100 per hour

     .... Overview We are hiring a senior legal domain expert to work directly with a leading AI lab...  ..., improving how frontier AI models reason about real legal work. Your legal expertise...  ...: Design challenging legal tasks and evaluation sets, and help build legal-specific... 
    Legal
    Full time
    Contract work
    Part time
    Freelance
    Internship
    Live in
    Relocation
    Relocation package

    Mercor

    Remote
    a month ago
  • $126k

     ...Incident Investigator, Expert. The EII team is responsible...  ...tothese factors. A reasonable salary range is:...  ...including working with PG&E's Legal team. Prepare and...  ...report) and Apparent Cause Evaluations (ACEs), including identifying...  ...Professional (PMP) #J-18808-Ljbffr PG&E
    Legal
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    PG&E

    Oakland, CA
    2 days ago
  • $43 - $58 per hour

     ...Critical Infrastructure Expert Trainer Office:...  ...on-one tutoring, daily evaluation and monitoring of individual...  ...Sick, Safe, or Personal reasons and accrue Vacation at...  ...access to counseling, legal support, and financial...  ...or national origin. #J-18808-Ljbffr Per Scholas
    Legal
    Hourly pay
    Full time
    Contract work
    Temporary work
    Part time
    Work at office
    Local area
    Remote work
    Flexible hours

    Per Scholas

    Columbus, OH
    3 days ago
  •  ...Military Operations & IHL Expert Role Type: Contractor Location...  ...will shape how models learn, reason, and perform through high-...  ...of frameworks that responsibly evaluate military and humanitarian scenarios...  ...military, governmental, legal, or think-tank environments.... 
    Legal
    For contractors
    Remote work

    ESR Healthcare

    United States
    2 days ago
  •  ...advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We...  ...evaluation problems, assess AI-generated reasoning, and identify technically...  ...to benchmarking efforts, and help push the #J-18808-Ljbffr BAM Ventures
    Remote job
    Contract work
    Immediate start
    Flexible hours

    BAM Ventures

    New York, NY
    5 days ago
  • $125 per hour

     ...challenging physics problems to train and evaluate frontier AI models . Evaluate model outputs...  ...or industry researcher. Compensation & Legal W-2 employment with Cincinnatus LLC;...  ...contributors continue as long as the program needs their expertise. #J-18808-Ljbffr
    Legal
    16 hours
    Contract work
    Part time
    Summer work
    Remote work

    Visa Hunt

    United States
    1 hour ago
  • $85k - $141k

     ...Accessibility Subject Matter Expert, you will collaborate directly...  ...with compliance testing and evaluation of tools and best practicesExpertise...  ..., Accident Insurance, Legal Assistance and ID theft protection...  ...required to provide needed reasonable accommodation.All... 
    Legal
    Full time
    Remote work
    Flexible hours

    Guidehouse

    McLean, VA
    1 day ago
  • $100 - $150 per hour

     ...Role Overview Apply your legal judgment to help evaluate and improve advanced AI systems...  ...research, drafting, and reasoning tasks. This is an ongoing...  .... Qualifications J.D., LL.B., or LL.M., plus a current...  ...qualify. Completing the domain-expert interview and joining all... 
    Legal
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    1 day ago
  •  ...Senior Safety Domain Expert - Falcon Team: Product Management...  ...public benefit corporation (PBC), legally bound to balancing the...  ...Verification: Actively review, evaluate, and verify AI-driven platform...  ...and calibrate the platform's reasoning boundaries Requirements... 
    Legal
    Work at office
    Remote work
    Work from home
    Shift work
    3 days per week

    Veeva Systems

    United States
    14 hours ago
  • $400 per unit

     ...Description Role Overview: We are seeking experienced legal professionals to generate, evaluate, and refine expert-level tasks related to the work of lawyers. The...  ...attention to detail, written communication, legal reasoning, and ability to incorporate feedback.... 
    Legal
    Contract work
    Freelance
    Remote work

    Prointegrate LLC

    Myrtle Point, OR
    4 days ago
  •  ...Senior Safety Domain Expert - Falcon Team: Product Management...  ...public benefit corporation (PBC), legally bound to balancing the...  ...Verification: Actively review, evaluate, and verify AI-driven platform...  ...and calibrate the platform's reasoning boundaries Requirements... 
    Legal
    Work at office
    Local area
    Remote work
    Work from home
    Shift work
    3 days per week

    Ostro by Veeva

    United States
    2 days ago
  •  ...model capabilities in thinking, reasoning, coding, agentic behavior,...  ...The individual will analyze legal issues, apply laws and principles...  ..., practical advice. Expert knowledge of interpreting laws...  ...field. Experience in AI evaluation, data annotation, content review... 
    Legal
    Temporary work
    For contractors

    Turing

    Remote
    6 days ago
  •  ...and playbook development to review and evaluate AI-generated legal content. No prior AI experience is...  ...contract analysis and provide expert feedback. Develop playbooks, evaluation...  ...remotely. Required Qualifications ~ J.D. from an ABA-accredited law school.... 
    Legal
    Remote job
    Full time
    Contract work
    Part time
    For contractors

    YO AI Labs

    Houston, TX
    5 days ago
  • $1,000 per month

     ...or disability status. If you require reasonable accommodation during the application process...  ...standards. Complying with all legal standard requirements, which include mandatory...  .... Candidates’ Sabre proficiency will be evaluated during the screening process. Minimum... 
    Legal
    Ongoing contract
    Contract work
    Remote work
    Work from home
    Shift work

    Teleperformance USA

    Phenix City, AL
    3 days ago
  • $60 - $100 per hour

    Gridnaut Recruiting is hiring a remote Legal Domain Expert — AI Training & Evaluation contractor (pay $60-$100/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: JD from accredited U.S. law school; 5+ years post-qualification legal practice;... 
    Legal
    Contract work
    For contractors
    Remote work
    Relocation

    Gridnaut Recruiting

    Remote
    7 days ago
  • $50 - $90 per hour

     ...biosecurity and synthetic biology expertise to evaluate and build biosecurity evaluation...  ...knowledge to shape how AI systems learn and reason about biological misuse, biosafety, and public...  ...terms; specific tax, contracting, and legal arrangements will follow standard... 
    Legal
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • $126k

     ...as an Incident Investigator, Expert. The EII team is responsible...  ...related to these factors.​   A reasonable salary range is: Minimum...  ...including working with PG&Es Legal team. Prepare and submit...  ...day report) and Apparent Cause Evaluations (ACEs), including identifying... 
    Legal
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    PG&E Corporation Careers

    American Canyon, CA
    1 day ago
  •  ...this role Role Title: AI Domain Expert Role Type: Contractor (Part...  ...will shape how models learn, reason, and perform through high-...  ...responses and performance. Evaluate and annotate data with keen attention...  ..., Finance, Data Science, or Legal, with a proven record of... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    Remote
    6 days ago
  •  ...Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete...  ...to work from home, making it a great opportunity for professionals looking to influence future AI developments. #J-18808-Ljbffr... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    14 hours ago
  • $150 - $180 per hour

     ...seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI...  ...strong attention to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly from home. #J-18808-Ljbffr... 
    Remote work
    Work from home

    Prolific

    Virginia Beach, VA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation [Remote]. Be the first to apply!