Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation [Remote]
$100 - $150 per hourAuraOne Human Data
- Remote job
Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.
Why this role matters
Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.
Responsibilities
- Review AI outputs against current legal review statutes, case law, or policy for Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation assignments.
- Verify citations, jurisdictions, and dates against authoritative sources.
- Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
- Capture the corrected analysis or memo paragraph so the modeling team can train on it.
- Adjudicate disputed treatments against published authority or firm policy.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Active or recent qualification in legal review or an adjacent practice for Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation work.
- Hands-on experience drafting, reviewing, or advising on real matters.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites authority and names the rule being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Verify the citations in a model's legal review memo and flag any miscites with severity.
- Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
- Adjudicate a disputed treatment between two reviewers using current authority.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Bar admission or legal-equivalent credential in a relevant jurisdiction.
- Prior experience reviewing AI-assisted legal-research or compliance tooling.
- Bilingual experience for cross-jurisdiction matters.
Skills
- Legal research
- Citation review
- Statutory analysis
- Policy reasoning
- Legal review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$100–$150 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and... ...and attention to detail, and be willing to take a skills verification test. #J-18808-Ljbffr ProlificLegalRemote jobHourly payFlexible hours- ...AI systems understand, interpret, and reason about legal concepts. We are seeking experienced legal... ...their real-world expertise by evaluating AI-generated content, providing subject... ...multidisciplinary team of subject matter experts to improve AI performance across a variety...LegalPart timeRemote work10 hours per weekFlexible hours
$35 - $42 per hour
..., insurance, compliance, and legal professionals to join our growing network of on-call AI Evaluation Specialists supporting the development... ...network of subject matter experts. As client projects become... ...for factual accuracy, reasoning quality, and business relevance...LegalHourly payExtra incomePermanent employmentFull timeContract workTemporary workRemote workFlexible hours- ...Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities... ...) through high-quality human feedback, evaluation, and training data. Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-...SuggestedContract workTemporary workFor contractorsFreelanceRemote work
- ...generation of AI systems to reason about and work with... ...to think like skilled legal professionals. Our goal... ...to build high-quality evaluation and training datasets that... ...researchers and legal experts shaping foundational... ...Experience ~ Juris Doctor (J.D.) from an accredited...LegalFor contractorsRemote workFlexible hours
$30 per hour
...and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving... ...models of the future using professional legal expertise. Once you pass our assessment... ...Prolific use of your personal personal information. #J-18808-Ljbffr ProlificLegalRemote jobWork from homeFlexible hours- ...is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role... ...performance, and improving AI models using legal expertise. Candidates must have strong English... ...home, making it ideal for self-employed language specialists. #J-18808-Ljbffr ProlificLegalRemote jobSelf employmentWork from homeFlexible hours
$70 - $75 per hour
...looking for a Knowledge Expert - Math for Meta. This is... ...model performance in your legal domain. Create and maintain... ...and detailed rubrics / evaluation frameworks to assess legal reasoning across tasks. Design challenging... ...with the help of AI. #J-18808-Ljbffr Tundra...LegalFull timeContract workFor contractorsRemote workFlexible hours$120 per hour
...Jack Dorsey . Position: Expert Software Engineer – Scala /... ...Role Responsibilities Evaluate complex technical tasks using... ...to articulate technical reasoning clearly in writing. Preferred... .... Compensation & Legal Hourly contractor...LegalHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$100 per hour
...The role We’re looking for Legal Subject Matter Experts to join our Expert Network to help train and evaluate cutting‑edge AI models using... ...providing logical, fact‑based reasoning to support your answers. Reliability... ...use of your personal information. #J-18808-Ljbffr ProlificLegalRemote jobHourly payWork from homeFlexible hours$60 - $100 per hour
.... Overview We are hiring a senior legal domain expert to work directly with a leading AI lab... ..., improving how frontier AI models reason about real legal work. Your legal expertise... ...: Design challenging legal tasks and evaluation sets, and help build legal-specific...LegalFull timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package$126k
...Incident Investigator, Expert. The EII team is responsible... ...tothese factors. A reasonable salary range is:... ...including working with PG&E's Legal team. Prepare and... ...report) and Apparent Cause Evaluations (ACEs), including identifying... ...Professional (PMP) #J-18808-Ljbffr PG&ELegalWork experience placementWork at officeRemote workFlexible hours$43 - $58 per hour
...Critical Infrastructure Expert Trainer Office:... ...on-one tutoring, daily evaluation and monitoring of individual... ...Sick, Safe, or Personal reasons and accrue Vacation at... ...access to counseling, legal support, and financial... ...or national origin. #J-18808-Ljbffr Per ScholasLegalHourly payFull timeContract workTemporary workPart timeWork at officeLocal areaRemote workFlexible hours- ...Military Operations & IHL Expert Role Type: Contractor Location... ...will shape how models learn, reason, and perform through high-... ...of frameworks that responsibly evaluate military and humanitarian scenarios... ...military, governmental, legal, or think-tank environments....LegalFor contractorsRemote work
- ...advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We... ...evaluation problems, assess AI-generated reasoning, and identify technically... ...to benchmarking efforts, and help push the #J-18808-Ljbffr BAM VenturesRemote jobContract workImmediate startFlexible hours
$125 per hour
...challenging physics problems to train and evaluate frontier AI models . Evaluate model outputs... ...or industry researcher. Compensation & Legal W-2 employment with Cincinnatus LLC;... ...contributors continue as long as the program needs their expertise. #J-18808-LjbffrLegal16 hoursContract workPart timeSummer workRemote work$85k - $141k
...Accessibility Subject Matter Expert, you will collaborate directly... ...with compliance testing and evaluation of tools and best practicesExpertise... ..., Accident Insurance, Legal Assistance and ID theft protection... ...required to provide needed reasonable accommodation.All...LegalFull timeRemote workFlexible hours$100 - $150 per hour
...Role Overview Apply your legal judgment to help evaluate and improve advanced AI systems... ...research, drafting, and reasoning tasks. This is an ongoing... .... Qualifications J.D., LL.B., or LL.M., plus a current... ...qualify. Completing the domain-expert interview and joining all...LegalHourly payContract workFor contractorsRemote work- ...Senior Safety Domain Expert - Falcon Team: Product Management... ...public benefit corporation (PBC), legally bound to balancing the... ...Verification: Actively review, evaluate, and verify AI-driven platform... ...and calibrate the platform's reasoning boundaries Requirements...LegalWork at officeRemote workWork from homeShift work3 days per week
$400 per unit
...Description Role Overview: We are seeking experienced legal professionals to generate, evaluate, and refine expert-level tasks related to the work of lawyers. The... ...attention to detail, written communication, legal reasoning, and ability to incorporate feedback....LegalContract workFreelanceRemote work- ...Senior Safety Domain Expert - Falcon Team: Product Management... ...public benefit corporation (PBC), legally bound to balancing the... ...Verification: Actively review, evaluate, and verify AI-driven platform... ...and calibrate the platform's reasoning boundaries Requirements...LegalWork at officeLocal areaRemote workWork from homeShift work3 days per week
- ...model capabilities in thinking, reasoning, coding, agentic behavior,... ...The individual will analyze legal issues, apply laws and principles... ..., practical advice. Expert knowledge of interpreting laws... ...field. Experience in AI evaluation, data annotation, content review...LegalTemporary workFor contractors
- ...and playbook development to review and evaluate AI-generated legal content. No prior AI experience is... ...contract analysis and provide expert feedback. Develop playbooks, evaluation... ...remotely. Required Qualifications ~ J.D. from an ABA-accredited law school....LegalRemote jobFull timeContract workPart timeFor contractors
$1,000 per month
...or disability status. If you require reasonable accommodation during the application process... ...standards. Complying with all legal standard requirements, which include mandatory... .... Candidates’ Sabre proficiency will be evaluated during the screening process. Minimum...LegalOngoing contractContract workRemote workWork from homeShift work$60 - $100 per hour
Gridnaut Recruiting is hiring a remote Legal Domain Expert — AI Training & Evaluation contractor (pay $60-$100/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: JD from accredited U.S. law school; 5+ years post-qualification legal practice;...LegalContract workFor contractorsRemote workRelocation$50 - $90 per hour
...biosecurity and synthetic biology expertise to evaluate and build biosecurity evaluation... ...knowledge to shape how AI systems learn and reason about biological misuse, biosafety, and public... ...terms; specific tax, contracting, and legal arrangements will follow standard...LegalHourly payFor contractorsRemote work$126k
...as an Incident Investigator, Expert. The EII team is responsible... ...related to these factors. A reasonable salary range is: Minimum... ...including working with PG&Es Legal team. Prepare and submit... ...day report) and Apparent Cause Evaluations (ACEs), including identifying...LegalWork experience placementWork at officeRemote workFlexible hours- ...this role Role Title: AI Domain Expert Role Type: Contractor (Part... ...will shape how models learn, reason, and perform through high-... ...responses and performance. Evaluate and annotate data with keen attention... ..., Finance, Data Science, or Legal, with a proven record of...LegalPart timeFor contractorsRemote work
- ...Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete... ...to work from home, making it a great opportunity for professionals looking to influence future AI developments. #J-18808-Ljbffr...Hourly payRemote workWork from homeFlexible hours
$150 - $180 per hour
...seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI... ...strong attention to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly from home. #J-18808-Ljbffr...Remote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Legal Expert (J.D./LL.B.) — Legal Reasoning Evaluation [Remote]. Be the first to apply!





