Operational Law Attorney SME — Legal AI Evaluation (Remote)
AuraOne Human Data
Remote
- Remote job
Operational Law Attorney SME — Legal AI Evaluation (Remote) is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.
Why this role matters
Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.
Responsibilities
- Review AI outputs against current legal review statutes, case law, or policy for Operational Law Attorney SME — Legal AI Evaluation (Remote) assignments.
- Verify citations, jurisdictions, and dates against authoritative sources.
- Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
- Capture the corrected analysis or memo paragraph so the modeling team can train on it.
- Adjudicate disputed treatments against published authority or firm policy.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Active or recent qualification in legal review or an adjacent practice for Operational Law Attorney SME — Legal AI Evaluation (Remote) work.
- Hands-on experience drafting, reviewing, or advising on real matters.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites authority and names the rule being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Verify the citations in a model's legal review memo and flag any miscites with severity.
- Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
- Adjudicate a disputed treatment between two reviewers using current authority.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Bar admission or legal-equivalent credential in a relevant jurisdiction.
- Prior experience reviewing AI-assisted legal-research or compliance tooling.
- Bilingual experience for cross-jurisdiction matters.
Skills
- Legal research
- Citation review
- Statutory analysis
- Policy reasoning
- Legal review
- Legal
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Operational Law Attorney SME — Legal AI Evaluation (Remote) in Remote vacancy
$260k
...transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-... ...customers, lawyers evaluate and grade its... .... As a Contract Attorney, you will have the... ...transactional law. ~ Experience... ...and location: Remote, your own schedule...Remote workLegalHourly payContract workPart timeFor contractorsWeekend work$95 - $150 per hour
...Role Title: Operational Law Attorney (JAG) SME Role Type: Contractor Location: Remote micro1 is engaging Operational... ...addressing the legal boundaries of military... ...surveillance/privacy evaluations. In this role, you'll... ...train next-generation AI systems. Your work will...Remote workLegalContract workFor contractorsWork at office$45 - $55 per hour
Consilio LLC is seeking an AI Expert Contributor (Attorney) for a remote, part-time role in the United States. You will apply real attorney judgment to evaluate legal questions, refine rubrics, and ensure objective grading criteria for AI-generated legal work. Responsibilities...Remote jobLegalPart timeImmediate start- ...Military lawyers with operational law experience write and sort... ..., give reasoned legal judgments on unclear scenarios... ..., and grade how an AI model handles military... .... The contract is remote. Pay, hours and country... ...law, cyber law or AI evaluation Suits current or former...Remote workLegalContract workWork at office
$50 - $90 per hour
Apply military operations and international humanitarian law expertise to evaluate AI systems, build conflict-risk frameworks, and... ...defense and humanitarian scenarios remotely for $50 to $90 per hour.... ...turn complex operational and legal issues into clear guidance for...Remote workLegalHourly payContract workPart timeWorldwide- ...partner is looking for an Attorney, Evaluation Operations (Contract) based in the United... ..., and reliability of AI-powered legal solutions. In this position... ...technology while working remotely on your own schedule. The... ...active license to practice law in at least one U. S. jurisdiction...Remote workLegalFull timeContract workFlexible hoursWeekend work
- UK Commercial Banking Operations Expert - AI Evaluation Project About the Project Truelancer... ...reviewing a simulated SME/mid-market banking environment... ...Wealth management Audit Legal Compliance without hands-... ...operations experience Engagement Remote Part-time / project-based...Remote workLegalPart timeFlexible hours
$75k
Since 2020, Lisinski Law Firm has served as a... ...About the Role The Operational Staff Attorney reviews immigration applications... ..., templates, and legal strategy, completes... ...legal guidance. Evaluate assigned filings and... ...75,000 USD per year (Remote (United States)) #J-...Remote workLegalInternshipMonday to FridayFlexible hours- ...A leading AI research accelerator is seeking a Licensed Attorney to enhance AI systems through legal expertise. Responsibilities include writing... ...legal analyses, evaluating AI responses, and collaborating... ...offers strong compensation, remote work, and project durations...Remote workLegalFreelance
Turing
Seattle, WA4 days ago $125k - $170k
...Our Story TopDog Law is a nationally... ...building the operations, systems, and teams... .... We're fully remote, and we value... ...Our attorneys help injured people... ...responsible for: Case Evaluation: Review and... ...potential value Legal Representation:... ...intelligence (AI) and automated...Remote workLegalFull timeFor contractorsWork experience placementLocal areaTopdog Law, Llc
Seattle, WA2 days ago- AI Trainer Jobs is seeking a Compliance Attorney for a remote review track within compliance workflows. Reviewers evaluate citation accuracy, statutory reasoning, and policy adherence; flag risk... ...modeling team. The role emphasizes legal research, citation review,...Remote jobLegalHourly payFor contractors
- AuraOne, Inc. seeks a Civil Rights Attorney (BigLaw Firms) for a remote reviewer role evaluating AI-generated legal outputs. You will assess citations, statutory reasoning, and policy adherence, flag risk, and document corrected analysis for training the modeling team....Remote jobLegal
- Jobgether in the United States is seeking a part-time, remote legal specialist to support AI-powered contract review and negotiation. The role focuses... ..., reviewing, and redlining MSAs and NDAs, while evaluating AI-generated legal responses for accuracy and usefulness...Remote jobLegalContract workPart time
- AuraOne is seeking a Junior Transactional Attorney for a remote review track that evaluates AI outputs in legal review workflows. You will grade citation accuracy, statutory reasoning, and policy adherence, flag risk, and document corrected analysis to train the model....Remote jobLegal10 hours per week
- Remotebridge is seeking Junior Transactional Attorneys for a part-time, remote contract role focused on AI-enabled contract review. Early-... ...trained and applied in real-world legal work. You will perform simulated negotiations, evaluate AI responses, and provide structured...Remote jobLegalContract workPart time
- AuraOne, Inc. seeks a remote Military Law Attorney reviewer to assess AI outputs for citation accuracy, statutory reasoning... ...analyses for model training, operating as a contractor with flexible... ...The role requires active or recent legal review qualifications, hands-on matter...Remote jobLegalFor contractorsFlexible hours
- A leading AI consultancy firm is seeking legal consultants for project-based opportunities involving testing... ...Candidates should have a degree in law and at least 2 years of legal experience... ...phases. Opportunities are available remotely for qualified candidates. #J-18808-...Remote workLegalPermanent employmentFreelance10 hours per week
$50 per hour
AI Trainer Jobs seeks a Criminal Defense Attorney to join a remote review track evaluating AI outputs in legal review workflows. Reviewers assess citations, statutory reasoning, and policy adherence; flag risk and document corrected analyses to train the model. The role...Remote jobLegalHourly payFor contractors$104k - $156k
...Are you a legal professional with litigation experience... ...to shape the future of AI? Large-scale language... ...prompts and improve evaluation metrics. A JD or equivalent... ...apply. Job title: Attorney Specialist - AI Trainer... ...Workplace type: Remote Seniority level: Mid...Remote workLegalHourly payContract workFor contractorsFreelance- agency, a remote contractor opportunity, seeks a Senior Litigation Attorney Specialist to shape AI-driven legal reasoning and practice. You will analyze AI-generated outputs, advise... ...strategy, and help refine prompts and evaluation standards. Requirements include a JD and...Remote jobLegalFor contractors
$40 - $70 per hour
Litigation Attorney Specialist - Freelance Project... ...the future of AI? Large-scale language... ...powerful engines of legal reasoning and... ...litigation scenarios, evaluate arguments and authorities... ...to practice law are required. Candidates... ...Workplace type: Remote Seniority level: Senior...Remote jobLegalHourly payContract workFor contractorsFreelanceWorldwide$60 per hour
...technology firm based in the United States is seeking legal consultants for project-based AI opportunities. The role involves generating prompts, evaluating AI solutions, and improving AI reasoning. Candidates should have a law degree and at least two years of legal...LegalFreelanceFlexible hours$60 per hour
A specialized legal consulting firm seeks legal consultants and attorneys familiar with US law for part-time, project-based roles. The position involves generating prompts for AI, evaluating AI solutions for correctness, and improving AI reasoning. Ideal candidates possess...LegalPart timeFreelance10 hours per weekFlexible hours$60 per hour
Mindrift in New York, NY is seeking a Freelance US Law Attorney — AI Project Evaluator. The role is part-time and non-permanent, focusing on evaluating AI systems and assessing legal risk in a dynamic consulting environment. The position requires a law degree, at least...LegalHourly payPermanent employmentPart timeFreelanceFlexible hours$60 per hour
A tech consulting firm is seeking legal consultants to engage in project-based opportunities evaluating AI systems. Ideal candidates include those with a law degree and experience in US law, able to commit to part-time tasks of 10-20 hours a week. As contributors, you will...LegalPart timeFreelance$60 per hour
A specialized AI consultancy is seeking legal consultants for project-based roles evaluating AI systems. Ideal candidates will have a law degree and at least two years of legal practice experience within US jurisdiction. Responsibilities include generating prompts to challenge...LegalPart timeFreelance10 hours per week$60 per hour
A tech consulting firm is seeking legal consultants or attorneys experienced in US law to evaluate AI systems on a project basis. This role requires strong written English proficiency and a degree in law. Contributors will generate prompts, assess AI solutions, and improve...LegalHourly payFreelance10 hours per week$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience... ...are hiring a Freelance US Law Attorney — AI Project Evaluator in New...LegalPermanent employmentPart timeFreelanceImmediate startFlexible hours- SME Careers, a subsidiary of SuperAnnotate, is seeking a Legal & Compliance SME for an hourly remote contractor role. You will create realistic scenarios, evaluate AI-generated content, and design rigorous rubrics for professional analysis. You will translate nuanced legal...Remote jobLegalHourly payFor contractors
$60 per hour
A tech consulting firm is seeking legal consultants with US law experience for part-time, project-based opportunities. You will generate prompts for AI, evaluate solutions, and improve reasoning standards. Ideal candidates have a law degree and 2+ years of legal experience...LegalPart timeFreelance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Operational Law Attorney SME — Legal AI Evaluation (Remote). Be the first to apply!
