Legal Domain Expert — AI Training & Evaluation [Remote]
$60 - $100 per hourAuraOne Human Data
- Remote job
Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.
Why this role matters
Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.
Responsibilities
- Review AI outputs against current legal review statutes, case law, or policy for Legal Domain Expert — AI Training & Evaluation assignments.
- Verify citations, jurisdictions, and dates against authoritative sources.
- Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
- Capture the corrected analysis or memo paragraph so the modeling team can train on it.
- Adjudicate disputed treatments against published authority or firm policy.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Active or recent qualification in legal review or an adjacent practice for Legal Domain Expert — AI Training & Evaluation work.
- Hands-on experience drafting, reviewing, or advising on real matters.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites authority and names the rule being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Verify the citations in a model's legal review memo and flag any miscites with severity.
- Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
- Adjudicate a disputed treatment between two reviewers using current authority.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Bar admission or legal-equivalent credential in a relevant jurisdiction.
- Prior experience reviewing AI-assisted legal-research or compliance tooling.
- Bilingual experience for cross-jurisdiction matters.
Skills
- Legal research
- Citation review
- Statutory analysis
- Policy reasoning
- Legal review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$60–$100 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...TrainingLegalRemote jobHourly payFlexible hours$60 - $80 per hour
...talent with leading AI research labs.... ...Design challenging, domain-relevant retail tasks... ...retail practice. Evaluate AI model outputs... ...other subject matter experts to ensure consistency... ...and accuracy in training data . Qualifications... ...Compensation & Legal ~ W-2 employment...TrainingLegalContract workSummer workRemote workWeekday work- ...Join an innovative AI initiative... ...and reason about legal concepts. We are seeking... ...world expertise by evaluating AI-generated content... ...of subject matter experts to improve AI... ...variety of legal domains. Help ensure AI... ...Experience mentoring, training, or reviewing legal...TrainingLegalPart timeRemote work10 hours per weekFlexible hours
$140 per hour
...improve how next-generation AI systems learn, reason, and perform. As an AI Domain Expert you will evaluate AI outputs, create challenging... ...actionable feedback that helps train and validate advanced models.... ..., finance, data science, legal practice, or equivalent. Proven...TrainingLegalRemote jobHourly payPart timeFor contractorsVisa sponsorshipWork visaFree visa$30 per hour
Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu...TrainingLegalRemote jobWork from homeFlexible hours$30 per hour
Prolific is seeking fluent Hindi speakers to join its Expert Network and assist in training AI models using legal expertise. Responsibilities include analyzing, editing, and writing in Hindi, judging AI responses, and enhancing AI models. Ideal candidates should have strong...TrainingLegalRemote jobWork from homeFlexible hours- Prolific is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role involves completing AI training tasks, judging AI performance, and improving AI models using legal expertise. Candidates must have strong English skills, attention to detail...TrainingLegalRemote jobSelf employmentWork from homeFlexible hours
- ...Finance Domain Expert AI Training & Evaluation Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise... ...into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be...TrainingLegalFull timeContract workPart timeFreelanceLive inRemote work
$50 per hour
Military Operations & IHL Expert.AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse... ...subject matter knowledge across domains such as finance, heal... Show... ...within military, governmental, legal, or think-tank environments. Prior...TrainingLegalRemote jobHourly payFull timeContract workPart timeFor contractorsApprenticeshipLocal areaWork from homeDay shift$120 per hour
...Prolific is seeking Licensed Pharmacists to join their Expert Network for AI training. As a Domain Expert, you will evaluate AI responses to pharmaceutical scenarios, offering your expertise for competitive pay of up to $120 USD/hr. Ideal candidates will have a current...TrainingRemote workWork from homeFlexible hours- Prolific is seeking Mental Health Professionals to train and evaluate AI models. Candidates will review psychological scenarios, analyze content... ...professionals and must complete a quick skills assessment to join Prolific’s Domain Expert Network. #J-18808-Ljbffr ProlificTrainingRemote jobFlexible hours
$8 - $65 per hour
Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive...TrainingRemote jobFlexible hours$8 - $65 per hour
Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates...TrainingRemote jobHourly payWork from homeFlexible hours$30 per hour
Prolific is seeking Advanced Polish Speakers to participate in training and evaluating AI models. As a Domain Expert, you will complete tasks like analyzing, editing, and writing Polish content while ensuring the performance of AI systems is up to standard. This role offers...TrainingRemote jobSelf employmentFlexible hours$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...agents to complete and evaluate complex machine learning and... ...implementations involving model training , inference systems , MLOps... ...production. Compensation & Legal ~$400 per accepted task...TrainingLegalFull timeContract workSummer workRemote work$120 per hour
...not just another player in the AI space - we are building the... ...Licensed Pharmacists to help train and evaluate cutting‑edge AI models. As AI... ...be guided by pharmaceutical experts. If you have the necessary experience... ...to join Prolific as a Domain Expert, where you’ll be paid...Remote jobSelf employmentWork from homeFlexible hours$30 per hour
...is not just another player in the AI space – we are building the biggest... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving... ...models of the future using professional legal expertise. Once you pass our...LegalRemote workWork from homeFlexible hours$100 per hour
...Prolific is not just another player in the AI space – we are building the biggest pool of quality... ..., and skills. The role We’re looking for Legal Subject Matter Experts to join our Expert Network to help train and evaluate cutting‑edge AI models using professional legal...TrainingLegalHourly payRemote workWork from homeFlexible hours- AuraOne is seeking a Ukrainian Law Expert for the Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote). This remote review track evaluates AI outputs in legal review workflows, with tasks... ...corrected reasoning for training the model. #J-18808-Ljbffr AuraOneTrainingLegalRemote jobFor contractors10 hours per weekFlexible hours
$100 per hour
Prolific is seeking Legal Subject Matter Experts in Seattle to train and evaluate AI models using legal insight. Candidates will review documents, provide expert feedback, and ensure information accuracy. A legal degree or qualifications (JD, LLB, LLM) is required along...TrainingLegalRemote jobHourly payFlexible hours$100 per hour
Prolific is looking for Legal Professionals to join their Expert Network in Columbus, Ohio. Candidates will provide legal insights to train and evaluate AI models, completing paid tasks at rates of up to $100 per hour based on experience. The role demands a legal background...TrainingLegalRemote jobHourly pay$100 per hour
Prolific in Portland, Oregon is seeking Legal Professionals to help train AI models by providing expert legal insights. Candidates will evaluate documents for accuracy, guide AI model development with legal content, and ensure that AI outputs meet professional standards...TrainingLegalRemote jobHourly payFlexible hours$80 - $120 per hour
Role Description ~Evaluate AI-generated artifacts against domain-specific quality rubrics. ~Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks. ~Provide clear, structured written feedback to improve AI model outputs....Part timeWork at officeRemote work$50 - $90 per hour
...role applies deep operational and legal expertise to shape how AI systems understand and evaluate military and humanitarian... ...providing structured guidance for AI training and assessment. Design... ...prior AI experience required; domain knowledge is the primary qualification...TrainingLegalRemote jobHourly payFor contractors$50 - $60 per hour
...DataAnnotation is looking for an Appellate Attorney to help train AI models by providing complex legal problems and evaluating AI outputs. This role is ideal for General Counsel or those with similar legal expertise. Contract details include working on your own schedule...TrainingLegalHourly payContract workRemote work$40 - $65 per hour
...how next-generation AI systems understand... ...by providing expert analyses, valuations... ...role contributes domain knowledge and clear... ...valuations, for AI training purposes. Review... ...nuances in legal and regulatory frameworks... ...AI data training, evaluation, or technology-...TrainingLegalHourly payFor contractorsRemote work10 hours per week$150 - $180 per hour
...in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological... ...to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly...TrainingRemote jobWork from home$8 - $65 per hour
...Portland, Oregon is looking for Mental Health Professionals to help train AI models. You will review AI-generated responses, complete... ...is required, and you will need to complete a skills screener to join Prolific's Domain Expert pool. #J-18808-Ljbffr ProlificTrainingRemote jobHourly payFlexible hours$150 - $180 per hour
Prolific in Sacramento is seeking Mental Health Professionals to help train and evaluate advanced AI models. You will review AI-generated responses and engage in various training tasks, earning competitive pay rates up to $150-180/hr. Ideal candidates must hold a verified...TrainingRemote jobWork from home$8 - $65 per unit
Prolific is seeking Mental Health Professionals to train and evaluate AI models. In this role, you will review AI responses, analyze psychology-related content, and provide feedback to improve models. Applicants must have verified status as a Mental Health Professional...TrainingRemote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Legal Domain Expert — AI Training & Evaluation [Remote]. Be the first to apply!





