Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Domain Expert — AI Training & Evaluation

$60 - $100 per hour

AuraOne Human Data

Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Legal Domain Expert — AI Training & Evaluation assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Legal Domain Expert — AI Training & Evaluation work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review

Work model

Bay Area, CA. Bay Area, CA · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$60–$100 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Legal Domain Expert — AI Training & Evaluation in Bay County, FL vacancy
  •  ...About the Opportunity Our client, a leading AI research organization, is looking for...  ...functional programming expertise to help evaluate and improve how AI systems write, understand...  ...Previous experience contributing to AI training, model evaluation, or coding-agent... 
    Training
    Freelance
    Remote work

    Braintrust

    Bay County, FL
    3 days ago
  •  ...Opportunity Our client, a leading AI research organization, is...  ...credit professionals to help evaluate and improve how AI systems analyze...  ...structured feedback and expert insights to improve AI systems...  ...experience contributing to AI training, model evaluation, or data annotation... 
    Training
    Freelance
    Remote work

    Braintrust

    Bay County, FL
    3 days ago
  •  ...Opportunity Our client, a leading AI research organization, is...  ...finance professionals to help evaluate and improve how AI systems analyze...  ...structured feedback and expert insights to improve AI systems...  ...experience contributing to AI training, model evaluation, or data annotation... 
    Training
    Freelance
    Remote work

    Braintrust

    Bay County, FL
    3 days ago
  • $85 - $120 per hour

     ...Senior Counsel — Legal Domain Expert is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning...  ...the corrected analysis so the modeling team can train on it. Why this role matters Legal review... 
    Legal
    For contractors
    Remote work
    10 hours per week

    AuraOne Human Data

    Bay County, FL
    1 day ago
  • $60 - $100 per hour

     ...Finance Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs across valuation workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct... 
    Training
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne Human Data

    Bay County, FL
    1 day ago
  • $140k - $180k

     ...projects, including its AI-based digital platform...  ...the workflows with domain experts, find the bottleneck,...  ...Provide usable guides, training, and support; observe...  ...untrusted inputs, and evaluate behavior before release...  ...Internet & Data ~ Optional Legal & Pet Insurance Plans... 
    Training
    Legal
    Remote job
    Full time
    Work at office
    Local area
    Flexible hours

    SB Energy

    Bay County, FL
    5 days ago
  • $1,858 per week

     ...physical and emotional needs. Continuously evaluate vital signs, lab results, and cardiac...  ...(EHR). Ensure compliance with all legal, regulatory, and hospital-specific documentation...  ...staff and participate in mentoring or training initiatives. Quality and Compliance:... 
    Training
    Legal
    Full time
    Contract work
    Shift work
    Night shift

    Magnet Medical

    Panama City, FL
    1 day ago
  • $16 per hour

     ...Well established Law Firm seeking a full-time Legal Assistant for our Panama location. The ideal candidate...  ...). ***Starting pay is $16.00 per hour during training and initial work period with raises based upon employee evaluations. Benefits after 60 days and PTO after 90 days.... 
    Training
    Legal
    Hourly pay
    Full time
    Monday to Friday
    Flexible hours

    The Ticket Clinic

    Panama City, FL
    2 days ago
  •  .... About congruentX congruentX is an AI-native CRM modernization and Mission Critical...  ...up to $5,000 Free EAP with counseling, legal, and caregiving support Commuter...  ...programs Free Calm app access On-demand training and professional development congruentX... 
    Training
    Legal
    Full time
    Temporary work
    Internship
    Live in

    congruentX

    Bay County, FL
    4 days ago
  • $104k

     ...Responsibilities Assess, plan, deliver, and evaluate preventive and therapeutic dental care...  ...deployments as required by mission needs. Training & Advancement The Navy is committed to...  ...Hygiene program. Must meet Navy medical, legal, and fitness standards, including normal... 
    Training
    Legal
    Full time
    Temporary work
    Apprenticeship
    Private practice
    Worldwide
    Overseas
    Relocation package
    Afternoon shift
    Early shift

    US Navy

    Callaway, FL
    3 hours ago
  • $145k - $300k

     ...Brain Co. Brain Co. builds AI-native operating systems for large...  ...stakeholder onboarding, training, operating-model changes, and...  ...reusable product capabilities, evaluation patterns, playbooks, templates...  ...Navigate the security, procurement, legal, compliance, and systems-of-... 
    Training
    Legal
    Remote job
    Full time
    Work at office
    Local area
    3 days per week

    brainco

    Bay County, FL
    8 days ago
  •  ...through generous scholarships and specialty training. Key Responsibilities Provide direct...  ...specialties; assess, plan, implement, and evaluate nursing care for individuals and families...  ...involve United States citizenship or other legal residency and work status, depending on... 
    Training
    Legal
    Contract work
    Apprenticeship
    Shift work

    US Navy

    Callaway, FL
    3 hours ago
  •  ...professional nursing consultation, education, training, resource identification and advocacy to...  ...risk reviews and tracking; nursing home evaluations and diversion planning; death reports...  ...and home visits, particularly with the legal department and management team on end of... 
    Training
    Legal
    Full time
    Part time
    Work experience placement
    Work at office

    Commonwealth of Massachusetts

    Bay County, FL
    3 hours ago
  •  ...evidenced-based therapies, in the evaluation, diagnosis, and treatment of...  ...with medical personnel, legal authorities, military commanders...  ...participate in military specific training/activities (e.g., security...  ...program. Loyal Source uses AI-powered voice screening as... 
    Training
    Legal
    Contract work
    For contractors
    Traineeship
    For subcontractor
    Local area
    Worldwide

    Loyal Source

    Bay County, FL
    2 days ago
  •  ...Resilience (PREV WF)/9S682 Compliance and Training Analyst (PREV WF)/04586 Data Scientist (...  ...WF)/9LAR9732 ISDV Prevention Program Evaluation Specialist (PREV WF)/9LAR9952 ISDV Prevention...  ...prevention efforts comply with legal and regulatory requirements and meet customer... 
    Training
    Legal

    Department of the Air Force

    Panama City, FL
    1 day ago
  • $1,853.69 per month

     ...physical and emotional needs. Continuously evaluate vital signs, lab results, and cardiac...  ...(EHR). Ensure compliance with all legal, regulatory, and hospital-specific documentation...  ...staff and participate in mentoring or training initiatives. Quality and... 
    Training
    Legal
    Weekly pay
    Shift work
    Night shift

    Ascension Sacred Heart Bay

    Panama City, FL
    3 days ago
  •  ...basic nursing plan of care treatments, evaluating patient progress towards goals. Participates...  ..., values, and objectives.Observes legal and ethical guidelines for safeguarding...  ...of care.Attends and completes required training modules, in-services, and continuing education... 
    Training
    Legal
    Relief
    Local area

    Option Care

    Panama City, FL
    1 day ago
  •  ...Conduct comprehensive psychological evaluations using clinical interviews, psychological...  ...medical professionals, military commanders, legal authorities, and other appropriate personnel...  ...in military-specific assessments and training, including command-directed evaluations,... 
    Training
    Legal
    Full time
    Internship
    Monday to Friday
    Shift work
    Weekday work

    The Columbus Organization

    Panama City, FL
    2 days ago
  • $220k - $250k

     ...Kodiak AI, Inc. (Nasdaq: KDK), founded in 2018, is a leader in...  ...infertility benefits) ~ MetLife Legal Services, Identity & Fraud...  ...location, experience, relevant training, education, skill level and performance...  ...applications. As part of the evaluation process, we provide Endorsed... 
    Training
    Legal
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    Bay County, FL
    2 hours ago
  • $38.84 - $64.72 per hour

     ...basic nursing plan of care treatments, evaluating patient progress towards goals. Participates...  ..., values, and objectives. Observes legal and ethical guidelines for safeguarding...  ...care. Attends and completes required training modules, in-services, and continuing education... 
    Training
    Legal
    Part time
    Relief
    Local area

    Naven Health

    Panama City, FL
    3 days ago
  • $3,700.71 per month

     ...psychological practice. Conduct psychological evaluations utilizing information from clinical...  .... Consult with medical personnel, legal authorities, and other relevant parties...  ...required. Participate in military-specific training, including training for assessments and... 
    Training
    Legal
    Weekly pay
    Internship
    Monday to Friday
    Shift work

    325th Medical Group at Tyndall Air Force Base

    Panama City, FL
    5 days ago
  •  ...ResponsibilitiesPatient Assessment: Conduct comprehensive evaluations of speech, language, voice, and...  ...plans, ensuring compliance with legal and ethical standards.Collaboration:...  ..., termination, layoff, recall, transfer, leaves of absence, compensation and training.... 
    Training
    Legal
    Part time
    Relief
    Local area
    Flexible hours

    HealthPRO Heritage

    Panama City Beach, FL
    5 days ago
  • $146.37k - $221.4k

     ...that power our HR workflows and AI initiatives. Our People...  ...scalability, and reliability. Evaluate and implement emerging...  ...business—through documentation, training, technical support, and troubleshooting...  ...to secure and maintain the legal right to work at the company... 
    Training
    Legal
    Remote job
    Full time
    Work experience placement
    Flexible hours

    Samsara

    Bay County, FL
    1 day ago
  • $300k - $350k

     ...compliance, trading and investment compliance, regulatory matters, training, and due diligence. Oversee the Code of Ethics, proxy voting...  ...key governance committees. Partner closely with investment, legal, finance, technology, and other business functions to provide... 
    Training
    Legal
    Full time

    Cardea Group

    Bay County, FL
    2 days ago
  •  ...Marshals—commonly called FAMs—are highly trained federal law enforcement officers who...  ...and seek or execute warrants within their legal authority Participate in multi-agency...  ...Must pass required drug screening, medical evaluation, physical testing, and polygraph... 
    Training
    Legal
    Full time
    Temporary work
    Work at office
    Local area
    Night shift

    Airport Security Hiring

    Fountain, FL
    19 days ago
  •  ...execute maritime warfare, logistics, and amphibious operations; train and mentor Sailors, drive maintenance and material readiness, and...  ...Navy, which may involve United States citizenship or other legal residency and work status, depending on the program and current... 
    Training
    Legal
    Contract work
    Apprenticeship
    Work at office
    Worldwide

    US Navy

    Callaway, FL
    3 hours ago
  •  ...Marshals—commonly called FAMs—are highly trained federal law enforcement officers who...  ...and seek or execute warrants within their legal authority Participate in multi-agency...  ...Must pass required drug screening, medical evaluation, physical testing, and polygraph... 
    Training
    Legal
    Full time
    Temporary work
    Work at office
    Local area
    Night shift

    TSA Hiring Center

    Youngstown, FL
    19 days ago
  •  ...financing loans. ~ Carefully assesses and evaluates the risk of financing requests within...  ...with attorneys and other financial or legal resources to obtain correct and accurate...  ...~ Assists in the development and training of Commercial Loan Department personnel.... 
    Training
    Legal
    Full time
    Self employment
    Bank staff
    Local area

    SNI Financial

    Bay County, FL
    2 days ago
  •  ...partners with firefighters and police in evaluating the situation. The Paramedic offers...  ...delivering patient care consistent with training and level of certification. What you...  ...protection plans, auto and home insurance, legal counseling, identity theft protection and... 
    Training
    Legal
    Temporary work
    Flexible hours

    HCA Mission Hospital - Memorial Campus

    Panama City, FL
    1 day ago
  •  ...Interested in law enforcement, corrections, or the legal system? Many roles in the field look for formal criminal justice education...  ...so you can compare your options. Good to know This is a training program, not a job, and completing it does not guarantee employment... 
    Training
    Legal

    Dreambound

    Panama City Beach, FL
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Domain Expert — AI Training & Evaluation. Be the first to apply!