Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Domain Expert, AI Training & Evaluation

$60 - $100 per hour
Temporary

Mercor

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models.

1. Overview

We are hiring a senior legal domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real legal work.

Your legal expertise is the substance of this role. You will review the quality of legal knowledge work tasks, write the instruction specs and golden solutions that define what "correct" looks like, and build the benchmarks that show whether the model is genuinely improving. We are looking for a practising specialist rather than a generalist.

This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. You will be provisioned with client-issued accounts and equipment, and will work inside the client's own tools alongside their research teams.

Location: This is a hybrid role based in the Bay Area, California . You must live in the Bay Area and work on-site with the client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts, relocation assistance is not provided.

2. Key Responsibilities

  • Data QA and reviews: Vet the quality of legal knowledge work tasks and model outputs, spotting missing behaviors, thin reasoning, and answers that read well but would not survive professional scrutiny.
  • Instruction specs and golden datasets: Write high-quality instruction specs, produce golden solutions to legal problems, and define new legal tasks that reflect how the work is actually done in practice.
  • Benchmarks and domain depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills and tools together with the research team.
  • Calibration: Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit legal judgment into explicit, teachable criteria.

3. Core Qualifications

  • Education: Juris Doctor (JD) from an accredited law school; a highly ranked school is strongly preferred.
  • Experience: 5+ years of substantive post-qualification legal practice at a reputable institution, an established law firm, a corporate legal department, a regulatory body, or a court. Internships and clerkships alone do not count.
  • Domain depth: Genuine specialization in at least one substantive practice area, for example corporate and transactional, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labor, or tax.
  • Seniority: Clear progression to a senior level, partner, of counsel, counsel, senior associate, senior in-house counsel, or general counsel, with real ownership of matters.
  • Licensure: Active admission to at least one U.S. state bar, in good standing.
  • AI fluency: Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one.
  • Availability: Able to commit reliably to 40 hours per week for an initial engagement of 6 months.
  • Location: Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost; relocation assistance is not provided.
  • Excellent written communication, and the ability to give precise, well-structured written feedback.

About Cincinnatus LLC

Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve part-time or full-time commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows.

Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC.

Equal Employment Opportunity

Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Legal Domain Expert, AI Training & Evaluation in Remote vacancy
  • $60 - $100 per hour

     ...Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team... 
    Training
    Legal
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...About this role Role Title: AI Domain Expert Role Type: Contractor (Part...  ...apply your expertise to help train next-generation AI systems....  ...responses and performance. Evaluate and annotate data with keen attention...  ..., Finance, Data Science, or Legal, with a proven record of... 
    Training
    Legal
    Part time
    For contractors
    Remote work

    micro1

    Remote
    2 days ago
  •  ...Join an innovative AI initiative...  ...and reason about legal concepts. We are seeking...  ...world expertise by evaluating AI-generated content...  ...of subject matter experts to improve AI...  ...variety of legal domains. Help ensure AI...  ...Experience mentoring, training, or reviewing legal... 
    Training
    Legal
    Part time
    Remote work
    10 hours per week
    Flexible hours

    Weekday

    Remote
    a month ago
  • $35 - $42 per hour

     ...Shape the Future of AI in Finance, Audit...  ..., compliance, and legal professionals to...  ...network ofon-call AI Evaluation...  ...the development, training, and evaluation of...  ...of subject matter experts. As client projects...  ...multiple business domains. Receive consideration... 
    Training
    Legal
    Hourly pay
    Extra income
    Permanent employment
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Dorado

    Brooklyn, NY
    4 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models... 
    Training
    Legal
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $30 per hour

    Prolific is looking for Fluent Urdu Speakers to join our Expert Network to help train AI models using real legal expertise. The role involves completing tasks that require one hour of uninterrupted work, with pay rates of up to $30/hr. Candidates must possess advanced Urdu... 
    Training
    Legal
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join its Expert Network and assist in training AI models using legal expertise. Responsibilities include analyzing, editing, and writing in Hindi, judging AI responses, and enhancing AI models. Ideal candidates should have strong... 
    Training
    Legal
    Remote job
    Work from home
    Flexible hours

    Prolific

    Chicago, IL
    2 days ago
  • $50 - $90 per hour

     ...synthetic biology expertise to evaluate and build biosecurity...  ...knowledge to shape how AI systems learn and...  ...experience is required; domain expertise is the...  ...evaluation frameworks and training dataset development for...  ...tax, contracting, and legal arrangements will follow... 
    Training
    Legal
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • Prolific is seeking fluent Hindi speakers for its Expert Network in San Jose, California. The role involves completing AI training tasks, judging AI performance, and improving AI models using legal expertise. Candidates must have strong English skills, attention to detail... 
    Training
    Legal
    Remote job
    Self employment
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    1 day ago
  •  ...Join a leading AI lab's cutting-edge GenAI team to be at the...  ...are hiring a senior finance domain expert to work directly with a leading...  ...finance tasks and evaluation sets, and help build finance-...  ...workflows. Cincinnatus is a legal entity separate from Mercor.... 
    Training
    Legal
    Full time
    Contract work
    Temporary work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    Remote
    2 days ago
  • Prolific is seeking Mental Health Professionals to train and evaluate AI models. Candidates will review psychological scenarios, analyze content...  ...professionals and must complete a quick skills assessment to join Prolific’s Domain Expert Network. #J-18808-Ljbffr Prolific
    Training
    Remote job
    Flexible hours

    Prolific

    San Antonio, TX
    4 days ago
  • $8 - $65 per hour

    Prolific is looking for Mental Health Professionals to help train and evaluate AI models in Phoenix, Arizona. As a Domain Expert participant, you'll review AI-generated psychological responses, complete training tasks, and improve models utilizing your expertise. Competitive... 
    Training
    Remote job
    Flexible hours

    Prolific

    Phoenix, AZ
    4 days ago
  •  ...Shape the Future of AI At Labelbox, we’...  ...high-quality training data at scale #...  ...leveraging subject matter experts for next-generation...  ...annotators and domain experts for flexible...  ...expertise to help develop, evaluate, and improve...  ...mathematics, healthcare, legal, and other highly... 
    Training
    Legal
    Full time
    For contractors
    Remote work
    Flexible hours

    Labelbox

    Remote
    8 days ago
  • $8 - $65 per hour

    Prolific is hiring Mental Health Professionals in New York to train and evaluate AI models. As a Domain Expert, you will be responsible for reviewing AI-generated responses, completing tasks related to psychology, and improving AI models based on your expertise. Pay rates... 
    Training
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • $30 per hour

    Prolific is seeking Advanced Polish Speakers to participate in training and evaluating AI models. As a Domain Expert, you will complete tasks like analyzing, editing, and writing Polish content while ensuring the performance of AI systems is up to standard. This role offers... 
    Training
    Remote job
    Self employment
    Flexible hours

    Prolific

    Chicago, IL
    1 day ago
  • $120 per hour

    Prolific is seeking Licensed Pharmacists to join their Expert Network for AI training. As a Domain Expert, you will evaluate AI responses to pharmaceutical scenarios, offering your expertise for competitive pay of up to $120 USD/hr. Ideal candidates will have a current... 
    Training
    Remote job
    Work from home
    Flexible hours

    Prolific

    San Antonio, TX
    12 hours ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...agents to complete and evaluate complex machine learning and...  ...implementations involving model training , inference systems , MLOps...  ...production. Compensation & Legal ~$400 per accepted task... 
    Training
    Legal
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    12 hours ago
  •  ...platform in Boston is seeking an AI Trainer fluent in Korean. The role involves training AI models and requires advanced...  .... You will complete tasks like evaluating AI performance and contributing...  ...verification test to join the Domain Expert pool. #J-18808-Ljbffr Prolific
    Training
    Remote job
    Flexible hours

    Prolific

    Boston, MA
    3 days ago
  • $100 per hour

     ...Prolific is not just another player in the AI space – we are building the biggest pool of quality...  ...skills. The role We’re looking for Legal Subject Matter Experts to join our Expert Network to help train and evaluate cutting‑edge AI models using professional... 
    Training
    Legal
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York State
    2 days ago
  • $30 per hour

     ...is not just another player in the AI space - we are building the biggest...  ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving...  ...models of the future using professional legal expertise. Once you pass our... 
    Legal
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    1 day ago
  • $150 - $180 per hour

     ...in Virginia Beach is seeking Mental Health Professionals to train and evaluate AI models. The role involves reviewing AI responses to psychological...  ...to detail, and a reliable internet connection. Join our Expert Network to influence future AI innovations and work flexibly... 
    Training
    Remote work
    Work from home

    Prolific

    Virginia Beach, VA
    2 days ago
  • $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: Expert Software Engineer – Scala / COBOL...  ...Role Responsibilities Evaluate complex technical tasks using...  ...Falcor . Compensation & Legal Hourly contractor... 
    Legal
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Remote
    12 hours ago
  • $8 - $65 per hour

     ...Portland, Oregon is looking for Mental Health Professionals to help train AI models. You will review AI-generated responses, complete...  ...Professional is required, and you will need to complete a skills screener to join Prolific's Domain Expert pool. #J-18808-Ljbffr... 
    Training
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    Portland, OR
    2 days ago
  •  ...Prolific is seeking Mental Health Professionals in Nashville, TN, to help train and evaluate AI models. Candidates will review AI-generated responses, complete training tasks, and provide insights based on their understanding of psychological theory. Successful participants... 
    Training
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Nashville, TN
    1 day ago
  •  ...Job Description The Expert-Level Network Evaluator / System Vulnerability Analyst...  ...research, systems analysis, cyber-domain vulnerability assessment,...  ..., network assessments, training events, and research activities...  ...we do. Growth: AI-powered career tool that identifies... 
    Training

    General Dynamics Information Technology

    Maryland, MD
    3 days ago
  • $8 - $65 per hour

     ...Prolific is looking for Mental Health Professionals in Houston, Texas, to train and evaluate cutting-edge AI models. The role offers flexible hours and competitive pay rates ranging from $8 to $65 per hour for AI tasks. Candidates must have a verified status as a Mental... 
    Training
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    Houston, TX
    1 day ago
  • $70 - $110 per hour

     ...Join a leading AI lab's cutting-edge GenAI team...  ...senior clinical medicine domain expert to work directly with...  ...clinical tasks and evaluation sets, and help build...  ...Residency and fellowship training alone do not count...  .... Cincinnatus is a legal entity separate from Mercor... 
    Training
    Legal
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    Remote
    25 days ago
  •  ...About this role Role Title: AI Software Engineering Domain Expert Role Type: Contractor (Part Time) Location...  ...you'll apply your expertise to help train next-generation AI systems. Your...  ...engineering. Create, refine, and evaluate prompts and instructions designed to... 
    Training
    Part time
    For contractors
    Remote work

    micro1

    Remote
    2 days ago
  • $120 per hour

     ...Prolific in Fort Worth, Texas is seeking Licensed Pharmacists to assist in training AI models for healthcare. Responsibilities include evaluating the accuracy of AI-generated content, providing comparative analysis based on pharmacy standards, and creating feedback to... 
    Training
    Remote work
    Work from home
    Flexible hours

    Prolific

    Fort Worth, TX
    4 days ago
  • $120 per hour

     ...Prolific in Milwaukee, WI is seeking Licensed Pharmacists to join our AI training team. You will evaluate AI-generated content crucial for the advancement of AI in healthcare. With competitive pay up to $120 per hour and flexible working conditions, this role allows you... 
    Training
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Milwaukee, WI
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Domain Expert, AI Training & Evaluation. Be the first to apply!