Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Domain Expert (SME) - AI Model Evaluation

$46 per hour
Full-time

jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Legal Domain Expert (SME) – AI Model Evaluation based in the United States.

This is a remote, flexible opportunity for an experienced legal professional to help evaluate the quality and reliability of AI-generated legal content.
You will apply your legal expertise to assess research, statutory interpretation, legal reasoning, citations, drafting, and factual accuracy.
Your evaluations will help identify errors, unsupported conclusions, weak reasoning, and jurisdictional inaccuracies in AI-generated responses.
The role combines deep legal knowledge with structured analysis, fact-checking, and the development of objective evaluation standards.
You may contribute expertise across areas including corporate, securities, employment and labor, intellectual property, and other specialized legal domains.
Assignments are designed for experienced practitioners and researchers who can provide precise, defensible feedback independently.
This engagement offers the flexibility of remote contract work while contributing directly to the development and evaluation of increasingly capable AI systems.

Accountabilities:

  • Evaluate AI-generated legal research, analysis, and responses for accuracy, relevance, completeness, and quality.
  • Verify legal citations, authorities, statutes, cases, regulations, and other supporting sources.
  • Assess whether legal reasoning is logically sound, appropriately supported, and accurate for the relevant jurisdiction.
  • Identify factual inaccuracies, unsupported assertions, misleading conclusions, reasoning gaps, and other substantive issues.
  • Evaluate legal drafting for clarity, precision, completeness, and adherence to applicable legal standards.
  • Develop and apply objective evaluation criteria, scoring frameworks, and rubrics for assessing AI-generated legal work.
  • Provide structured, detailed feedback that clearly explains identified issues and distinguishes substantive errors from acceptable variations in legal interpretation.
  • Apply specialized expertise in the relevant jurisdiction and practice area to ensure evaluations reflect current and applicable legal standards.
  • Participate in an initial calibration exercise and, where successful, take on recurring evaluation assignments.

Requirements:

  • Licensed attorney, legal researcher, senior paralegal, or another legal professional with verifiable qualifications relevant to the applicable jurisdiction.
  • 3+ years of relevant legal practice or legal research experience , with substantial expertise in at least one applicable legal specialty.
  • Strong knowledge of the relevant jurisdiction and demonstrated ability to conduct sophisticated legal research and analysis.
  • Verifiable bar admission, legal license, academic qualification, or other relevant professional credentials.
  • Excellent legal writing, analytical reasoning, fact-checking, and attention-to-detail skills.
  • Ability to evaluate legal arguments objectively and identify subtle factual, jurisdictional, citation, and reasoning errors.
  • Strong understanding of applicable statutes, regulations, case law, legal authorities, and professional standards within your area of specialization.
  • Ability to communicate complex legal issues clearly through structured written feedback.
  • Independent, detail-oriented working style and the ability to meet assignment requirements consistently in a remote environment.
  • Priority expertise includes US Corporate Law , US Securities Law , US Employment & Labor Law , Philippines Corporate Law , and China IP / Patent Law .
  • Experience with relevant areas such as entity governance, corporate formation, commercial disputes, fiduciary duties, transactional drafting, FINRA and SEC compliance, FMLA/FLSA, wage and hour law, restrictive covenants, commercial contracts, registry compliance, CNIPA standards, patentability, inventive-step analysis, patent examination, or claims drafting is highly relevant.

Benefits:

  • USD $46/hour compensation.
  • Fully remote engagement within the United States.
  • Flexible contract work structured around evaluation assignments.
  • Approximately 10–15 hours per evaluation task .
  • Potential for ongoing and recurring assignments following successful initial calibration.
  • Opportunity to apply professional legal expertise to the evaluation and improvement of AI-generated legal content.
  • Independent work environment suited to experienced legal practitioners and researchers.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Legal Domain Expert (SME) - AI Model Evaluation in United States vacancy
  •  ...experienced finance, audit, insurance, compliance, and legal professionals to join our on-call AI Evaluation Specialists network. This remote, project-based role...  ...and providing high-quality feedback across multiple domains. Start date is July 13, 2026, with 0-20 hours per... 
    Legal
    Remote job
    Flexible hours

    Dorado

    New York, NY
    3 days ago
  • $60 - $80 per hour

     ...technical talent with leading AI research labs....  ...Design challenging, domain-relevant retail tasks...  ...real retail practice. Evaluate AI model outputs against structured...  ...other subject matter experts to ensure consistency...  .... Compensation & Legal ~ W-2 employment... 
    Legal
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    2 days ago
  •  ...is seeking an experienced Investment Banking SME to support the development, evaluation, and improvement of advanced AI models in finance. You will assess AI-generated analyses...  ...is remote, project-based, and demands strong domain expertise across investment banking,... 
    Suggested
    Remote job

    Dorado

    New York, NY
    3 days ago
  • $60 - $100 per hour

     ...Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy...  ...risk; and document the corrected analysis so the modeling team can train on it. Why this role matters Legal... 
    Legal
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    14 days ago
  • Cincinnatus LLC is seeking a Marketing SME to join a leading GenAI team focused on evaluating AI outputs against rubrics and strengthening brand strategy in AI training data. We require 8+ years of marketing experience with top-tier brands, plus hands-on evaluation of LLM... 
    Suggested
    Weekday work

    Mercor

    San Francisco, CA
    3 days ago
  • $140 per hour

     ...improve next-generation AI systems. This...  ...turns real-world domain knowledge into high...  ...training data, evaluations, and feedback that...  ...strengthen how AI models learn, reason, and...  ...feedback from other experts. Collaborate remotely...  ...investment memos, legal memoranda,... 
    Legal
    Hourly pay
    Part time
    For contractors
    Remote work

    SaidGig

    Remote
    24 days ago
  •  ...Us Join an innovative AI initiative dedicated to...  ...interpret, and reason about legal concepts. We are...  ...real-world expertise by evaluating AI-generated content, providing...  ...team of subject matter experts to improve AI...  ...across a variety of legal domains. Help ensure AI-generated... 
    Legal
    Part time
    Remote work
    10 hours per week
    Flexible hours

    Weekday

    Remote
    a month ago
  •  ...Prolific is seeking Biology Experts and Life Science Professionals to join an expert network that evaluates and trains AI models. This role involves reviewing AI-generated scientific content for accuracy and validation, requiring candidates with a BS, MS, or PhD in relevant... 
    Remote work
    Flexible hours

    Prolific

    Charlotte, NC
    1 day ago
  • $60 per hour

     ...Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Jose, CA
    1 day ago
  • $60 per hour

     ...Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with...  ...pay rate of up to $60 per hour for reviewing model responses, validating technical claims, and critiquing... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    Dallas, TX
    1 day ago
  •  ...Prolific is seeking Biology Experts and Life Science Professionals in Jacksonville, Florida, to join our Expert Network for evaluating AI-generated science models. Candidates should hold a BS, MS, or PhD in relevant fields and have experience in research or academia.... 
    Hourly pay
    Remote work
    Flexible hours

    Prolific

    Jacksonville, FL
    6 hours ago
  •  ...computational problem solving to improve and evaluate large language models. You will design rigorous math...  ...supports customers Accelerate frontier AI research by contributing high quality...  ...with advanced training pipelines and expert researchers who specialize in coding,... 
    Contract work
    For contractors
    Freelance
    Remote work

    SaidGig

    United States
    a month ago
  •  ...Overview Apply advanced physics knowledge to help improve and evaluate large language models. You will design rigorous problems, produce clear reasoning...  ...into accessible explanations while contributing to AI research projects. Key Responsibilities Design and solve... 
    For contractors
    Freelance
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • $60 per hour

    Prolific, located in Arizona, is seeking Biology Experts and Life Science Professionals to join their Expert Network. This role involves evaluating and training AI models with real scientific expertise. Successful candidates will review AI-generated content for accuracy... 
    Hourly pay

    Prolific

    Arizona City, AZ
    4 days ago
  • $60 per hour

    Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network for training and evaluating AI models using scientific expertise. Candidates will assess AI-generated science, validate technical claims, and critique experimental designs. The... 
    Hourly pay

    Prolific

    Sacramento, CA
    5 days ago
  • Turing Global India is seeking a Politics Domain Expert to evaluate and improve Large Language Models. You will design challenging prompts across political science, governance, elections, public policy and international relations, and assess factual accuracy and reasoning... 
    For contractors

    Turing Global India

    New York, NY
    5 days ago
  •  ...Overview Join a leading AI lab's cutting-edge...  ...build foundational AI models from the ground up....  ...Retail subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against...  ..., or any other legally protected characteristic... 
    Contract work
    Weekday work

    Obsidian

    New York, NY
    5 days ago
  • $17 - $54 per hour

     ...Music & Lyrics Expert - French | Remote AI Model Evaluation is a remote evaluation track for reviewing french generalist evaluation prompts and responses...  ...inter-rater agreement metrics and calibration cycles. Domain expertise that lets you spot subject-matter errors... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    14 days ago
  • $30 per hour

     ...not just another player in the AI space – we are building the biggest...  ...and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image...  ...the future using professional legal expertise. Once you pass our assessment... 
    Legal
    Remote work
    Work from home
    Flexible hours

    Prolific

    United States
    2 days ago
  • $35 - $42 per hour

     ...Shape the Future of AI in Finance, Audit...  ..., compliance, and legal professionals to...  ...network ofon-call AI Evaluation...  ...artificial intelligence models. We'relooking for...  ...of subject matter experts. As client projects...  ...multiple business domains. Receive consideration... 
    Legal
    Hourly pay
    Extra income
    Permanent employment
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Dorado

    Brooklyn, NY
    3 days ago
  •  ...Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems,...  ...electromagnetism, use adversarial prompting to surface errors, and provide expert critique of AI responses while working with project #J-1880... 
    Remote job

    Dorado

    New York, NY
    4 days ago
  • $60 per hour

    Prolific is seeking Chemistry Experts and Chemical Engineers to join their Expert Network. Participants will evaluate AI-generated chemistry through tasks that assess factual accuracy...  ..., enabling cutting-edge advancements in AI models. The position requires a strong educational... 
    Hourly pay

    Prolific

    Arizona City, AZ
    3 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role...  ...and presentations, ensuring they meet domain-specific standards. A minimum of 5 years of relevant... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    5 days ago
  • $120 per hour

     ...just another player in the AI space - we are building the...  ...Pharmacists to help train and evaluate cutting‑edge AI models. As AI begins to play a...  ...be guided by pharmaceutical experts. If you have the necessary...  ...invited to join Prolific as a Domain Expert, where you’ll be... 
    Remote job
    Self employment
    Work from home
    Flexible hours

    Prolific

    Kansas City, MO
    4 days ago
  • $70 - $110 per hour

     ...Role Overview Apply your legal practice experience to evaluate and improve AI-generated legal content and workflows. You will assess work grounded in litigation...  ..., and client advisory decisions, then provide expert feedback. Qualifications At least 4 years of experience... 
    Legal
    Hourly pay
    Immediate start
    Remote work

    SaidGig

    United States
    4 days ago
  • Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks. Candidates should... 
    Weekday work

    Mercor

    San Francisco, CA
    1 day ago
  • Cincinnatus LLC is recruiting for an Insurance Subject‑Matter Expert to join a leading AI lab's GenAI team in New York. This W-2 role involves evaluating insurance tasks and guiding model development for high‑quality underwriting judgments, with placement at the client... 
    Weekday work

    Mercor

    New York, NY
    2 days ago
  • $131.01k - $218.79k

     ...Management Systems Subject Matter Expert (SME) - EAM/FSM.  Black & Veatch’s...  ...and third-party platforms. Evaluate emerging technologies...  ...one or more of the following domains: Electric Generation/Transmission...  ...pre-taxed accounts, voluntary legal plan and the B&V Credit Union... 
    Legal
    Part time
    Work experience placement
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    Black & Veatch

    Greenwood Village, CO
    4 days ago
  • A leading AI company is seeking a legal professional for a contractor role focused on evaluating AI model outputs in legal contexts. Candidates must hold a Juris Doctor (J.D.) and have more than 3 years of experience in law. The role involves reviewing complex legal hypotheticals... 
    Legal
    For contractors
    10 hours per week

    Turing

    Los Angeles, CA
    2 days ago
  • $30 per hour

    Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models... 
    Legal
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Domain Expert (SME) - AI Model Evaluation. Be the first to apply!