Legal Domain Expert (SME) - AI Model Evaluation
$46 per hourjobgether
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Legal Domain Expert (SME) – AI Model Evaluation based in the United States.
This is a remote, flexible opportunity for an experienced legal professional to help evaluate the quality and reliability of AI-generated legal content.
You will apply your legal expertise to assess research, statutory interpretation, legal reasoning, citations, drafting, and factual accuracy.
Your evaluations will help identify errors, unsupported conclusions, weak reasoning, and jurisdictional inaccuracies in AI-generated responses.
The role combines deep legal knowledge with structured analysis, fact-checking, and the development of objective evaluation standards.
You may contribute expertise across areas including corporate, securities, employment and labor, intellectual property, and other specialized legal domains.
Assignments are designed for experienced practitioners and researchers who can provide precise, defensible feedback independently.
This engagement offers the flexibility of remote contract work while contributing directly to the development and evaluation of increasingly capable AI systems.
Accountabilities:
- Evaluate AI-generated legal research, analysis, and responses for accuracy, relevance, completeness, and quality.
- Verify legal citations, authorities, statutes, cases, regulations, and other supporting sources.
- Assess whether legal reasoning is logically sound, appropriately supported, and accurate for the relevant jurisdiction.
- Identify factual inaccuracies, unsupported assertions, misleading conclusions, reasoning gaps, and other substantive issues.
- Evaluate legal drafting for clarity, precision, completeness, and adherence to applicable legal standards.
- Develop and apply objective evaluation criteria, scoring frameworks, and rubrics for assessing AI-generated legal work.
- Provide structured, detailed feedback that clearly explains identified issues and distinguishes substantive errors from acceptable variations in legal interpretation.
- Apply specialized expertise in the relevant jurisdiction and practice area to ensure evaluations reflect current and applicable legal standards.
- Participate in an initial calibration exercise and, where successful, take on recurring evaluation assignments.
Requirements:
- Licensed attorney, legal researcher, senior paralegal, or another legal professional with verifiable qualifications relevant to the applicable jurisdiction.
- 3+ years of relevant legal practice or legal research experience , with substantial expertise in at least one applicable legal specialty.
- Strong knowledge of the relevant jurisdiction and demonstrated ability to conduct sophisticated legal research and analysis.
- Verifiable bar admission, legal license, academic qualification, or other relevant professional credentials.
- Excellent legal writing, analytical reasoning, fact-checking, and attention-to-detail skills.
- Ability to evaluate legal arguments objectively and identify subtle factual, jurisdictional, citation, and reasoning errors.
- Strong understanding of applicable statutes, regulations, case law, legal authorities, and professional standards within your area of specialization.
- Ability to communicate complex legal issues clearly through structured written feedback.
- Independent, detail-oriented working style and the ability to meet assignment requirements consistently in a remote environment.
- Priority expertise includes US Corporate Law , US Securities Law , US Employment & Labor Law , Philippines Corporate Law , and China IP / Patent Law .
- Experience with relevant areas such as entity governance, corporate formation, commercial disputes, fiduciary duties, transactional drafting, FINRA and SEC compliance, FMLA/FLSA, wage and hour law, restrictive covenants, commercial contracts, registry compliance, CNIPA standards, patentability, inventive-step analysis, patent examination, or claims drafting is highly relevant.
Benefits:
- USD $46/hour compensation.
- Fully remote engagement within the United States.
- Flexible contract work structured around evaluation assignments.
- Approximately 10–15 hours per evaluation task .
- Potential for ongoing and recurring assignments following successful initial calibration.
- Opportunity to apply professional legal expertise to the evaluation and improvement of AI-generated legal content.
- Independent work environment suited to experienced legal practitioners and researchers.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
- ...experienced finance, audit, insurance, compliance, and legal professionals to join our on-call AI Evaluation Specialists network. This remote, project-based role... ...and providing high-quality feedback across multiple domains. Start date is July 13, 2026, with 0-20 hours per...LegalRemote jobFlexible hours
$60 - $80 per hour
...technical talent with leading AI research labs.... ...Design challenging, domain-relevant retail tasks... ...real retail practice. Evaluate AI model outputs against structured... ...other subject matter experts to ensure consistency... .... Compensation & Legal ~ W-2 employment...LegalContract workSummer workRemote workWeekday work- ...is seeking an experienced Investment Banking SME to support the development, evaluation, and improvement of advanced AI models in finance. You will assess AI-generated analyses... ...is remote, project-based, and demands strong domain expertise across investment banking,...SuggestedRemote job
$60 - $100 per hour
...Legal Domain Expert — AI Training & Evaluation is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy... ...risk; and document the corrected analysis so the modeling team can train on it. Why this role matters Legal...LegalRemote jobFor contractors10 hours per week- Cincinnatus LLC is seeking a Marketing SME to join a leading GenAI team focused on evaluating AI outputs against rubrics and strengthening brand strategy in AI training data. We require 8+ years of marketing experience with top-tier brands, plus hands-on evaluation of LLM...SuggestedWeekday work
$140 per hour
...improve next-generation AI systems. This... ...turns real-world domain knowledge into high... ...training data, evaluations, and feedback that... ...strengthen how AI models learn, reason, and... ...feedback from other experts. Collaborate remotely... ...investment memos, legal memoranda,...LegalHourly payPart timeFor contractorsRemote work- ...Us Join an innovative AI initiative dedicated to... ...interpret, and reason about legal concepts. We are... ...real-world expertise by evaluating AI-generated content, providing... ...team of subject matter experts to improve AI... ...across a variety of legal domains. Help ensure AI-generated...LegalPart timeRemote work10 hours per weekFlexible hours
- ...Prolific is seeking Biology Experts and Life Science Professionals to join an expert network that evaluates and trains AI models. This role involves reviewing AI-generated scientific content for accuracy and validation, requiring candidates with a BS, MS, or PhD in relevant...Remote workFlexible hours
$60 per hour
...Prolific is seeking Biology Experts and Life Science Professionals to evaluate AI-generated science and ensure compliance with scientific standards. Responsibilities include reviewing biological inquiries, validating technical claims from public databases, and critiquing...Hourly payRemote workWork from homeFlexible hours$60 per hour
...Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network to evaluate AI-generated science. This role allows you to work from home with... ...pay rate of up to $60 per hour for reviewing model responses, validating technical claims, and critiquing...Hourly payRemote workWork from homeFlexible hours- ...Prolific is seeking Biology Experts and Life Science Professionals in Jacksonville, Florida, to join our Expert Network for evaluating AI-generated science models. Candidates should hold a BS, MS, or PhD in relevant fields and have experience in research or academia....Hourly payRemote workFlexible hours
- ...computational problem solving to improve and evaluate large language models. You will design rigorous math... ...supports customers Accelerate frontier AI research by contributing high quality... ...with advanced training pipelines and expert researchers who specialize in coding,...Contract workFor contractorsFreelanceRemote work
- ...Overview Apply advanced physics knowledge to help improve and evaluate large language models. You will design rigorous problems, produce clear reasoning... ...into accessible explanations while contributing to AI research projects. Key Responsibilities Design and solve...For contractorsFreelanceRemote work
$60 per hour
Prolific, located in Arizona, is seeking Biology Experts and Life Science Professionals to join their Expert Network. This role involves evaluating and training AI models with real scientific expertise. Successful candidates will review AI-generated content for accuracy...Hourly pay$60 per hour
Prolific is seeking Biology Experts and Life Science Professionals to join their Expert Network for training and evaluating AI models using scientific expertise. Candidates will assess AI-generated science, validate technical claims, and critique experimental designs. The...Hourly pay- Turing Global India is seeking a Politics Domain Expert to evaluate and improve Large Language Models. You will design challenging prompts across political science, governance, elections, public policy and international relations, and assess factual accuracy and reasoning...For contractors
- ...Overview Join a leading AI lab's cutting-edge... ...build foundational AI models from the ground up.... ...Retail subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against... ..., or any other legally protected characteristic...Contract workWeekday work
$17 - $54 per hour
...Music & Lyrics Expert - French | Remote AI Model Evaluation is a remote evaluation track for reviewing french generalist evaluation prompts and responses... ...inter-rater agreement metrics and calibration cycles. Domain expertise that lets you spot subject-matter errors...Remote jobFor contractors10 hours per week$30 per hour
...not just another player in the AI space – we are building the biggest... ...and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image... ...the future using professional legal expertise. Once you pass our assessment...LegalRemote workWork from homeFlexible hours$35 - $42 per hour
...Shape the Future of AI in Finance, Audit... ..., compliance, and legal professionals to... ...network ofon-call AI Evaluation... ...artificial intelligence models. We'relooking for... ...of subject matter experts. As client projects... ...multiple business domains. Receive consideration...LegalHourly payExtra incomePermanent employmentContract workTemporary workRemote workFlexible hours- ...Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems,... ...electromagnetism, use adversarial prompting to surface errors, and provide expert critique of AI responses while working with project #J-1880...Remote job
$60 per hour
Prolific is seeking Chemistry Experts and Chemical Engineers to join their Expert Network. Participants will evaluate AI-generated chemistry through tasks that assess factual accuracy... ..., enabling cutting-edge advancements in AI models. The position requires a strong educational...Hourly pay- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role... ...and presentations, ensuring they meet domain-specific standards. A minimum of 5 years of relevant...Remote jobHourly pay
$120 per hour
...just another player in the AI space - we are building the... ...Pharmacists to help train and evaluate cutting‑edge AI models. As AI begins to play a... ...be guided by pharmaceutical experts. If you have the necessary... ...invited to join Prolific as a Domain Expert, where you’ll be...Remote jobSelf employmentWork from homeFlexible hours$70 - $110 per hour
...Role Overview Apply your legal practice experience to evaluate and improve AI-generated legal content and workflows. You will assess work grounded in litigation... ..., and client advisory decisions, then provide expert feedback. Qualifications At least 4 years of experience...LegalHourly payImmediate startRemote work- Cincinnatus LLC is placing finance SMEs at a leading AI lab to critically evaluate AI model outputs for financial tasks. The role focuses on rigorous, rubric-based assessment of model performance and constructing finance-focused evaluation frameworks. Candidates should...Weekday work
- Cincinnatus LLC is recruiting for an Insurance Subject‑Matter Expert to join a leading AI lab's GenAI team in New York. This W-2 role involves evaluating insurance tasks and guiding model development for high‑quality underwriting judgments, with placement at the client...Weekday work
$131.01k - $218.79k
...Management Systems Subject Matter Expert (SME) - EAM/FSM. Black & Veatch’s... ...and third-party platforms. Evaluate emerging technologies... ...one or more of the following domains: Electric Generation/Transmission... ...pre-taxed accounts, voluntary legal plan and the B&V Credit Union...LegalPart timeWork experience placementLocal areaImmediate startVisa sponsorshipFlexible hours- A leading AI company is seeking a legal professional for a contractor role focused on evaluating AI model outputs in legal contexts. Candidates must hold a Juris Doctor (J.D.) and have more than 3 years of experience in law. The role involves reviewing complex legal hypotheticals...LegalFor contractors10 hours per week
$30 per hour
Prolific is seeking fluent Hindi speakers to join their Expert Network, helping to train and evaluate AI models with real legal expertise. Responsibilities include analyzing and writing tasks in Hindi, judging AI’s performance, and aiding in the improvement of AI models...LegalRemote jobHourly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Legal Domain Expert (SME) - AI Model Evaluation. Be the first to apply!
- expert data analyst United States
- subject matter expert work from home United States
- sql expert United States
- subject matter expert United States
- fulfillment expert United States
- guest service support expert United States
- expert systems engineer United States
- fruit expert United States
- subject matter expert senior United States
- technology expert United States


