Legal Expert, AI Benchmark Question Author and Reviewer
$83 - $105 per hourSaidGig
Role Overview
Develop and validate rigorous academic legal assessments that support an AI research initiative. You will either create original multiple-choice questions in your legal specialty or review existing questions to ensure they meet a high standard for accuracy, clarity, and analytical depth.
Law Domains
Intellectual Property; Privacy and Technology; Regulatory and Government Affairs; Securities; Capital Markets; Financial Regulation and Compliance; Private Equity; M&A and Transaction Structuring; Antitrust, Merger Control and Competition; Healthcare; Life Sciences and Pharmaceuticals; Environmental; Energy; and ESG/Climate.
Key Responsibilities
- Author original, challenging law questions that assess deep conceptual understanding rather than factual recall.
- Ensure every question is unambiguous, self-contained, precisely defined, and includes all information needed to solve it.
- Assign a difficulty rating of Medium, for introductory undergraduate level; Hard, for advanced undergraduate level; or Expert, for postgraduate level and above.
- Provide one correct answer and nine plausible, subtly incorrect alternatives designed to challenge expert-level solvers.
- Prepare step-by-step solutions with clear, concise reasoning in Markdown format.
- Provide one to five academic references for each question from reputable sources, including peer-reviewed journals and legal repositories.
- For verification assignments, assess pre-written questions for accuracy, clarity, rigor, completeness, precision, and solvability; make necessary edits; rate difficulty; and document and justify all changes.
Qualifications
- JD, LLM, SJD, doctoral candidacy in Law, or a closely related field.
- A master''s degree may be considered for candidates with exceptional depth in a specific legal subdomain.
- Strong legal reasoning, statutory interpretation, and jurisprudential theory skills.
- Experience writing bar-exam content, working in legal academia, or serving in a judicial clerkship is a strong advantage.
- Excellent written English and the ability to communicate complex legal concepts clearly and concisely.
Work Terms
- Fully remote, asynchronous hourly engagement.
- Expected commitment of at least 10 hours per week.
Compensation
$83 to $105 per hour.
$44 - $56 per hour
...that helps advance AI research in... ...standard multiple-choice benchmarks across National... ...assignment types: author original, challenging... ...multiple-choice questions in your specialty... ...and submit them for review, or verify existing... ...level, or Expert, for postgraduate...SuggestedHourly payRemote work10 hours per week- ...Role Overview Compose original Arabic-language multiple-choice questions about the law of your jurisdiction for an AI evaluation dataset. The work relies on your professional legal expertise and requires creating exam-style items that include ten answer options and a...LegalHourly payRemote workFlexible hours
- AuraOne is seeking a Ukrainian Law Expert for the Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote). This remote review track evaluates AI outputs in legal review workflows, with tasks like verifying citations and flagging policy-adherence gaps. As a...LegalRemote jobFor contractors10 hours per weekFlexible hours
$65 - $90 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst... ...Dorsey . Position: Legal Expert Type: Contract... ...Role Responsibilities Review and evaluate written... ...and quality. Answer questions and provide clear,...LegalContract workSummer workRemote work10 hours per week$38.59 - $47.17 per hour
...Role Overview Create original, exam-style multiple-choice questions on Swedish law for an AI evaluation dataset, drawing on your professional legal expertise. Key Responsibilities Write Swedish law questions with ten answer options each. Provide a worked solution...LegalHourly payRemote workFlexible hours- ...Role Overview Create original, exam-style multiple-choice questions on Vietnamese law for an AI evaluation dataset, drawing on your professional legal expertise. Key Responsibilities Draft questions with ten answer options each. Provide a worked solution for...LegalHourly payRemote workFlexible hours
- ...Create original, exam-style multiple-choice questions on Finnish law for an AI evaluation dataset. This remote, flexible-hours opportunity draws on your professional legal expertise to produce rigorous assessment content in Finnish. Key Responsibilities Draft original...LegalHourly payRemote workFlexible hours
$15.79 - $19.29 per hour
...Role Overview Create original, exam-style multiple-choice questions on Thai law to support an AI evaluation dataset. This role draws on your professional legal expertise to produce rigorous, well-explained assessment content in Thai. Key Responsibilities Draft original...LegalHourly payRemote workFlexible hours- ...Develop original, exam-style multiple-choice questions on Danish law for an AI evaluation dataset. This flexible remote opportunity draws on your professional legal expertise to create rigorous, clearly explained assessment content. Key Responsibilities Write original...LegalHourly payRemote workFlexible hours
$24.26 - $29.65 per hour
...Develop original, exam-style Arabic law questions that draw on your professional knowledge of the jurisdiction... ...or were trained. Your work will support an AI evaluation dataset. Key Responsibilities Create multiple-choice legal questions in Arabic based on your own...LegalHourly payRemote workFlexible hours$77 - $98 per hour
...assessment content that helps benchmark AI capabilities across... ...contribute through either question authoring or question verification, producing... ...advanced undergraduate; or Expert, postgraduate and above.... ...reputable sources, such as peer-reviewed journals or university...Hourly payRemote work10 hours per week- ...expertise to help train next-generation AI systems. Your work will shape how models... ...objective, multi-step analytical tasks and questions based on challenging visualizations, emphasizing... ...in producing data-annotation tasks, benchmark questions, technical reports, or related...Temporary workRemote work
$50 - $90 per hour
...help train and evaluate next generation AI systems for defense policy and humanitarian... ...Evaluate and improve policy relevant benchmarks for responsible AI testing in defense and... ...advisory roles in military, government, legal, or think tank settings. Experience with...LegalHourly payFor contractorsRemote work$85 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...AI engineering tasks. Review model-generated implementations... ...production. Compensation & Legal ~$400 per accepted task...LegalFull timeContract workSummer workRemote work- ...Overview Develop original exam-style multiple-choice questions in Chinese, Traditional script, focused on Taiwanese or Hong Kong law to populate an AI evaluation dataset. Each question must be grounded in your professional legal expertise, include ten answer choices, and be...LegalHourly payRemote workFlexible hours
$100 - $150 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst ,... ...Cybersecurity Labeling Expert Type: Contract... ...experience. Compensation & Legal Hourly... ....com PS: Our team reviews applications daily. Please...LegalHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$50 - $90 per hour
...subject-matter knowledge to shape how AI systems learn and reason about biological... .... Perform rigorous false-negative reviews of draft benchmarks to ensure protective and pragmatic... ...terms; specific tax, contracting, and legal arrangements will follow standard contractor...LegalHourly payFor contractorsRemote work$60 - $80 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst ,... ...with other subject matter experts to ensure consistency... ...skills. Compensation & Legal ~ W-2 employment... ...mercor.com PS: Our team reviews applications daily....LegalContract workSummer workRemote workWeekday work- ...Us Join an innovative AI initiative dedicated to... ...interpret, and reason about legal concepts. We are... ...Key Responsibilities Review and evaluate AI-generated... .... Answer legal questions and provide clear, well... ...team of subject matter experts to improve AI performance...LegalPart timeRemote work10 hours per weekFlexible hours
$85 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...complex engineering tasks. Review model-generated frontend code... ...applications. Compensation & Legal ~$400 per accepted task...LegalFull timeContract workSummer workRemote work$39.69 - $48.51 per hour
...Role Overview Create original, exam-style multiple-choice questions in Simplified Chinese that evaluate understanding of Chinese law. Work from your own professional legal expertise to produce items for an AI evaluation dataset. Each item must include ten answer options...LegalHourly payRemote workFlexible hours$33.96 - $41.5 per hour
...Role Overview Create original, exam-style multiple choice questions on Czech law for an AI evaluation dataset. Each item will be produced from your... ...explains the correct choice. Use your professional legal expertise to ensure questions are accurate and suitable for...LegalHourly payRemote workFlexible hours$12.92 - $15.8 per hour
...Role Overview Create original, exam-style multiple-choice questions that evaluate knowledge of Vietnamese law for an AI evaluation dataset. Each item must be grounded in your professional legal expertise, include ten answer options, and be accompanied by a worked solution...LegalHourly payRemote workFlexible hours$38.59 - $47.17 per hour
...Role Overview Produce original, exam-style multiple-choice questions on Finnish law to support an AI evaluation dataset. Each item must reflect your professional legal expertise, include ten answer options, and be accompanied by a worked solution. Key Responsibilities...LegalHourly payRemote workFlexible hours$38.59 - $47.17 per hour
...Overview Create original, exam-style multiple choice questions on Danish law to support an AI evaluation dataset. The work is remote and offers flexible... ...exam-style questions based on your professional legal expertise. For each question, provide ten distinct answer...LegalHourly payRemote workFlexible hours$38.59 - $47.17 per hour
...Role Overview Create original, exam-style multiple-choice questions on Swedish law for an AI evaluation dataset. Each item must reflect your professional legal expertise, include ten answer options, and be accompanied by a worked solution that explains the correct answer...LegalHourly payRemote workFlexible hours$40 - $60 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst ,... ...Healthcare Administration Expert Type:... ...Compensation & Legal Hourly contractor... ....com PS: Our team reviews applications daily. Please...LegalHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work- ...Overview Join Sigma.AI – Shaping the Future of Artificial... ...intermediaries or third parties are authorized to represent or participate... ...an ethical, transparent, and legally compliant manner. The purpose... ...Help? We’re here for any questions or concerns. Join us and be...LegalRemote work
- ...Join Sigma.AI – Shaping the Future of Artificial Intelligence... ...intermediaries or third parties are authorized to represent benefit from or... ...an ethical, transparent, and legally compliant manner. The purpose... ...Help? We're here for any questions or concerns. Join us and...LegalContract workFreelanceRemote work
- ...LILT (Production) is seeking a Subject Matter Expert to contribute to an AI benchmarking project in the healthcare sector. You will design realistic scenarios reflecting patient care and hospital operations, ensuring context and cultural appropriateness. Ideal candidates...Temporary workFor contractorsFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Legal Expert, AI Benchmark Question Author and Reviewer. Be the first to apply!
- fruit expert United States
- subject matter expert United States
- expert data analyst United States
- guest service support expert United States
- expert systems engineer United States
- technology expert United States
- fulfillment expert United States
- subject matter expert senior United States
- subject matter expert work from home United States
- sql expert United States




