Legal Expert - AI Evaluation
$60 - $85 per hourWintermeyer Ventures
Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether the result would survive a senior lawyers red pen is another question and a benchmark score will not tell you. Someone who has practised the law can.
That is this project. Leading Frontier Lab is bringing in EU-law specialists to read the legal tasks its large language models (LLMs) learn from and are tested on mark what is wrong or missing and write down what good looks like. Your judgement feeds into how those models are trained and evaluated. It is about 10 hours a week fully remote and paid by the hour so it fits next to your practice.
The work
You will use your legal experience to review realistic legal tasks and documents for training or evaluating LLMs. Assess the legal accuracy realism and completeness of examples; explain errors and missing considerations; revise faulty samples when needed; and develop practical guidelines for improving future examples. Clearly identify the relevant EU or member-state jurisdiction when assessing legal content.
Who we are looking for
- At least five years of substantive professional experience in a legal field.
- Legal training and professional practice in at least one EU member state.
- Strong working knowledge of EU law and/or the national law of a specific EU member state with the jurisdiction(s) of expertise clearly identified.
- Ability to review legal documents critically and provide precise structured written feedback.
- Prior work with LLMs AI evaluation legal datasets or research consulting is an advantage not required.
Contract at a glance
- Openings: 12 legal experts.
- Time commitment: Approximately 10 hours per week per expert.
- Initial duration: Two months contract.
- Location: Fully remote; location flexible. Relevant EU legal training and practice matter more than current residence.
- Compensation: US$60$85 per hour depending on relevant experience jurisdictional expertise and seniority.
This is a scoped expert-review project not a position providing legal representation or client legal advice. Clera coordinates recruiting for the confidential research team.
$24 per hour
...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part...SuggestedPart timeFreelanceRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...asynchronously to meet deadlines while improving AI evaluation . Qualifications Must-Have US-... ...in your specialty. Compensation & Legal ~ Hourly contractor Application...LegalHourly payContract workFor contractorsSummer workRemote work$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Clinical Medicine Domain Expert Type: Contract Compensation... ...Role Responsibilities Evaluate the quality of clinical knowledge... .... Compensation & Legal Hourly contractor Paid weekly...LegalHourly payWeekly payContract workFor contractorsSummer work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...LegalContract workSummer workWork at officeRemote work$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated sales conversations... ...and post-sale support. Provide expert feedback. Work independently... ...Immediate Compensation & Legal ~ Task-based payment upon...LegalHourly payContract workSummer workImmediate startRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation... ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety...Contract workSummer workRemote work$40 - $75 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Evaluation Rubric Reviewer Type: Contract Compensation: $40–$75/...Contract workSummer workRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work$65 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Legal Expert Type: Contract Compensation:... ...Role Responsibilities Review and evaluate written content and AI-generated responses...LegalContract workSummer workRemote work10 hours per week$80 - $100 per hour
...Experience: 3 - 5 years Location: United States | Canada + 1 more We’re seeking an experienced legal professional to support a short-term AI content evaluation project. You’ll use your legal judgment to assess written material, identify issues, and provide...LegalContract workTemporary workImmediate startRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Contract workSummer workWork at officeRemote work$57 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal & Compliance Professional Type: Contract Compensation:...LegalHourly payContract workFor contractorsSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work$50 - $150 per hour
...hours / week Experience: 3 - 5 years Location: United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge...Contract workTemporary workRemote workFlexible hours- ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the world’s fastest-growing AI companies, accelerating... ...Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models....Contract workPart timeFor contractorsFreelanceRemote work
- ...Accenture is helping companies use generative AI and semantic layer to reinvent their... ...needed by the specific problem, you design, evaluate, and maintain ontologies.As a significant... ...employer, or (c) consistent with the Company's legal duty to furnish information.California...LegalWork experience placementLive inWork at officeLocal area
$45 - $65 per hour
...technical talent with leading AI research labs. Headquartered in... ...under edge cases. Evaluate and revise draft guidelines for... ...as finance, retail, insurance, legal, and sports into precise, discipline... ...Collaborate with subject matter experts and program leads to ensure...LegalContract workSummer workRemote workWeekday work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks... ...production-scale systems. Compensation & Legal ~$400 per accepted task ~ Compensation...LegalContract workSummer workRemote work$80 - $130 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsRemote work- ...Employers Job seekers Career centers AI Skills Studio Handshake AI... ...Log in Sign up INTELLIGENCE EXPERT (BACHELOR'S, MASTER'S AND PHDS... ...role will be to simulate and evaluate how malicious actors might leverage... ...Program Opportunities Legal Help center Employers Pricing...LegalHourly payPart timeImmediate startRemote work10 hours per weekFlexible hours
- ...As a legal expert, you'll help train and evaluate how AI models reason about the law. This can be writing challenging legal prompts, evaluating model responses for accuracy and sound reasoning, spotting subtle errors like fabricated citations or misapplied rules, drafting...LegalTemporary work
$50 per hour
...this hourly, remote contractor role, you will work as a Paralegal Subject Matter Expert (SME) to review AI-generated legal support responses and/or create expert paralegal content, evaluating reasoning quality and step-by-step task execution while providing precise...LegalHourly payContract workTemporary workFor contractorsImmediate startRemote work$80 - $130 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsRemote work$21 - $70 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsRemote work$50 - $80 per hour
...About the Role We are looking for physicists to help train and evaluate AI models on physics content. You will analyse physics documents,... .... Experience with simulation or data-analysis tools. Legal and Compliance Notice All content you submit must be lawful,...LegalHourly payTemporary workFor contractorsRemote work$30 - $65 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsRemote work$20 - $60 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsImmediate startRemote work10 hours per weekFlexible hours$50 - $90 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...agent sources and vets domain experts for our data platform that... ...-value, specialized domains (legal, medical, finance, coding, etc...LegalPart timeFor contractorsRemote work$170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Counsel (Access to Justice Expert) Type: Contract Compensation... ...Review AI-generated legal analyses to ensure accuracy and... ...depth in civil legal services. Evaluate scenarios in housing ,...LegalContract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Legal Expert - AI Evaluation. Be the first to apply!
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- subject matter expert San Francisco, CA
- contract legal San Francisco, CA
- legal full time San Francisco, CA
- undergraduate legal intern San Francisco, CA
- entry legal San Francisco, CA
- legal compliance San Francisco, CA
- legal work from home San Francisco, CA







