Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Legal Expert - AI Evaluation

$60 - $85 per hour
Full-time

Wintermeyer Ventures

Frontier AI models can draft a contract clause or summarise a judgment in seconds. Whether the result would survive a senior lawyers red pen is another question and a benchmark score will not tell you. Someone who has practised the law can.

That is this project. Leading Frontier Lab is bringing in EU-law specialists to read the legal tasks its large language models (LLMs) learn from and are tested on mark what is wrong or missing and write down what good looks like. Your judgement feeds into how those models are trained and evaluated. It is about 10 hours a week fully remote and paid by the hour so it fits next to your practice.

The work

You will use your legal experience to review realistic legal tasks and documents for training or evaluating LLMs. Assess the legal accuracy realism and completeness of examples; explain errors and missing considerations; revise faulty samples when needed; and develop practical guidelines for improving future examples. Clearly identify the relevant EU or member-state jurisdiction when assessing legal content.

Who we are looking for

  • At least five years of substantive professional experience in a legal field.
  • Legal training and professional practice in at least one EU member state.
  • Strong working knowledge of EU law and/or the national law of a specific EU member state with the jurisdiction(s) of expertise clearly identified.
  • Ability to review legal documents critically and provide precise structured written feedback.
  • Prior work with LLMs AI evaluation legal datasets or research consulting is an advantage not required.

Contract at a glance

  • Openings: 12 legal experts.
  • Time commitment: Approximately 10 hours per week per expert.
  • Initial duration: Two months contract.
  • Location: Fully remote; location flexible. Relevant EU legal training and practice matter more than current residence.
  • Compensation: US$60$85 per hour depending on relevant experience jurisdictional expertise and seniority.

This is a scoped expert-review project not a position providing legal representation or client legal advice. Clera coordinates recruiting for the confidential research team.

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Legal Expert - AI Evaluation in San Francisco, CA vacancy
  • $24 per hour

     ...Use your accounting and QuickBooks experience to help improve AI responses to real small-business and financial questions. In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable standards for accounting-related AI tasks. A part... 
    Suggested
    Part time
    Freelance
    Remote work

    Braintrust

    San Francisco, CA
    19 hours ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...asynchronously to meet deadlines while improving AI evaluation . Qualifications Must-Have US-...  ...in your specialty. Compensation & Legal ~ Hourly contractor Application... 
    Legal
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $70 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: Clinical Medicine Domain Expert Type: Contract Compensation...  ...Role Responsibilities Evaluate the quality of clinical knowledge...  .... Compensation & Legal Hourly contractor Paid weekly... 
    Legal
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    San Francisco, CA
    25 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... 
    Legal
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $70 - $110 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Role Responsibilities Evaluate AI-generated sales conversations...  ...and post-sale support. Provide expert feedback. Work independently...  ...Immediate Compensation & Legal ~ Task-based payment upon... 
    Legal
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $40 - $75 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: AI Evaluation Rubric Reviewer Type: Contract Compensation: $40–$75/... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $65 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Legal Expert Type: Contract Compensation:...  ...Role Responsibilities Review and evaluate written content and AI-generated responses... 
    Legal
    Contract work
    Summer work
    Remote work
    10 hours per week

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $100 per hour

     ...Experience: 3 - 5 years Location: United States | Canada + 1 more We’re seeking an experienced legal professional to support a short-term AI content evaluation project. You’ll use your legal judgment to assess written material, identify issues, and provide... 
    Legal
    Contract work
    Temporary work
    Immediate start
    Remote work

    Braintrust

    San Francisco, CA
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $57 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal & Compliance Professional Type: Contract Compensation:... 
    Legal
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $50 - $150 per hour

     ...hours / week Experience: 3 - 5 years Location: United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge... 
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    a month ago
  •  ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the world’s fastest-growing AI companies, accelerating...  ...Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models.... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    a month ago
  •  ...Accenture is helping companies use generative AI and semantic layer to reinvent their...  ...needed by the specific problem, you design, evaluate, and maintain ontologies.As a significant...  ...employer, or (c) consistent with the Company's legal duty to furnish information.California... 
    Legal
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    19 hours ago
  • $45 - $65 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...under edge cases. Evaluate and revise draft guidelines for...  ...as finance, retail, insurance, legal, and sports into precise, discipline...  ...Collaborate with subject matter experts and program leads to ensure... 
    Legal
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    10 days ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    24 days ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks...  ...production-scale systems. Compensation & Legal ~$400 per accepted task ~ Compensation... 
    Legal
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $130 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    4 days ago
  •  ...Employers Job seekers Career centers AI Skills Studio Handshake AI...  ...Log in Sign up INTELLIGENCE EXPERT (BACHELOR'S, MASTER'S AND PHDS...  ...role will be to simulate and evaluate how malicious actors might leverage...  ...Program Opportunities Legal Help center Employers Pricing... 
    Legal
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    a month ago
  •  ...As a legal expert, you'll help train and evaluate how AI models reason about the law. This can be writing challenging legal prompts, evaluating model responses for accuracy and sound reasoning, spotting subtle errors like fabricated citations or misapplied rules, drafting... 
    Legal
    Temporary work

    AfterQuery

    San Francisco, CA
    a month ago
  • $50 per hour

     ...this hourly, remote contractor role, you will work as a Paralegal Subject Matter Expert (SME) to review AI-generated legal support responses and/or create expert paralegal content, evaluating reasoning quality and step-by-step task execution while providing precise... 
    Legal
    Hourly pay
    Contract work
    Temporary work
    For contractors
    Immediate start
    Remote work

    SuperAnnotate

    San Francisco, CA
    a month ago
  • $80 - $130 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    4 days ago
  • $21 - $70 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    13 days ago
  • $50 - $80 per hour

     ...About the Role We are looking for physicists to help train and evaluate AI models on physics content. You will analyse physics documents,...  .... Experience with simulation or data-analysis tools. Legal and Compliance Notice All content you submit must be lawful,... 
    Legal
    Hourly pay
    Temporary work
    For contractors
    Remote work

    RemoExperts

    San Francisco, CA
    a month ago
  • $30 - $65 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    17 days ago
  • $20 - $60 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    micro1

    San Francisco, CA
    25 days ago
  • $50 - $90 per hour

     ...micro1 is a data lab that helps AI labs & Enterprises train...  ...and agents. We provide frontier evaluations and reinforcement learning environments...  ...agent sources and vets domain experts for our data platform that...  ...-value, specialized domains (legal, medical, finance, coding, etc... 
    Legal
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    19 days ago
  • $170 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Counsel (Access to Justice Expert) Type: Contract Compensation...  ...Review AI-generated legal analyses to ensure accuracy and...  ...depth in civil legal services. Evaluate scenarios in housing ,... 
    Legal
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Legal Expert - AI Evaluation. Be the first to apply!