Lawyer for Legal AI Evaluation
$150 per hourSaidGig
Apply deep legal expertise to evaluate blinded AI work product in a specialized legal domain. You will assess synthetic matters only within your own practice area and provide clear, evidence-based preferences between alternative deliverables. Role Overview
This role supports a blinded human-preference study for legal AI. Available specialisms include sanctions and export controls; structured finance and securitisation; and life sciences and pharmaceutical regulatory.
Key Responsibilities- Review a synthetic legal matter and its supporting documents.
- Assess six blinded AI deliverables, labelled A through F, for each matter.
- Complete five head-to-head comparisons against a shared comparator output.
- Provide a concise, specific written rationale for every preference.
- Qualified lawyer with substantial, current practice experience in one of the listed specialisms.
- Ability to evaluate legal work product holistically, including correctness, completeness, judgment, and practical usefulness.
- Precise written English.
- Ability to work independently from written instructions and meet deadlines.
- Hourly independent-contractor engagement.
- Expected commitment is approximately 24 to 30 hours across the engagement, depending on specialism.
- All work is subject to a non-disclosure agreement.
- External AI tools may not be used with any project material.
$150 per hour.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lawyer for Legal AI Evaluation in United States vacancy
$27.78 - $33.96 per hour
...Overview Create original, exam-style multiple-choice questions that evaluate understanding of Ukrainian law. Each item will be authored from... ...original exam-style questions on Ukrainian law based on your legal expertise. Provide ten distinct answer options for every...LegalHourly payRemote workFlexible hoursSaidGig
United States26 days ago- ...Create original, exam-style multiple-choice questions on Czech law for an AI evaluation dataset, drawing on your professional legal expertise. Key Responsibilities Draft Czech law questions with ten answer options for each question. Provide a worked solution for...LegalHourly payRemote workFlexible hours
SaidGig
United Statesa month ago $100 - $120 per hour
...Apply your restructuring and insolvency judgment to evaluate AI-generated legal work on realistic matters. You will review blinded deliverables... ...and practical usefulness. Qualifications Qualified lawyer with substantive experience in restructuring and insolvency...LegalHourly paySaidGig
United States3 days ago$100 - $120 per hour
...Evaluate AI-generated legal work on realistic disputes and international matters, using your professional judgment to identify the strongest analysis... ...for each preference. Qualifications Qualified lawyer with substantive practice experience in the relevant disputes...LegalHourly payInterim roleSaidGig
United States3 days ago£130 per hour
...your UK disputes and international arbitration experience to evaluate AI-generated legal work on realistic, synthetic matters. You will provide... ...emergency interim relief. Qualifications Qualified lawyer with substantive practice experience in the practice areas...LegalHourly payInterim roleRemote workSaidGig
Remote3 days ago$100 - $120 per hour
...Role Overview Evaluate AI-generated legal work product for realistic environmental law matters in a blinded preference study. You will apply professional... ...defense and allocation. Qualifications Qualified lawyer with substantive practice experience in the environmental...LegalHourly payFor contractorsSaidGig
United States3 days ago$70 - $110 per hour
...Apply your litigation, legal drafting, and client advisory experience to evaluate and improve AI-generated legal content and workflows. Key Responsibilities Assess... ...Qualifications At least 4 years of experience as a lawyer, attorney, counsel, general counsel, prosecutor...LegalHourly payImmediate startRemote workSaidGig
United States13 days ago- Gramian Consulting, a US-based boutique, seeks a US-qualified lawyer for AI legal research and evaluation in a fully remote contract role. You will research US law, review AI-generated materials for accuracy, and draft high-quality legal content with precise feedback. The...LegalRemote jobHourly payContract workFlexible hours
$70 - $110 per hour
...finding and building careers in AI training and data labeling. It... .... OpenTrain AI is recruiting legal professionals for this remote... ...Grow a durable portfolio of work evaluating advanced AI systems About AI... ...Role As a Legal AI Evaluation Lawyer, you will evaluate AI-...LegalHourly payContract workPart timeFor contractorsRemote workFlexible hours$140 per hour
...project focused on improving how advanced AI systems understand, analyse, and generate legal content. We are looking for an experienced US-qualified Lawyer to research legal issues, review AI-... ...across legal documents and evaluation tasks. Collaborate remotely with legal...LegalHourly payContract workFor contractorsFreelanceRemote workFlexible hours$150 per hour
...Role Overview Evaluate AI-generated legal reasoning in civil justice matters, using your public interest and civil litigation experience to identify gaps, assess practical usefulness, and deliver expert feedback that supports access to justice. Key Responsibilities...LegalHourly payRemote workSaidGig
United Statesa month ago€150 - €160 per hour
...French corporate and commercial law expertise to help evaluate the quality of AI-generated legal answers. You will review responses to practical French... ...practice, with 3+ years preferred. Current in-house lawyers are eligible only if they moved in-house within the...LegalHourly payFor contractorsRemote workSaidGig
Remote22 days ago$90 - $100 per hour
...Design and author realistic corporate law evaluation tasks used to test AI systems in high-stakes corporate... ...and write rubrics that reflect senior lawyer judgment rather than law school level... ...transaction tooling, such as legal research platforms, virtual data rooms...LegalHourly payContract workRemote workSaidGig
United States25 days ago$90 - $150 per hour
...Overview Apply your M&A experience to improve how advanced AI handles real-world contract review, negotiation, and legal risk analysis. This part-time, remote contractor role focuses on training and evaluating AI systems used in legal work, with particular emphasis on...LegalHourly payContract workPart timeFor contractorsRemote workSaidGig
United Statesa month ago$90 - $100 per hour
...Role Overview Design and author complex regulatory law evaluation tasks for AI systems used in regulatory compliance and government affairs. Workstreams... ...are encouraged to apply. The two tracks emphasize different legal frameworks, US Administrative Procedure Act and agency-...LegalHourly payFixed term contractRemote workSaidGig
United Statesa month ago$60 per hour
A specialized AI consultancy is seeking legal consultants for project-based roles evaluating AI systems. Ideal candidates will have a law degree and at least two years of legal practice experience within US jurisdiction. Responsibilities include generating prompts to challenge...LegalPart timeFreelance10 hours per week$60 per hour
A leading technology firm based in the United States is seeking legal consultants for project-based AI opportunities. The role involves generating prompts, evaluating AI solutions, and improving AI reasoning. Candidates should have a law degree and at least two years of...LegalFreelanceFlexible hours$90 - $100 per hour
...Role Overview Design and author realistic evaluation tasks for AI systems used in civil rights, environmental, and public advocacy work. This... ...government accountability. Develop scenarios that involve legal research platforms, case management systems used by legal aid...LegalHourly payWork at officeRemote workSaidGig
United Statesa month ago$60 per hour
A tech consulting firm is seeking legal consultants to engage in project-based opportunities evaluating AI systems. Ideal candidates include those with a law degree and experience in US law, able to commit to part-time tasks of 10-20 hours a week. As contributors, you...LegalPart timeFreelance$60 per hour
A specialized legal consulting firm seeks legal consultants and attorneys familiar with US law for part-time, project-based roles. The position involves generating prompts for AI, evaluating AI solutions for correctness, and improving AI reasoning. Ideal candidates possess...LegalPart timeFreelance10 hours per weekFlexible hours$60 per hour
A leading tech engagement firm in the United States is seeking legal consultants with expertise in US law for project-based AI opportunities. Contributors will evaluate AI-generated solutions, generate prompts, and improve AI reasoning, requiring 2+ years of legal practice...LegalFreelance10 hours per weekFlexible hours$60 - $100 per hour
...Role Overview Shape how advanced AI systems handle real-world legal work. You will partner closely with an AI research team to translate specialist... ...tasks, model instructions, reference solutions, and evaluation benchmarks. Key Responsibilities Review legal knowledge...LegalHourly payFull timeFreelanceInternshipLive inRelocationRelocation packageSaidGig
Bay County, FL25 days ago$60 per hour
A tech consulting firm is seeking legal consultants with US law experience for part-time, project-based opportunities. You will generate prompts for AI, evaluate solutions, and improve reasoning standards. Ideal candidates have a law degree and 2+ years of legal experience...LegalPart timeFreelance$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a stable...LegalPermanent employmentPart timeFreelanceFlexible hours$100 - $150 per hour
...Overview Our client is supporting the development of advanced AI systems for professional legal use, with a focus on improving the quality of legal... ...review and improve AI-generated legal content. You will evaluate briefs, arguments, memoranda, and other litigation...LegalHourly payContract workPart timeFor contractorsRemote work$60 per hour
A tech consulting firm is seeking legal consultants or attorneys experienced in US law to evaluate AI systems on a project basis. This role requires strong written English proficiency and a degree in law. Contributors will generate prompts, assess AI solutions, and improve...LegalHourly payFreelance10 hours per week$100 - $120 per hour
...Apply your finance and real estate legal experience to evaluate AI-generated work product for realistic legal matters. You will assess blinded deliverables... ...development agreements. Qualifications Qualified lawyer with substantive practice experience in the listed...LegalHourly payFor contractorsSaidGig
United States3 days ago$100 - $120 per hour
...Role Overview Apply your business immigration expertise to evaluate AI-generated legal work products for a realistic synthetic matter. You will... ...and blanket L eligibility. Qualifications Qualified lawyer with substantive experience in the practice area described...LegalHourly payFor contractorsSaidGig
United States3 days ago$140 - $150 per hour
...is offering a specialised part-time consulting opportunity for experienced corporate and M&A lawyers qualified to practise in France. The role supports an AI legal evaluation project benchmarking AI responses to French law questions. You will review AI-generated answers...LegalRemote jobPart time$90 - $100 per hour
...Role Overview Design evaluation tasks and realistic practice materials for AI systems that will operate in patent prosecution, licensing, and intellectual property... ...authentic practitioner reasoning from generic legal recall. Key Responsibilities Construct IP scenarios...LegalHourly payWork at officeRemote workSaidGig
United Statesa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lawyer for Legal AI Evaluation. Be the first to apply!
