International Disputes Lawyer for Legal AI Evaluation

Evaluate AI-generated legal work on realistic disputes and international matters, using your professional judgment to identify the strongest analysis and explain your conclusions. Role Overview

You will serve as an expert reviewer in a blinded human-preference study for legal AI work products. The work focuses on international arbitration and award enforcement, sanctions and export controls, cross-border disputes, and emergency interim relief.

• Review a synthetic legal matter and its supporting documents.
• Assess six blinded AI-generated deliverables, labeled A through F, for the same matter.
• Complete five head-to-head comparisons against a common comparator deliverable.
• Document a concise, specific written rationale for each preference.

• Qualified lawyer with substantive practice experience in the relevant disputes and international practice areas.
• Ability to evaluate legal work product holistically, including correctness, completeness, professional judgment, and practical usefulness.
• Precise written English.
• Ability to work independently from written instructions and meet deadlines.

• Hourly engagement with an expected commitment of approximately 24 hours.
• All work is subject to a nondisclosure agreement.
• Do not use external AI tools with any project materials.

$100 to $120 per hour.