Litigation Lawyer for Legal AI Evaluation

Role Overview

Evaluate how AI systems respond to practical questions of French law by testing identical prompts across two AI platforms, comparing the results, and applying a standardized assessment rubric.

Key Responsibilities

• Run the same set of prompts on two AI language-model platforms.
• Review and compare both responses side by side.
• Score each response using the provided standardized rubric.
• Provide concise written feedback for every evaluation.

Qualifications

• At least 2 years of primarily law-firm experience in litigation, disputes, or contentious practice. Three or more years is preferred.
• If currently working in-house, you must have moved in-house within the past 2 years and have prior law-firm experience.
• Qualified to practise in France as an avocat/e, with strong knowledge of French litigation and procedural law.
• Native or fluent French with precise written communication skills.
• Ability to work independently, follow a rubric, and meet deadlines.

Work Terms

• Remote role open to candidates located in France.
• Hourly engagement.
• Initial commitment of approximately 10 hours, with potential for additional work.
• All work is subject to a non-disclosure agreement.

Compensation

150 to 160 per hour.