In-House Legal Counsel for AI Evaluation [Remote]

Evaluate how two large language model platforms answer real questions of UK law by running identical prompts, comparing outputs, scoring them against a provided rubric, and delivering concise written feedback. This is a short, remote hourly engagement for experienced in-house counsel with strong commercial and contract law experience in the United Kingdom.

• Execute a predefined set of prompts on two AI language model platforms, ensuring the same prompts are used for both systems.
• Compare the responses from each platform side by side and identify differences in analysis, accuracy, and relevance.
• Score every response using a standardized rubric supplied by the project team.
• Provide concise written feedback for each evaluated response, explaining scoring decisions where relevant.

• Minimum 5 years experience as in-house legal counsel practising in the United Kingdom.
• Deep knowledge of UK law, with particular strength in commercial and contract matters.
• Excellent attention to detail and precise written English.
• Ability to follow a defined rubric and complete work independently to agreed deadlines.

• Location: United Kingdom, remote work permitted.
• Engagement type: hourly contract.
• Initial commitment approximately 10 hours, with strong potential for additional assignments.
• All work is subject to a nondisclosure agreement, which must be accepted prior to starting.

150 - 160 hourly.

• You must be practising in the United Kingdom and able to demonstrate the required in-house counsel experience.
• Agreement to the NDA is required before beginning work.