In-House Counsel for AI Legal Evaluation [Remote]

Evaluate and benchmark how two AI language models answer real questions of Spanish law by reviewing paired outputs, scoring them against a provided rubric, and delivering concise written feedback for each evaluation. This is a short-term, remote engagement for a lawyer experienced in Spanish commercial and contract matters.

• Run the same set of legal prompts through two AI LLM platforms.
• Compare the outputs from both platforms side by side.
• Score each AI response using a standardized rubric that will be supplied.
• Provide concise, clear written feedback for every evaluation completed.

• At least 5 years of experience as in-house legal counsel practising in Spain.
• Strong knowledge of Spanish law, with emphasis on commercial and contract matters.
• High attention to detail, and precise written communication skills.
• Ability to work independently, follow a rubric closely, and meet deadlines.

• Location: Remote, must be based in Spain.
• Engagement type: Hourly contract.
• Initial time commitment: Approximately 10 hours, with a strong potential for additional assignments.
• All work is subject to a confidentiality agreement, you will be required to sign an NDA.

• Rate: 140 - 150 hourly.

• Must have practised as in-house counsel in Spain for the required experience period noted above.
• Applicants must be able to perform work under the NDA and complete evaluations remotely according to the rubric and deadlines.