Legal Practitioner for AI Training and Evaluation

Contribute deep legal expertise to a GenAI research team by defining what correct legal reasoning and outcomes look like, and by evaluating whether advanced AI models perform to professional standards. This role places a practicing legal specialist directly with an AI research group to create instruction specifications, golden solutions, and rigorous benchmarks that improve model behavior on real legal tasks.

• Data quality assurance, reviews, and feedback: assess the fidelity of legal tasks and model outputs, identify missing behaviors, weak reasoning, and answers that appear plausible but would not pass professional scrutiny.
• Instruction specifications and golden datasets: write clear instruction specs, craft golden solutions to legal problems, and define new task formulations that match how legal work is actually done.
• Benchmarks and domain depth: design challenging evaluation sets and legal tasks to measure model capability and build legal-specific skills and tooling with the research team.
• Calibration and standards: collaborate with researchers and adjacent specialists to translate tacit legal judgment into explicit, teachable criteria, and maintain consistent evaluation standards.

• Juris Doctor, from an accredited law school, with preference for graduates of highly ranked programs.
• At least 5 years of substantive post-qualification legal practice at a reputable institution, such as an established law firm, corporate legal department, regulatory body, or court; internships and clerkships alone do not meet this requirement.
• Deep specialization in at least one substantive practice area, for example corporate and transactional law, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labor, or tax.
• Senior-level progression with real matter ownership, such as partner, of counsel, counsel, senior associate, senior in-house counsel, or general counsel.
• Active admission to at least one U.S. state bar, in good standing.
• Practical experience using large language models in professional work, with the judgment to distinguish well-reasoned answers from plausible-sounding but incorrect outputs.
• Excellent written communication, including the ability to provide precise, structured written feedback.
• Ability to commit reliably to 40 hours per week for an initial engagement period of 6 months.
• Practicing specialist profile preferred over a generalist background.

• Employment type: W-2 hourly employment through Cincinnatus LLC, placed to work directly with a leading AI research team as part of their extended workforce.
• Schedule: Full-time commitment, 40 hours per week, for an initial 6 month engagement.
• Location and on-site expectation: Hybrid role based in the Bay Area, California. You must live in the Bay Area and be available to work on-site with the client team multiple days each week when required. This is not a remote role.
• Relocation: Candidates not currently based in the Bay Area must be willing to relocate at their own expense prior to starting; relocation assistance is not provided.
• Workspace and tools: You will be provisioned with client-issued accounts and equipment, and will work inside the client’s tools alongside their research teams.
• Role type: Structured, role-based employment rather than a project-only or freelance engagement, involving close collaboration with internal teams and integration into enterprise workflows.

Hourly rate range: $60.00 to $100.00 per hour.

• Active U.S. state bar admission in good standing is required.
• Must live in the Bay Area, California, or be willing to relocate at personal cost before the engagement begins. This role is not available for remote work.

Applications are processed and employment is administered by Cincinnatus LLC, which serves as the employer of record for this position, handling hiring, onboarding, payroll, and benefits. Submit your application through the posting channel where you found this opportunity; your candidacy will be routed to Cincinnatus for consideration and onboarding if selected.

Cincinnatus LLC is an Equal Employment Opportunity employer. All qualified applicants will receive consideration regardless of legally protected characteristics. Reasonable accommodations are available for qualified individuals with disabilities during the application process.