Practicing Attorney for AI Training and Evaluation

Shape how advanced AI systems handle real-world legal work. You will partner closely with an AI research team to translate specialist legal judgment into high-quality tasks, model instructions, reference solutions, and evaluation benchmarks.

• Review legal knowledge-work tasks and model outputs, identifying missing behaviors, weak reasoning, and responses that would not meet professional legal standards.
• Create detailed instruction specifications, authoritative reference solutions, and legal tasks grounded in actual practice.
• Design demanding legal evaluation sets and help develop legal-specific model skills and tools.
• Calibrate quality standards with researchers and adjacent-domain specialists, converting professional legal judgment into clear, teachable evaluation criteria.

• Juris Doctor from an accredited law school. Graduation from a highly ranked law school is strongly preferred.
• At least 5 years of substantive post-qualification practice at a reputable law firm, corporate legal department, regulatory body, or court. Internships and clerkships alone do not qualify.
• Specialization in at least one substantive area, such as corporate and transactional law, litigation and dispute resolution, regulatory and compliance, intellectual property, employment and labor, or tax.
• Demonstrated progression to a senior role, such as partner, of counsel, counsel, senior associate, senior in-house counsel, or general counsel, with meaningful ownership of legal matters.
• Active admission to at least one U.S. state bar and good standing.
• Professional experience using large language models and the ability to distinguish sound legal reasoning from plausible but incorrect answers.
• Excellent written communication and the ability to provide precise, well-structured feedback.

• Full-time W-2 position, with a 40-hour weekly commitment for an initial 6-month engagement.
• Hybrid role based in the Bay Area, California. Work on-site with the client team multiple days each week when required.
• This is not a remote position. Candidates must live in the Bay Area or relocate there at their own expense before the engagement begins. Relocation assistance is not available.
• Client-issued accounts and equipment will be provided, and work will be performed within the client’s tools alongside its research team.
• This is a structured role integrated with internal enterprise workflows, not a freelance or project-based engagement.

$60 to $100 per hour.

You may first discover the opportunity through an online job platform. Employment onboarding, payroll, and benefits administration are handled by the employer of record.

Employment decisions are made without discrimination based on any legally protected characteristic, including race, religion, color, national origin, sex, pregnancy or related conditions, sexual orientation, gender identity or expression, age, veteran status, disability, genetic information, or political views or activity. Reasonable accommodations are available for qualified individuals with disabilities and disabled veterans throughout the application process.