Senior Lawyer for AI System Evaluation
$110 - $150 per hourSaidGig
Help shape AI evaluation work for complex enterprise legal matters by creating realistic scenarios, reference materials, and scoring rubrics grounded in the demands of Fortune 500 and large public-company legal teams. Role Overview
This role focuses on legal workflows involving significant regulatory complexity, transaction scale, and organizational risk. You will translate senior-level legal judgment into evaluation tasks that distinguish rigorous reasoning from superficial responses.
Key Responsibilities- Create enterprise legal scenarios spanning in-house counsel, regulatory, transactional, and litigation matters for Fortune 500-scale organizations.
- Draft and review materials based on enterprise compliance regimes, including FCPA, SOX, GDPR, HIPAA, and banking, healthcare, pharmaceutical, and insurance regulations.
- Develop tasks involving material-scale enterprise contracts, including MSAs, SOWs, DPAs, and licensing agreements, as well as M&A diligence for Fortune 500 transactions.
- Create ERM- and COSO-aligned risk scenarios, board-level reporting materials, and investigations for regulated industries.
- Write detailed, criterion-referenced rubrics that reflect the judgment expected of a senior Fortune 500 lawyer.
- At least 2 years of experience as in-house counsel at a Fortune 500 or large public company, or as a partner or senior associate at an AmLaw 100 firm representing Fortune 500 clients.
- Deep experience in one or more enterprise practice areas, including M&A, securities, regulatory, employment, intellectual property, privacy, or commercial contracting at Fortune 500 scale.
- Familiarity with CLM platforms such as Ironclad, Agiloft, or Icertis, plus enterprise GRC tools.
- JD and active bar admission.
- Experience authoring rubrics, exams, or training content is preferred.
- Remote, hourly engagement.
- Minimum commitment of 20 hours per week.
- Before beginning live work, contributors complete a paid calibration program focused on the required quality standard.
- High-performing contributors may advance to reviewer, lead, and domain subject-matter-expert roles with higher rates.
$110 to $150 per hour, determined by demonstrated expertise.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Lawyer for AI System Evaluation in United States vacancy
$90 - $100 per hour
...Overview Design and author realistic corporate law evaluation tasks used to test AI systems in high-stakes corporate transactions, capital markets... ...transaction documents, and write rubrics that reflect senior lawyer judgment rather than law school level recall. The...SuggestedHourly payContract workRemote workSaidGig
United States19 days ago$90 - $100 per hour
...Role Overview Design and author realistic evaluation tasks for AI systems used in civil rights, environmental, and public advocacy work. This senior role creates scenario worlds calibrated to societal stakes, regulatory scope, and community impact for major public interest...SuggestedHourly payWork at officeRemote workSaidGig
United States24 days ago- United States Digital Space LLC is seeking a deeply technical, hands-on AI product leader to shape system design, evaluation, and requirements for global users. You will work at the intersection of user needs, model capability, and architectural constraints to deliver...Senior
- Hims, Inc. is seeking a Senior Staff Engineer to own end-to-end AI evaluation, data pipelines, and governance across teams. You will define metrics, build robust... ..., and scale datasets for trustworthy healthcare AI systems. You will lead multi-team initiatives, mentor...SeniorRemote job
$110 - $150 per hour
...Role Overview Help shape AI evaluation tasks for legal work in Fortune 500 and large public-company environments. You will create... ...rubrics that reflect the judgment expected of a senior Fortune 500 lawyer. Qualifications At least 2 years of experience as in...SeniorHourly payFor contractorsRemote workSaidGig
United States24 days ago- ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes for multi-... ...tracing, and building non-deterministic systems that yield meaningful evaluation...Senior
- ...US position based in California, seeks a Senior Litigation Attorney with extensive US litigation experience to contribute to an AI evaluation project. The role involves drafting... ...litigation scenarios, directing junior lawyers, and ensuring high-quality submissions while...SeniorRemote job
$201k - $315k
...City, CA / San Diego, CASoftware - Software Systems /Full-time /HybridSimulation is central... ...this role, you will develop metrics and evaluation pipelines to assess simulator fidelity and... ....We may use artificial intelligence (AI) tools to support parts of the hiring process...SeniorFull timeTemporary workRelocation package$80 - $90 per hour
...Overview Design and author realistic enterprise product evaluation tasks used to assess AI systems in Fortune 500 level product contexts. You will create... ...reflect the judgment and decision making expected of senior product leaders operating at large public company scale...SeniorHourly payRemote workSaidGig
United States19 days ago$70 - $110 per hour
...Role Overview Apply your legal practice experience to evaluate and improve AI-generated legal content and workflows. You will assess work grounded... .... Qualifications At least 4 years of experience as a Lawyer, Attorney, Counsel, General Counsel, Prosecutor, or in a...Hourly payImmediate startRemote workSaidGig
United States7 days ago$50 - $60 per hour
...Role Overview Build realistic enterprise insurance evaluation tasks and reference materials used to test AI systems in large, complex insurance and risk environments... ..., model outputs, and rubrics that reflect senior practitioner judgment. Key Responsibilities...SeniorHourly payRemote workSaidGig
United States24 days ago$144.7k - $261.3k
Job DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges... ...and scalability of next-generation autonomous systems.About the RoleAs a Senior Engineer in the Embodied AI Scaling...SeniorFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours- ...The Opportunity Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems to join the team responsible for validating the quality of our speech, audio, and multilingual models before they reach customers. This team owns the evaluation and...SeniorFull time
Deepgram
Remotea month ago $90 - $100 per hour
...Role Overview Design and author complex regulatory law evaluation tasks for AI systems used in regulatory compliance and government affairs. Workstreams... ...design, reference outputs, and rubrics that reflect senior regulatory counsel judgment. Key Responsibilities...Hourly payFixed term contractRemote workSaidGig
United States24 days ago$166k - $220k
...Anduril is changing how military systems are designed, built and sold.... ...is powered by Lattice OS, an AI-powered operating system that... ...TEAM The Mission Systems Test & Evaluation team owns the characterization... ...programs. We're looking for a Senior Manager, Test & Evaluation to...SeniorFull timeWork experience placement- ...Requisition #: 1678 Job Title: Advanced Battle Management System (ABMS) Test & Evaluation Analyst - Senior Location: Fort Huachuca, AZ Clearance Level:... ...Disabilities We may use artificial intelligence (AI) tools to support parts of the hiring process, such as...SeniorContract workFor contractorsWork at office
Agile Defense
Arizona3 days ago - Mercor is seeking senior public interest law professionals to design evaluation tasks for AI systems used in civil rights, environmental, and public advocacy contexts in the United States. The role spans federal civil rights statutes, NEPA, and Clean Air/Water Act tracks...Senior
- Mercor seeks senior regulatory law professionals to design evaluation tasks for AI systems in regulatory compliance and government affairs contexts, spanning US and International tracks. You will craft scenarios, draft reference outputs, and write rubrics reflecting senior...Senior
- Sail is the foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers... ...background agent. Let's design and build the rest of the system, that turns billions of tokens into the best possible answers. What...SeniorWork at officeImmediate start
- General Motors in the United States seeks a Senior Engineer on the Embodied AI Scaling Foundations team to measure and visualize autonomous vehicle... ...across the stack. You will design, implement, and iterate evaluation and introspection tools, collaborate with Data, Infra,...SeniorRemote jobRelocation package
$150k - $200k
...Runpod is the AI Developer Cloud. More than one million developers... .... We're looking for a Senior Developer Advocate who lives at... ...Success means repeatable, durable systems rather than one-off efforts.... ...workforce at every level. We evaluate qualified applicants without regard...SeniorRemote workHome officeVisa sponsorshipWork visaFlexible hoursRunpod Inc
United States4 days ago- ...leader to accelerate the application of AI and agentic systems across drug discovery. Working at the... ...will drive the strategy, development, evaluation, deployment, and adoption of AI-... ...scientists, engineers, data scientists, and senior leaders across a matrixed organization...SeniorFull timeSummer workRemote workFlexible hours2 days per week3 days per week
$184.03k - $266.49k
...Edge. ADI combines analog, digital, AI, and software technologies into solutions... ...Learn more at and on LinkedIn and X.Senior Principal Engineer, Systems Design/ArchitectThe ADI Industrial... ...working directly with customers and evaluation engineers to compare and contrast...SeniorPermanent employmentFull timeWork at officeLocal areaRemote workDay shift- Mercor seeks senior litigation professionals to build evaluation tasks for AI systems operating in civil litigation and dispute resolution contexts. The role spans US track (FRCP, FRE, state court analogs) and International track (CPR, ICC, LCIA) with experts in either...Senior
$220k - $250k
...Senior Developer Advocate New York, NY Founded by Eliot Horowitz... ...experiment with new physical AI technology. Prior... ...on with hardware and physical systems. What You'll Do: Build... ...understanding of how developers discover, evaluate, and adopt new technologies....SeniorFull timeWork at officeAfternoon shift3 days per weekViam
New York, NY4 days ago- ...Senior/Staff/Principal Imaging System Software EngineerHorizon Surgical Systems Inc. is revolutionizing the world... ...by developing a novel, AI driven, and imaging-guided surgical... ...software optimization.Prototype and evaluate new algorithms and technologies to improve...Senior
Horizon Surgical Systems
Los Angeles, CA2 days ago $117.2k - $313.7k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying... ...and reliably.Critically evaluate code (Human or AI-generated) for correctness...SeniorFull time$100 - $120 per hour
...Apply your Australian litigation expertise to evaluate how AI systems respond to practical legal questions. You will independently review and compare AI-generated answers using a structured evaluation process. Key Responsibilities Run the same legal prompts through...Hourly payRemote workSaidGig
Remote15 days ago$70 - $110 per hour
...finding and building careers in AI training and data labeling. It... ...to help improve modern AI systems, while providing a place to build... ...a durable portfolio of work evaluating advanced AI systems About AI Training... ...Role As a Legal AI Evaluation Lawyer, you will evaluate AI-...Hourly payContract workPart timeFor contractorsRemote workFlexible hours- ...Senior Principal Mechanical Systems Architect From applied research to advanced engineering, the Engineering Technologist team has the expertise to... ...commercial and consumer line of business for mini PC and AI PC portfolio. You will also leverage data, dashboards, and...Senior
Dell GmbH
Austin, TX1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lawyer for AI System Evaluation. Be the first to apply!
