Criminal Lawyer — AI Legal Evaluation Reviewer [Remote]
AuraOne Human Data
Remote
- Remote job
Criminal Lawyer — AI Legal Evaluation Reviewer is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.
Why this role matters
Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.
Responsibilities
- Review AI outputs against current legal review statutes, case law, or policy for Criminal Lawyer — AI Legal Evaluation Reviewer assignments.
- Verify citations, jurisdictions, and dates against authoritative sources.
- Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
- Capture the corrected analysis or memo paragraph so the modeling team can train on it.
- Adjudicate disputed treatments against published authority or firm policy.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Active or recent qualification in legal review or an adjacent practice for Criminal Lawyer — AI Legal Evaluation Reviewer work.
- Hands-on experience drafting, reviewing, or advising on real matters.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites authority and names the rule being applied.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Verify the citations in a model's legal review memo and flag any miscites with severity.
- Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
- Adjudicate a disputed treatment between two reviewers using current authority.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Bar admission or legal-equivalent credential in a relevant jurisdiction.
- Prior experience reviewing AI-assisted legal-research or compliance tooling.
- Bilingual experience for cross-jurisdiction matters.
Skills
- Legal research
- Citation review
- Statutory analysis
- Policy reasoning
- Legal review
- Legal
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Criminal Lawyer — AI Legal Evaluation Reviewer [Remote] in Remote vacancy
$140 per hour
...Role Overview Provide criminal law subject matter expertise to help train next-generation AI systems by reviewing and annotating legal materials, evaluating AI-generated legal text, and delivering concise, actionable feedback. This is a remote contractor engagement supporting...LegalRemote jobHourly payFor contractorsSaidGig
Indiana1 day ago$140 per hour
...Role Overview Apply your criminal defense expertise to train and evaluate next-generation AI systems. In this contractor role you will provide real-world legal judgment, draft and critique criminal... ...priority. Key Responsibilities Review, annotate, and provide feedback...LegalRemote jobHourly payFor contractorsSaidGig
Indiana3 days ago$50 - $60 per hour
...experienced Appellate Attorney to assist in training AI models by evaluating their logical outputs and solving complex legal problems. Ideal candidates will have a J.D. and... ...various fields, including corporate law, criminal law, and more. This independent contractor position...LegalHourly payFor contractorsRemote workWork from homeDataAnnotation
Oklahoma City, OK2 days ago$90 - $130 per hour
...Role Overview Help train and evaluate advanced legal AI by applying your transaction law expertise to contract drafting, redlining, and negotiation... ...risk and interpret contract language, through hands-on review, simulated negotiations, and creation of objective evaluation...LegalHourly payContract workPart timeFor contractorsRemote workSaidGig
United States2 days ago$50 - $60 per hour
...DataAnnotation is looking for an Appellate Attorney to help train AI models by providing complex legal problems and evaluating AI outputs. This role is ideal for General Counsel or those with similar legal expertise. Contract details include working on your own schedule...LegalHourly payContract workRemote workDataAnnotation
Washington DC1 day ago$50 - $60 per hour
...DataAnnotation seeks an experienced Appellate Attorney to train AI models and evaluate their legal outputs. This role allows for flexible project choices and schedules, enabling work from home at an hourly rate of $50-60. Applicants must have a Juris Doctor (J.D.) and...LegalHourly payFor contractorsRemote workWork from homeFlexible hoursDataAnnotation
Florida, NY2 days ago$50 - $60 per hour
DataAnnotation is seeking an Appellate Attorney to train AI models by evaluating their legal outputs and solving complex legal challenges. This role allows for flexible remote work, enabling you to choose projects based on your own schedule and preferences. A J.D. is mandatory...LegalRemote jobHourly payFlexible hours$150 - $160 per hour
...In-House Counsel Reviewer — UK Legal AI Evaluation (Remote) is a remote review track for evaluating AI outputs across in house counsel specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and...LegalRemote jobFor contractorsWork experience placement10 hours per week$40 - $49 per hour
...Traditional Chinese Legal Reviewer - AI Evaluation Work (Remote) is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis...LegalRemote jobFor contractors10 hours per week$38.59 - $47.17 per hour
...Role Overview Produce original, exam-style multiple-choice questions on Finnish law to support an AI evaluation dataset. Each item must reflect your professional legal expertise, include ten answer options, and be accompanied by a worked solution. Key Responsibilities...LegalHourly payRemote workFlexible hoursSaidGig
United States1 day ago$38.59 - $47.17 per hour
...exam-style multiple choice questions on Danish law to support an AI evaluation dataset. The work is remote and offers flexible hours,... ...Draft original exam-style questions based on your professional legal expertise. For each question, provide ten distinct answer options...LegalHourly payRemote workFlexible hoursSaidGig
United States1 day ago$38.59 - $47.17 per hour
...Role Overview Create original, exam-style multiple-choice questions on Swedish law for an AI evaluation dataset. Each item must reflect your professional legal expertise, include ten answer options, and be accompanied by a worked solution that explains the correct answer...LegalHourly payRemote workFlexible hoursSaidGig
United States1 day ago$200k
...actually practice law with legal acumen and grit. DM Cantor Criminal Law Practice is Arizona’s... ...Top Law Firm in Arizona (25 Lawyers or less) for all of... ...success looks like in the role, review your full career history and achievements, evaluate your skills and fit with...LegalWork at officeRemote workDM Cantor Criminal Law Practice, P.C
Phoenix, AZ3 days ago$39.69 - $48.51 per hour
...choice questions in Chinese, Traditional script, focused on Taiwanese or Hong Kong law to support an AI evaluation dataset. Work remotely with flexible hours, using your legal expertise to produce high-quality questions and fully explained solutions. Key...LegalHourly payRemote workFlexible hoursSaidGig
United States1 day ago$76.75k - $197.1k
...United States Attorneys in the Criminal Division of our Roanoke,... ...Additional applicants will be reviewed and referred every two weeks... ...strong academic records, superior legal research and writing skills,... ...is involved so that we can evaluate any potential conflict of interest...LegalFull timePart timeInternshipWork at officeRemote workRelocationUnited States Attorneys' Offices
Abingdon, VA3 days ago$110 per hour
...Role Overview Lawyers will apply their legal practice experience to evaluate AI-generated legal content and provide precise feedback that improves AI understanding... ...legal communication. Key Responsibilities Review AI-generated responses for legal accuracy, logical...LegalHourly payFull timeFor contractorsRemote workFlexible hoursSaidGig
United States1 day ago$82.46k - $197.1k
...Assistant United States Attorney (Criminal) Hiring Organization USAO Northern District of... ...will efficiently and accurately perform legal research, draft legal documents, and present... ...which this Office is involved so that we can evaluate any potential conflicts of interest or...LegalPermanent employmentInternshipWork at officeLocal areaRemote workRelocationThe United States Department of Justice
Tallahassee, FL1 day ago$9.06k - $17.6k
...:Assistant Attorney General (Criminal Prosecutor, DA Asst Section)Job... ...The selected candidate will evaluate and pursue criminal cases,... ...depending primarily on years of legal practice experience and other... ..., including nearly 400 lawyers, are dedicated to the rule of...LegalFull timeWork at officeLocal areaImmediate startRemote workNight shift$78.91k - $197.1k
...States Attorneys (AUSAs) in the Criminal Division prosecute a wide... ...have at least 1* year post-J.D. legal or other relevant experience.... .... Applications will be reviewed on a rolling basis. The closing... ...Office is involved so that we can evaluate any potential conflict of...LegalFull timePart timeWork at officeRemote workRelocationUnited States Attorneys' Offices
San Antonio, TX1 day ago$104.71k - $140.15k
...accountability, and healing. The Criminal Division seeks one or more... ...through units dedicated to reviewing incident reports and filing... ...and data; conducts factual and legal analysis to determine whether... ...employees who are properly evaluated and assigned to provide direct...LegalHourly payFull timeInternshipWork at officeLocal areaRemote workTrial periodFlexible hoursCity of Seattle, WA
United States2 days ago$60 - $150 per hour
...Role Overview Join a Law Expert Network to provide legal subject matter expertise that helps train and evaluate AI systems and inform frontier AI research. This is... ...research and writing, contract drafting and review, litigation and dispute resolution. Strong oral...LegalHourly payContract workImmediate startRemote workSaidGig
United States3 days ago$65 - $90 per hour
...Role Overview Contribute practical legal expertise to improve AI systems'' understanding and reasoning about legal topics by reviewing AI-generated content, answering domain-specific... .... Key Responsibilities Review and evaluate written content and AI-generated...LegalRemote jobHourly payPart time10 hours per weekFlexible hoursSaidGig
Remote1 day ago$90 - $100 per hour
...Role Overview Design realistic regulatory law evaluation tasks and reference outputs used to test AI systems that operate in regulatory compliance and government... ...doctrinal recall, enabling evaluation of nuanced legal reasoning and practical compliance decision-making....LegalHourly payContract workFixed term contractRemote workSaidGig
United States1 day ago- ...Bankruptcy Attorney — Insolvency Reasoning Review for AI Evaluation is a remote review track for evaluating AI outputs across banking workflows... ...review Regulatory standards Risk assessment Banking Legal Work model Remote — US-eligible. Remote · Independent...LegalRemote jobHourly payFor contractorsWork experience placement10 hours per week
- A leading AI consultancy firm is seeking legal consultants for project-based opportunities involving testing and improving AI systems. Candidates should have a degree in law and at least 2 years of legal experience within US jurisdiction. Strong written English is required...LegalPermanent employmentFreelanceRemote work10 hours per week
$90 - $100 per hour
...Role Overview Design evaluation tasks and realistic legal scenarios used to test AI systems in high-stakes public interest contexts, including civil rights, environmental... ...constitutional analysis, regulatory compliance review, and impact litigation strategy, to create...LegalHourly payWork at officeRemote workSaidGig
United States1 day ago$80 - $105 per hour
...experience to improve how advanced AI systems read, interpret, and negotiate... ...and simulated negotiations, evaluate AI outputs against real-world legal standards, and help build rigorous... ...focused on technology agreements. Review and assess AI responses to contract...LegalHourly payContract workPart timeFor contractorsRemote workSaidGig
United States3 days ago$90 - $130 per hour
...Role Overview Help shape how advanced legal AI systems read, evaluate, and negotiate deals by applying practical M&A experience to real-world contract review and redlining workflows. You will perform expert contract analysis and create objective evaluation criteria that...LegalHourly payContract workPart timeFor contractorsRemote workSaidGig
United States1 day ago$140 per hour
...Apply your legal expertise to generate high-quality inputs and evaluations that train next-generation AI systems. This remote contractor role focuses on producing accurate, well... ...accurate for project objectives. Draft, review, and edit legal materials, including memoranda...LegalRemote jobHourly payFor contractorsSaidGig
Indiana2 days ago$140 per hour
...Overview Provide high-level M&A legal analysis and strategic input to help train next-generation AI systems. You will apply your M&A... ...subject-matter expertise to evaluate and generate M&A legal content for AI system training. Review and analyze real-world M&A scenarios...LegalRemote jobHourly payFor contractorsSaidGig
Canada1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Criminal Lawyer — AI Legal Evaluation Reviewer [Remote]. Be the first to apply!
