Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote)

$28 - $34 per hour

AuraOne Human Data

Remote
  • Remote job

Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote) is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote) assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote) work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$28–$34 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote) in Remote vacancy
  • $40 - $49 per hour

     ...Simplified Chinese Legal AI Evaluation Specialist — Multiple-Choice QA Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers...  ...outputs against current legal review statutes, case law, or policy for Simplified Chinese Legal AI... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  • $40 - $49 per hour

     ...Simplified Chinese AI Output Reviewer — Generalist Multiple-Choice QA is a remote Chinese specialist track for evaluating chinese evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  • $39 - $47 per hour

     ...Danish Finance AI Evaluation Specialist - Multiple-Choice Finance QA Review is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  •  ...’s fastest-growing AI companies, pushing...  ...ability to apply U.S. law with precision and...  ...and legal experts shaping foundational...  ...leading AI labs to: Review and evaluate model...  ...hypotheticals across multiple domains of law....  ...helping define new benchmarks for legal understanding... 
    Remote work
    For contractors
    Flexible hours

    Turing

    Chicago, IL
    2 days ago
  • $39.69 - $48.51 per hour

     ...Create original, exam-style multiple-choice questions in Simplified Chinese...  ...evaluate understanding of Chinese law. Work from your own...  ...expertise to produce items for an AI evaluation dataset. Each item...  ...a worked solution. This is a remote, hourly role with flexible scheduling... 
    Remote work
    Hourly pay
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $50 - $60 per hour

    A healthcare technology company is seeking a Clinical Reviewer to enhance AI models through comprehensive evaluation. The ideal candidate must have a medical degree and fluency in English. The role allows for flexible hours and is available as both full-time and part-time... 
    Remote work
    Hourly pay
    Full time
    Part time
    Flexible hours

    DataAnnotation

    Hartford, CT
    3 days ago
  • $85 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...hour Location: Remote Role Responsibilities...  ...tasks. Review model-generated frontend...  ...Compare outputs from multiple frontier models and assess... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Remote
    17 hours ago
  • $50 per hour

    A leading AI research accelerator is looking for remote PhD candidates in Chemistry, Chemical Engineering, or related fields. You will design advanced chemistry...  ...AI performance and collaborate with researchers on benchmarks. This role offers flexible hours and a pay rate of... 
    Remote job
    Hourly pay
    Flexible hours

    Turing

    New York, NY
    2 days ago
  • $1,150 - $1,450 per month

     ...talent with leading AI research labs....  ...investors include Benchmark , General Catalyst...  ...& Administration Expert Type: Contract...  ...Location: Remote Role Responsibilities...  .... Navigate multiple apps, files, and stakeholders...  ...task scope, and review scenarios for... 
    Remote work
    Hourly pay
    Full time
    Contract work
    Summer work

    Mercor

    San Diego, CA
    22 days ago
  • $50 - $60 per hour

    A leading AI training firm is seeking a Clinical Reviewer to evaluate AI chatbot performance on healthcare-related tasks. This remote role requires expertise in healthcare, including various clinician roles. Responsibilities include assessing the accuracy of solutions provided... 
    Remote job
    Hourly pay

    DataAnnotation

    Iowa, LA
    3 days ago
  • $80 - $180 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...SWE (Chinese, Japanese, Ukrainian) Type: Contract...  ...hour Location: Remote Role Responsibilities Review and assess technical and... 
    Remote work
    Ukrainian language skills
    Full time
    Contract work
    Summer work

    Mercor

    Remote
    17 hours ago
  • $62k - $141k

     ...stockpiles Experience reviewing analytical products for...  ...with opportunities and choices, and support your total...  ...prevent fraud.Candidate AI Usage PolicyAI is a part...  ...on during meetings.Remote: If this position is listed...  ..., or international law.SummaryLocation: Reston... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area

    Booz Allen Hamilton

    Reston, VA
    4 days ago
  • $90 - $100 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Position: Regulatory Law Expert Type: Contract...  ...0/hour Location: Remote Role Responsibilities...  ...mercor.com PS: Our team reviews applications daily. Please... 
    Remote work
    Contract work
    Summer work

    Mercor

    Chicago, IL
    1 day ago
  • $70 - $90 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Position: Cybersecurity Experts Type: Contract...  ...Location: Remote Duration: ~2 months...  ...Responsibilities Analyze and review content for security... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Remote
    17 hours ago
  • $72.8k - $129.9k

     ...the rise. We're expanding in multiple directions, across borders and...  ...clinical programs and projects for review- this includes data analysis...  ..., you’ll find a far-reaching choice of benefits and incentives....  ...other characteristic protected by law.UnitedHealth Group is a drug -... 
    Remote work
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    Pittsburgh, PA
    4 days ago
  • $99k - $225k

     ...Europe Subject Matter Expert Cyber Threat...  ...opportunities and choices, and support your total...  ...our Careers site and reviewing Our Employee...  ...prevent fraud.Candidate AI Usage PolicyAI is a...  ...on during meetings.Remote: If this position is...  ..., or international law.SummaryLocation: Arlington... 
    Remote work
    Full time
    Contract work
    Part time
    Work at office
    Local area

    Booz Allen Hamilton

    Arlington, VA
    5 days ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Cybersecurity Labeling Expert Type: Contract...  ...hour Location: Remote Duration: 2–3...  ....com PS: Our team reviews applications daily. Please... 
    Remote work
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    17 hours ago
  •  ...across relevant jurisdictions. Review and prepare corporate...  ...internal policies, and applicable law. Documentation, Reporting...  ...principles; ~ Ability to manage multiple priorities and complex legal...  ...Languages Proficiency: Ukrainian — fluent English — fluent... 
    Remote work
    Ukrainian language skills
    Contract work
    Local area

    MGID

    United States
    3 days ago
  • $50 - $90 per hour

     ...legal expertise to shape how AI systems understand and evaluate...  ...and international humanitarian law into structured frameworks,...  ...Evaluate and refine policy-relevant benchmarks to ensure responsible testing...  ...: Contractor. Location: Remote. Engagement: Contribute to... 
    Remote job
    Hourly pay
    For contractors

    SaidGig

    Remote
    19 days ago
  •  ...Pharmacovigilance Expert — Safety Case Review for AI Evaluation is a remote review track for evaluating AI outputs across pharmacovigilance specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Physics Expert — Gravitation, Cosmology & Astrophysics AI Review is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  •  ...Mechanical Design and CAD Expert - AI Output Review is a remote review track for evaluating AI outputs across cad design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  • $127k - $152k

     ...Engineer II to join our AI Enablement product...  ...Consulting & Embedded Experts team. In this role, you...  ...matrixed environments with multiple stakeholdersStrong ability...  ...tools to assist in reviewing and evaluating job applications...  ...rights.LinkedIn Remote Hashtag#LI-Remote LinkedIn... 
    Remote work
    Hourly pay
    Temporary work
    Work experience placement
    Work at office

    Principal Financial Group

    Charlotte, NC
    5 days ago
  • $24 - $35 per hour

     ...to train next-generation AI systems. This contract, remote role focuses on converting...  ...Korean and English content. Review, edit, and proofread...  ...and meeting defined quality benchmarks. Provide feedback on workflow...  .... Ability to manage multiple assignments and adapt to... 
    Remote job
    Hourly pay
    Contract work
    For contractors

    SaidGig

    Remote
    2 days ago
  • $91.7k - $163.7k

     ...determinations.Services reviewed may include, but are...  ...the flexibility to work remotely * from anywhere within...  ...ability to prioritize multiple demands within strict turnaround...  ...ll find a far-reaching choice of benefits and...  ...with all minimum wage laws as applicable.Application... 
    Remote work
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Work from home
    Monday to Friday

    UnitedHealth Group

    Louisville, KY
    2 days ago
  • $134.6k - $230.8k

     ...analytics and AI to cybersecurity...  ...flexibility to work remotely * from anywhere...  ...across multiple domains and healthcare...  ..., benchmarking, and monitoring...  ...data scientists, review technical designs...  ...a far-reaching choice of benefits and...  ...all minimum wage laws as applicable.Application... 
    Remote work
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    Eden Prairie, MN
    4 days ago
  • $90k - $130k

     ...meet EB1A eligibility criteria, reviewing their qualifications and...  ...latest changes in immigration law and policies, particularly in...  ...skills. Ability to manage multiple cases efficiently and with attention...  ...working hours and potential for remote work. A dynamic, inclusive,... 
    Remote work
    Full time
    H1b
    Work visa
    Flexible hours

    ImmigrationJobs

    Seattle, WA
    2 days ago
  • $40 - $60 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Healthcare Administration Expert Type:...  ...hour Location: Remote Role Responsibilities...  ....com PS: Our team reviews applications daily. Please... 
    Remote work
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work

    Mercor

    Remote
    17 hours ago
  • $40 per hour

     ...healthcare technology company in the United States seeks medical experts to evaluate AI chatbots. Responsibilities include presenting healthcare...  ...degree. This role offers flexibility and the opportunity to work remotely, with pay starting at $40+ per hour. #J-18808-Ljbffr
    Remote work
    Hourly pay

    DataAnnotation

    Helena, MT
    4 days ago
  • $70 - $100 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...0/hour Location: Remote Commitment: 15–20...  ...Preferred Experience across multiple listed domains or tools...  ....com PS: Our team reviews applications daily.... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ukrainian Law Expert — Multiple-Choice AI Benchmark Review (Remote). Be the first to apply!