Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review [Remote]

$39 - $47 per hour

AuraOne Human Data

Remote
  • Remote job

Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on it.

Why this role matters

Legal review content is judged on precision. AuraOne uses qualified legal and policy reviewers to grade AI outputs the way a senior associate would — with citations, severity tags, and the corrected reasoning alongside the original.

Responsibilities

  • Review AI outputs against current legal review statutes, case law, or policy for Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review assignments.
  • Verify citations, jurisdictions, and dates against authoritative sources.
  • Flag risky reasoning, missed exceptions, and policy-adherence gaps with severity tags.
  • Capture the corrected analysis or memo paragraph so the modeling team can train on it.
  • Adjudicate disputed treatments against published authority or firm policy.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Active or recent qualification in legal review or an adjacent practice for Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review work.
  • Hands-on experience drafting, reviewing, or advising on real matters.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites authority and names the rule being applied.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Verify the citations in a model's legal review memo and flag any miscites with severity.
  • Grade a model's statutory reasoning on a complex fact pattern and rate the analysis.
  • Adjudicate a disputed treatment between two reviewers using current authority.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Bar admission or legal-equivalent credential in a relevant jurisdiction.
  • Prior experience reviewing AI-assisted legal-research or compliance tooling.
  • Bilingual experience for cross-jurisdiction matters.

Skills

  • Legal research
  • Citation review
  • Statutory analysis
  • Policy reasoning
  • Legal review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$39–$47 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review [Remote] in Remote vacancy
  • $40 - $49 per hour

     ...Simplified Chinese Legal AI Evaluation Specialist — Multiple-Choice QA Review is a remote review track for evaluating AI outputs in legal review workflows. Reviewers...  ...against current legal review statutes, case law, or policy for Simplified Chinese Legal AI Evaluation... 
    Legal
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $40 - $49 per hour

     ...Simplified Chinese Finance AI Evaluation Specialist — Multiple-Choice QA Review is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation... 
    Suggested
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $38.59 - $47.17 per hour

     ...Role Overview Produce original, exam-style multiple-choice questions on Finnish law to support an AI evaluation dataset. Each item must reflect your professional legal expertise, include ten answer options, and be accompanied by a worked solution. Key Responsibilities... 
    Legal
    Hourly pay
    Remote work
    Flexible hours

    SaidGig

    United States
    3 days ago
  • $112.7k - $193.2k

     ...generation agentic AI systems and...  ...agent/tool use, and evaluation on modern cloud...  ...design/code reviews to derisk delivery...  ...auditabilityCollaborate with legal, compliance, and...  ...with QA, architecture,...  ...a far-reaching choice of benefits and...  ...all minimum wage laws as applicable.Application... 
    Legal
    Minimum wage
    Full time
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Richardson, TX
    5 days ago
  • $200.4k - $343.5k

     ...data analytics and AI to cybersecurity, we...  ...delivery across multiple business domainsTechnical...  ...robust model evaluation, testing, monitoring...  ...close partnership with Legal, Risk, Privacy,...  ...find a far-reaching choice of benefits and incentives...  ...all minimum wage laws as applicable.At... 
    Legal
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Eden Prairie, MN
    2 days ago
  • $203.2k - $348.4k

     ...data analytics and AI to cybersecurity, we...  ...engineers across multiple scrum teams, you will...  ...e.g., Finance, HR, Legal, Operations) to...  ...orchestration, RAG, evaluation frameworks, and AI...  ...find a far-reaching choice of benefits and incentives...  ...all minimum wage laws as applicable.... 
    Legal
    Minimum wage
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Eden Prairie, MN
    5 days ago
  • $126.07k - $196.98k

     ...performance computing and AI, climate friendly...  ...Manufacturing, Legal, Finance, R&D,...  ...initiatives across multiple business functions,...  ...security & governance reviews. When assigned to...  ...developing, deploying, and evaluating GenAI solutions,...  ...all applicable laws. Chemours is an... 
    Legal
    Work at office
    Local area
    Remote work

    Chemours

    Raleigh, NC
    3 days ago
  • $166.8k

     ...the world. The AI and Data Analytics...  ...training strategies) and evaluation (T&E, robustness)...  ...systems across multiple axes, including...  ...research (e.g., peer reviewed publications,...  ...state, and/or local laws. We are committed...  ...backup childcare, legal benefits,... 
    Legal
    For contractors
    Work experience placement
    Work at office
    Local area
    Remote work
    Relocation package
    Flexible hours

    Pacific Northwest National Laboratory

    Seattle, WA
    1 day ago
  • $85k - $130k

     ...invite you to review our current business...  ...prestigious law firms in the...  ...to our clients’ legal issues. We are...  ...Strategy Legal Specialist to join our Firm...  ...Supports the use of AI‑driven due...  ...Assists with the evaluation, selection and...  ...ability to handle multiple projects and... 
    Legal
    Contract work
    Work at office
    Local area
    Remote work
    Shift work

    Skadden Arps

    New York, NY
    2 days ago
  • $228k - $340k

     ...a Staff/Principal AI Engineer to help design...  ...the AI leader in legal discovery and...  ...documents or code reviews, or in less formal...  ...organization of your choice ~ Take advantage...  ...you!    We help law firms, government agencies...  .... As part of the evaluation process, we provide... 
    Legal
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Everlaw

    Oakland, CA
    1 day ago
  • $96k - $144k

    Legal Consultant - LL07FEWe’re determined to make a difference...  ...our Privacy and Data Law Group, to engage in...  ...attorneys specializing in AI Law relative to AI...  ...Governance WorkAI legislative review, including tracking...  ...navigating and prioritizing multiple assignments and projects... 
    Legal
    Full time
    Temporary work
    Remote work

    The Hartford Financial Services Group

    Hartford, CT
    6 days ago
  •  ...Description Modern Family Law (“MFL”) is seeking...  ...sophisticated AI Workflow Engineer /...  ...of AI-native legal workflows and operational...  ...standards. ~Evaluate emerging automation...  ...including testing, code reviews, version control,...  ...~Ability to manage multiple complex projects in... 
    Legal
    Full time
    Temporary work
    Work at office
    Shift work
    Afternoon shift

    Modern Family Law

    Remote
    6 days ago
  • $140 - $150 per hour

     ...In-House Counsel Reviewer — Spain Legal AI Evaluation (Remote) is a remote review track for evaluating AI outputs across in house counsel specialist operations workflows. Reviewers grade workflow correctness...  ...training, calibrating, or QA-ing operations teams.... 
    Legal
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    4 days ago
  • $120k - $145k

     ...construction projects.Review and interpret...  ...with client QA personnel,...  ...Control Process and evaluate survey shots...  ...Quality Control Specialists and contribute...  ...certificationAbility to manage multiple design teams...  ...and federal laws, to all...  ...contractor’s legal duty to furnish... 
    Legal
    Contract work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Doyon

    Bremerton, WA
    5 days ago
  • $163.2k - $220.8k

     ...Sonsini is the premier legal advisor to technology,...  ...is looking for a Senior AI Security Engineer to join...  ...of the world’s leading law firms builds and...  ...designing secure AI pipelines, evaluating MCP server integrations...  ...security architecture reviews for MCP (Model Context... 
    Legal
    Full time
    Work experience placement
    Remote work
    Worldwide
    Shift work

    Wilson Sonsini Goodrich & Rosati

    San Francisco, CA
    5 days ago
  •  ...A legal support services provider is seeking a Portuguese Document Reviewer to assist with document and privilege review. The role involves working collaboratively with attorneys to ensure thorough evaluations and successful case outcomes. Applicants must be fluent in... 
    Legal
    Remote work
    Flexible hours

    CGS Federal (Contact Government Services)

    Baltimore, MD
    4 days ago
  •  ...A legal services provider is seeking a skilled Portuguese Document Reviewer to assist with document evaluation and privilege assessments. This remote role requires candidates to be actively barred in a U.S. jurisdiction and familiar with document review technologies such... 
    Legal
    Remote work

    CGS Federal (Contact Government Services)

    Arlington, VA
    4 days ago
  • $120.1k - $214.5k

     ...opportunities.As a lead AI/ML Engineer at...  ...used for reviewing clinical data and...  ...and research, and evaluate their applicability...  ...designing and operating multiple production grade pipelinesProficient...  ...a far-reaching choice of benefits and...  ...all minimum wage laws as applicable.... 
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    San Francisco, CA
    2 days ago
  • $1,750 - $2,150 per month

     ...talent with leading AI research labs....  .... Position: IP Law Expert Type:...  ...requiring navigation of multiple apps, files, and stakeholders...  ...task scope, and review scenarios for...  ...refine task designs and evaluation criteria for IP-law...  ...Compensation & Legal Task Completion... 
    Legal
    Hourly pay
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Chicago, IL
    19 days ago
  • $60 per hour

     ...company in Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires...  ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected... 
    Part time
    Remote work
    Flexible hours

    Mind Rift

    Kansas City, MO
    5 days ago
  • $1,750 - $2,150 per month

     ...technical talent with leading AI research labs....  ...agents by navigating multiple apps, files, and stakeholders...  ...shape task scope, and review scenarios for realism...  ...refine task designs and evaluation criteria for litigation...  .... Compensation & Legal Task Completion Pay:... 
    Legal
    Hourly pay
    Full time
    Contract work
    Fixed term contract
    Summer work
    Remote work

    Mercor

    Chicago, IL
    23 days ago
  • $219k - $285k

     ...strategic leader to help drive our AI agenda and strategy. As the Sr...  ...a repeatable framework for evaluating AI opportunities based on...  ...DeploymentPartner with Cybersecurity, Legal, Compliance and Enterprise...  ...technology initiatives across multiple business domains.Experience... 
    Legal
    Full time
    Temporary work
    Remote work

    Travere Therapeutics

    San Diego, CA
    1 day ago
  • $145.5k - $249.5k

     ...together. Come build the AI foundation behind...  ...lead architecture reviews, and drive cross-...  ..., with defined evaluation and monitoringRAG...  ...on Azure, using multiple services such as Azure...  ...a far-reaching choice of benefits and incentives...  ...all minimum wage laws as applicable.... 
    Minimum wage
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Immediate start
    Remote work
    Visa sponsorship
    Work visa

    UnitedHealth Group

    Eden Prairie, MN
    2 days ago
  • $98.81k - $148.16k

     ...efficiently. As a Senior AI Engineer on...  ...knowledge.You'llarchitect evaluation frameworks to ensure AI...  ...practices through code reviews, pairing, and design collaboration...  ...be a U.S. citizen, lawful permanent resident of...  ...be conditioned on your legal authorization to work... 
    Legal
    Permanent employment
    Full time
    Remote work

    GrabJobs

    Denver, CO
    1 day ago
  • $225k - $250k

     ...allowed SharkNinja to enter multiple product categories,...  ...around the world. AI at SharkNinja At SharkNinja...  ...infrastructure: you can evaluate tools, assess platforms...  ...insurance, pre-paid legal insurance, back-up child...  ...legislation, and local law. SharkNinja will consider... 
    Legal
    Full time
    Temporary work
    Work at office
    Local area
    Immediate start
    Flexible hours
    Shift work

    SharkNinja

    Needham, MA
    4 days ago
  • $147.05k - $220.8k

     ...is looking for a Senior AI Security Engineer to...  ...of the world’s leading law firms builds and deploys...  ...-native workflows in a legal environment. You will own...  ...AI pipelines ~Evaluating MCP server integrations...  ...security architecture reviews for MCP integrations... 
    Legal
    Full time

    Wilson Sonsini

    Remote
    3 days ago
  • $65k - $85k

     ...Description Job Description Legal Research Attorney / J.D....  ...demands that come with traditional law practice?   Do you enjoy:...  ...preparation and case organization Review and summarize documents and...  ...detail Ability to manage multiple matters simultaneously... 
    Legal
    Full time
    Remote work
    Flexible hours

    Legalis Financial Services

    Tulsa, OK
    12 days ago
  • $92.14k - $134.8k

     ...financial institution of your choice by Direct Deposit/...  ...tax verification and review of prior performance/conduct...  ...the Form I-9. Federal law requires verification...  ...includes: managing multiple assignments that required...  ...Be EvaluatedYou will be evaluated for this job based on... 
    Permanent employment
    Full time
    Work experience placement
    Remote work
    Relocation
    Monday to Friday

    Department of the Treasury

    Washington DC
    4 days ago
  • $50 - $60 per hour

     ...DataAnnotation seeks an experienced Appellate Attorney to train AI models and evaluate their legal outputs. This role allows for flexible project choices and schedules, enabling work from home at an hourly rate of $50-60. Applicants must have a Juris Doctor (J.D.) and... 
    Legal
    Hourly pay
    For contractors
    Remote work
    Work from home
    Flexible hours

    DataAnnotation

    Florida, NY
    4 days ago
  • $100 per hour

    LEGAL SUBJECT-MATTER EXPERT (AI LEGAL WORKFLOWS) ABOUT PARETO.AI Pareto.AI is a human...  ...Participants will create and evaluate realistic legal workflows...  ...fact-based context. Document Review Analyzing agreements to...  ...compliance obligations Case Law Research Identifying, analyzing... 
    Legal
    Remote job
    Work at office
    Immediate start

    Pareto.AI

    Florida, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Finnish Law AI Evaluation Specialist - Multiple-Choice Legal QA Review [Remote]. Be the first to apply!