Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Algorithmic Complexity Reasoning Reviewer [Remote]

AuraOne Human Data

Remote
  • Remote job

Algorithmic Complexity Reasoning Reviewer is a remote evaluation track for reviewing algorithmic complexity reasoning evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn algorithmic complexity reasoning evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate algorithmic complexity reasoning evaluation model outputs against a versioned rubric and assign severity tags for Algorithmic Complexity Reasoning Reviewer assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on algorithmic complexity reasoning evaluation or adjacent content for Algorithmic Complexity Reasoning Reviewer work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two algorithmic complexity reasoning evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Algorithmic Complexity Reasoning evaluation
  • Formal reasoning
  • Proof review
  • Quantitative analysis
  • Algorithmic
  • Complexity

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Algorithmic Complexity Reasoning Reviewer [Remote] in Remote vacancy
  • $83.2k - $156k

     ...Upon Award Position Summary TestPros is seeking a STEM and Complex Document Accessibility Specialist to support remediation of...  ...of GIS maps, engineering drawings, and technical schematics. Review complex source documents and identify appropriate accessible alternatives... 
    Suggested
    Contract work
    Part time
    For contractors
    Work experience placement
    Work at office
    Remote work

    TestPros

    Remote
    19 days ago
  • $52k

     ...experienced marketing professionals to review sales and marketing presentation materials...  ...learn the intricacies of language and reasoning—not just how to write, but how to think....  .... Identify opportunities to simplify complex concepts and improve audience understanding... 
    Suggested
    Hourly pay
    Full time
    Part time
    Fixed term contract
    Remote work
    Flexible hours

    Innodata Inc.

    Remote
    4 days ago
  • $100k - $115k

     ...About the Opportunity The DRG Dispute Reviewer is responsible for evaluating provider...  ...and critical thinking skills for complex case reviews Ability to write clear...  ...the recruitment process. If you require a reasonable accommodation to complete any part of the... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Machinify

    Remote
    16 days ago
  • $58.74k - $83.64k

     ...financial performance, simplify administrative complexity and create better experiences for...  .... As our Inpatient Coding Quality Reviewer, you will help the Coding Quality department...  ...If you have a disability and require a reasonable accommodation to complete any part of... 
    Suggested
    Hourly pay
    Full time
    Local area

    R1 RCM

    Remote
    6 days ago
  • $82.72k - $120.63k

     ...We're hiring an Associate, Itemized Bill Reviewer to join our Payment Integrity team....  ...internal and external stakeholders regarding complex billing issues, coding guidelines, and...  ...to support our recruiting efforts. Reasonable Accommodation: Oscar applicants are considered... 
    Suggested
    Full time
    Contract work
    Remote work
    Work from home
    Home office

    Oscar Health

    Remote
    16 days ago
  • $1,000 per month

     ...Tax Reviewer Doola is seeking a detail-oriented and customer-focused Tax Reviewer to...  ...improve filing quality. Assist with complex tax matters, tax notices, amendments, and...  ...law. Doola is also committed to providing reasonable accommodations for talented individuals... 
    Permanent employment
    Work at office
    Local area
    Remote work
    Worldwide

    Doola

    United States
    2 days ago
  •  ...MAKE A DIFFERENCE: This Residential Reviewer fills a remote role (work from home) in...  ...3 & 4 Ensure that valuations are reasonably supported, credible and compliant with...  ...prioritize work assignments of varying complexities, track progress of said assignments, demonstrate... 
    Work at office
    Remote work
    Work from home
    Flexible hours

    MountainSeed

    United States
    1 day ago
  • $70k - $80k

     ...Magnolia Tax Services is hiring a Senior Tax Reviewer to review business and individual...  ...before they go to the client Prepare complex returns yourself when needed, especially...  ...clients: shareholder and partner basis, reasonable compensation, K-1 flow-through, depreciation... 
    Full time
    Live in
    Remote work

    Magnolia Tax Services

    United States
    6 days ago
  • $152.5k - $226.6k

     ...extend their global reach while reducing the complexity and friction involved in enabling cross-...  ...fees for courses, applications, resume reviews, interviews, background checks, or...  ...local law. In addition, PayPal will provide reasonable accommodations for qualified individuals... 
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    Scottsdale, AZ
    4 days ago
  •  ...Safety Standards Job Description Data Reviewer- Remote, Cell Lab At PPD, part of Thermo...  ...of people in a comprehensible and reasonable manner. Able to work upright and stationary...  ...together to accelerate research, solve complex scientific challenges, drive technological... 
    Work at office
    Remote work

    Thermo Fisher Scientific

    New York, NY
    3 days ago
  • $55 per hour

     ...Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50-$55/hour Location:...  ...in wholesale and technical sales to strengthen reasoning and rigor in model outputs . Review complex sales tasks for alignment with domain principles and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    5 days ago
  • Data Reviewer Work Schedule Standard (Mon-Fri) Environmental Conditions Adherence to all...  ...performs review of a variety of routine and complex analytical analysis experiments that are...  ...of people in a comprehensible and reasonable manner. Able to work upright and stationary... 
    Work at office
    Remote work

    Thermo Fisher

    New York, NY
    15 hours ago
  • $89.57k - $118.45k

     ...What You Will Bring to ChargePoint Analyze and manage complex product structures, assemblies, and PCBAs. Partner with mechanical...  ..., we ensure that persons with disabilities are provided with reasonable accommodations throughout the employment process. If you... 
    Full time
    Remote work

    ChargePoint

    Remote
    18 days ago
  • Data Reviewer- Remote, Cell Lab At PPD, part of Thermo Fisher Scientific, you'll discover...  ...groups of people in a comprehensible and reasonable manner. Able to work upright and...  ...together to accelerate research, solve complex scientific challenges, drive technological... 
    Work at office
    Remote work

    Thermo Fisher

    New York, NY
    2 days ago
  • $30 per hour

     ...Freelance Physics QA Reviewer - AI Trainer 2 weeks ago - Be among the first 25 applicants Get AI-powered advice on this job...  ...them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might... 
    Part time
    Freelance
    Remote work

    Mind Rift

    New York State
    2 days ago
  •  ...Causal Reasoning Failure Analysis Reviewer is a remote review track for evaluating AI outputs across causal reasoning failure analysis research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  • $61.18k - $99.66k

     ...Continuity of Services Specialist - State Reviewer Job Title: Program Specialist VI...  ...services across the SSLCs. Work involves complex remote and on-site assessment of center...  ...ADA), HHSC and DSHS agencies will provide reasonable accommodation during the hiring and... 
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Immediate start
    Remote work
    Shift work

    Texas Health & Human Services Commission

    Remote
    6 days ago
  • $70k

    Case Reviewer II/Clinical Reviewer (60740) Fully Remote • Remote - Remote Employees, VA 1...  ...proposals. In this role, you will analyze complex medical records, project future medical...  ...Policy + Paid Holidays Qualifications Reasonable Accommodation Capitol Bridge complies with... 
    Full time
    Remote work
    Monday to Friday
    Shift work

    CAPITOL BRIDGE, LLC

    New York, NY
    4 days ago
  • $32.9k - $50.3k

     ...people, technology and best practices improve and automate highly complex business processes middle and back offices- while facilitating...  ...-specific affordability and organizational requirements. A reasonable estimate of the current compensation range for this position... 
    Minimum wage
    Full time
    Contract work
    Flexible hours

    DXC Technology

    Ashburn, VA
    3 days ago
  •  ...Promptly informs Supervisor of any unusual complex or problem situations confronting the...  ...any backlog. Directly responsible for reviewing medical records for other indirect...  ...obtain an exemption for medical or religious reasons. Wearing a face mask is required when an... 
    Permanent employment
    Full time
    Part time
    For contractors
    Traineeship
    Seasonal work
    Work at office
    Remote work
    Work from home
    Trial period
    Relocation package
    Monday to Friday

    VETERANS HEALTH ADMINISTRATION

    Indianapolis, IN
    2 days ago
  • $60.85k

     ...selected. Metra is one of the largest and most complex commuter rail systems in North America,...  ...related to InEight and SharePoint. Review incoming document transmittals and the document...  ...synthetic substances such as THC for any reason for preemployment screening purposes,... 
    For contractors

    Metra

    Chicago, IL
    3 days ago
  • $180k

     ...About the RoleAs a member of Uber’s Security Review Team, you will proactively identify and...  ...quality and scale.What You'll DoLead complex security and privacy design reviews across...  ...that autonomously gather technical context, reason across multiple sources, invoke security... 
    Full time
    Work at office
    Remote work

    Uber

    Sunnyvale, CA
    1 day ago
  • $32.9k - $50.3k

     ...people, technology and best practices improve and automate highly complex business processes middle and back offices- while facilitating...  ...-specific affordability and organizational requirements. A reasonable estimate of the current compensation range for this position... 
    Minimum wage
    Full time
    Contract work
    Flexible hours

    DXC Technology

    Ashburn, VA
    3 days ago
  • $75 per hour

     ...Aerospace Engineer, AI Technical Reasoning Reviewer is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    1 day ago
  •  ...Documents Specialist (Portuguese) is a remote review track for evaluating AI outputs across...  ...Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance...  ...a model's narrative reasoning on a complex transaction and rate the citation quality... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    Auraone

    New York, NY
    3 days ago
  • $17.94 per hour

     ...oriented Patent Application Specialist (Reviewer) to support patent application processing...  ...to the business rules. Identify complex work units that have not been extracted...  ...training, meetings, and other work related reasons. Other duties as assigned/required.... 
    Hourly pay
    Contract work
    Work at office
    Remote work

    DTSV, Inc.

    Newport News, VA
    5 days ago
  •  ...Otolaryngology Physician Disability Peer Reviewer based in the United States. This...  ...analytical skills and the ability to interpret complex medical records. Excellent written...  ...Ability to provide objective, well-reasoned clinical assessments. Willingness... 
    Contract work
    For contractors
    Remote work
    Flexible hours

    Jobgether

    Remote
    2 days ago
  • $25 per hour

     ...About the gig Join our distributed team as a Remote AI Task Reviewer and help improve AI systems by completing short, style online tasks...  ...Strong written communication Able to follow complex instructions Motivated to work independently and manage your... 
    Remote job
    Second job
    Immediate start
    Work from home
    Flexible hours

    RLDG

    Honey Brook, PA
    16 days ago
  •  ...people-focused, operations-driven organization that prioritizes reasonable caseloads, strong training, collaborative teams, and expert...  ...clients and/or providers to clarify information. Forwards to Bill Review supervisor any unidentifiable unlisted procedure numbers. Ability... 
    16 hours
    Remote work
    Shift work

    AvonRisk LLC

    Austin, TX
    3 days ago
  • $75k - $90k

     ...accommodation or an alternative application process. Clinical Reviewer - LCSW, LPC, LCPC - Salem, Oregon OR Care Management F-T...  ...required for meetings, training, or other work-related events. Reasonable accommodations will be provided to enable individuals with... 
    Full time
    Contract work
    Remote work
    Work from home

    Comagine Health

    Salem, OR
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Algorithmic Complexity Reasoning Reviewer [Remote]. Be the first to apply!