Algorithmic Complexity Reasoning Reviewer [Remote]
AuraOne Human Data
- Remote job
Algorithmic Complexity Reasoning Reviewer is a remote evaluation track for reviewing algorithmic complexity reasoning evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn algorithmic complexity reasoning evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate algorithmic complexity reasoning evaluation model outputs against a versioned rubric and assign severity tags for Algorithmic Complexity Reasoning Reviewer assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on algorithmic complexity reasoning evaluation or adjacent content for Algorithmic Complexity Reasoning Reviewer work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two algorithmic complexity reasoning evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Algorithmic Complexity Reasoning evaluation
- Formal reasoning
- Proof review
- Quantitative analysis
- Algorithmic
- Complexity
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$83.2k - $156k
...Upon Award Position Summary TestPros is seeking a STEM and Complex Document Accessibility Specialist to support remediation of... ...of GIS maps, engineering drawings, and technical schematics. Review complex source documents and identify appropriate accessible alternatives...SuggestedContract workPart timeFor contractorsWork experience placementWork at officeRemote work$52k
...experienced marketing professionals to review sales and marketing presentation materials... ...learn the intricacies of language and reasoning—not just how to write, but how to think.... .... Identify opportunities to simplify complex concepts and improve audience understanding...SuggestedHourly payFull timePart timeFixed term contractRemote workFlexible hours$100k - $115k
...About the Opportunity The DRG Dispute Reviewer is responsible for evaluating provider... ...and critical thinking skills for complex case reviews Ability to write clear... ...the recruitment process. If you require a reasonable accommodation to complete any part of the...SuggestedFull timeWork experience placementWork at officeRemote workFlexible hours$58.74k - $83.64k
...financial performance, simplify administrative complexity and create better experiences for... .... As our Inpatient Coding Quality Reviewer, you will help the Coding Quality department... ...If you have a disability and require a reasonable accommodation to complete any part of...SuggestedHourly payFull timeLocal area$82.72k - $120.63k
...We're hiring an Associate, Itemized Bill Reviewer to join our Payment Integrity team.... ...internal and external stakeholders regarding complex billing issues, coding guidelines, and... ...to support our recruiting efforts. Reasonable Accommodation: Oscar applicants are considered...SuggestedFull timeContract workRemote workWork from homeHome office$1,000 per month
...Tax Reviewer Doola is seeking a detail-oriented and customer-focused Tax Reviewer to... ...improve filing quality. Assist with complex tax matters, tax notices, amendments, and... ...law. Doola is also committed to providing reasonable accommodations for talented individuals...Permanent employmentWork at officeLocal areaRemote workWorldwide- ...MAKE A DIFFERENCE: This Residential Reviewer fills a remote role (work from home) in... ...3 & 4 Ensure that valuations are reasonably supported, credible and compliant with... ...prioritize work assignments of varying complexities, track progress of said assignments, demonstrate...Work at officeRemote workWork from homeFlexible hours
$70k - $80k
...Magnolia Tax Services is hiring a Senior Tax Reviewer to review business and individual... ...before they go to the client Prepare complex returns yourself when needed, especially... ...clients: shareholder and partner basis, reasonable compensation, K-1 flow-through, depreciation...Full timeLive inRemote work$152.5k - $226.6k
...extend their global reach while reducing the complexity and friction involved in enabling cross-... ...fees for courses, applications, resume reviews, interviews, background checks, or... ...local law. In addition, PayPal will provide reasonable accommodations for qualified individuals...Full timeWork at officeLocal areaImmediate startFlexible hours- ...Safety Standards Job Description Data Reviewer- Remote, Cell Lab At PPD, part of Thermo... ...of people in a comprehensible and reasonable manner. Able to work upright and stationary... ...together to accelerate research, solve complex scientific challenges, drive technological...Work at officeRemote work
$55 per hour
...Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50-$55/hour Location:... ...in wholesale and technical sales to strengthen reasoning and rigor in model outputs . Review complex sales tasks for alignment with domain principles and...Remote jobContract workSummer work- Data Reviewer Work Schedule Standard (Mon-Fri) Environmental Conditions Adherence to all... ...performs review of a variety of routine and complex analytical analysis experiments that are... ...of people in a comprehensible and reasonable manner. Able to work upright and stationary...Work at officeRemote work
$89.57k - $118.45k
...What You Will Bring to ChargePoint Analyze and manage complex product structures, assemblies, and PCBAs. Partner with mechanical... ..., we ensure that persons with disabilities are provided with reasonable accommodations throughout the employment process. If you...Full timeRemote work- Data Reviewer- Remote, Cell Lab At PPD, part of Thermo Fisher Scientific, you'll discover... ...groups of people in a comprehensible and reasonable manner. Able to work upright and... ...together to accelerate research, solve complex scientific challenges, drive technological...Work at officeRemote work
$30 per hour
...Freelance Physics QA Reviewer - AI Trainer 2 weeks ago - Be among the first 25 applicants Get AI-powered advice on this job... ...them capable of addressing specialized questions and achieving complex reasoning skills. Although every project is unique, you might...Part timeFreelanceRemote work- ...Causal Reasoning Failure Analysis Reviewer is a remote review track for evaluating AI outputs across causal reasoning failure analysis research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and...Remote jobHourly payFor contractors10 hours per week
$61.18k - $99.66k
...Continuity of Services Specialist - State Reviewer Job Title: Program Specialist VI... ...services across the SSLCs. Work involves complex remote and on-site assessment of center... ...ADA), HHSC and DSHS agencies will provide reasonable accommodation during the hiring and...Full timeTemporary workPart timeWork at officeLocal areaImmediate startRemote workShift work$70k
Case Reviewer II/Clinical Reviewer (60740) Fully Remote • Remote - Remote Employees, VA 1... ...proposals. In this role, you will analyze complex medical records, project future medical... ...Policy + Paid Holidays Qualifications Reasonable Accommodation Capitol Bridge complies with...Full timeRemote workMonday to FridayShift work$32.9k - $50.3k
...people, technology and best practices improve and automate highly complex business processes middle and back offices- while facilitating... ...-specific affordability and organizational requirements. A reasonable estimate of the current compensation range for this position...Minimum wageFull timeContract workFlexible hours- ...Promptly informs Supervisor of any unusual complex or problem situations confronting the... ...any backlog. Directly responsible for reviewing medical records for other indirect... ...obtain an exemption for medical or religious reasons. Wearing a face mask is required when an...Permanent employmentFull timePart timeFor contractorsTraineeshipSeasonal workWork at officeRemote workWork from homeTrial periodRelocation packageMonday to Friday
$60.85k
...selected. Metra is one of the largest and most complex commuter rail systems in North America,... ...related to InEight and SharePoint. Review incoming document transmittals and the document... ...synthetic substances such as THC for any reason for preemployment screening purposes,...For contractors$180k
...About the RoleAs a member of Uber’s Security Review Team, you will proactively identify and... ...quality and scale.What You'll DoLead complex security and privacy design reviews across... ...that autonomously gather technical context, reason across multiple sources, invoke security...Full timeWork at officeRemote work$32.9k - $50.3k
...people, technology and best practices improve and automate highly complex business processes middle and back offices- while facilitating... ...-specific affordability and organizational requirements. A reasonable estimate of the current compensation range for this position...Minimum wageFull timeContract workFlexible hours$75 per hour
...Aerospace Engineer, AI Technical Reasoning Reviewer is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model...Remote jobFor contractors10 hours per week- ...Documents Specialist (Portuguese) is a remote review track for evaluating AI outputs across... ...Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance... ...a model's narrative reasoning on a complex transaction and rate the citation quality...Hourly payFor contractorsWork experience placementRemote work10 hours per week
$17.94 per hour
...oriented Patent Application Specialist (Reviewer) to support patent application processing... ...to the business rules. Identify complex work units that have not been extracted... ...training, meetings, and other work related reasons. Other duties as assigned/required....Hourly payContract workWork at officeRemote work- ...Otolaryngology Physician Disability Peer Reviewer based in the United States. This... ...analytical skills and the ability to interpret complex medical records. Excellent written... ...Ability to provide objective, well-reasoned clinical assessments. Willingness...Contract workFor contractorsRemote workFlexible hours
$25 per hour
...About the gig Join our distributed team as a Remote AI Task Reviewer and help improve AI systems by completing short, style online tasks... ...Strong written communication Able to follow complex instructions Motivated to work independently and manage your...Remote jobSecond jobImmediate startWork from homeFlexible hours- ...people-focused, operations-driven organization that prioritizes reasonable caseloads, strong training, collaborative teams, and expert... ...clients and/or providers to clarify information. Forwards to Bill Review supervisor any unidentifiable unlisted procedure numbers. Ability...16 hoursRemote workShift work
$75k - $90k
...accommodation or an alternative application process. Clinical Reviewer - LCSW, LPC, LCPC - Salem, Oregon OR Care Management F-T... ...required for meetings, training, or other work-related events. Reasonable accommodations will be provided to enable individuals with...Full timeContract workRemote workWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Algorithmic Complexity Reasoning Reviewer [Remote]. Be the first to apply!



