Physical Affordance Task Evaluator [Remote]
AuraOne Human Data
- Remote job
Physical Affordance Task Evaluator is a remote review track for evaluating AI outputs across physics reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
Physics models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current physics methods, conventions, and prior work for Physical Affordance Task Evaluator assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in physics or a closely related field for Physical Affordance Task Evaluator work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce a physics derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- Physics
- Robotics evaluation
- Embodied AI
- Safety review
- Physical
- Affordance
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- A leading AI research collaboration in Atlanta is seeking a specialist to develop advanced physics problems and rigorously evaluate AI-generated solutions. Applicants must have a PhD or be near completion in Applied Physics or a related field, showcasing mastery in core...SuggestedRemote jobFlexible hours
- Productive Playhouse seeks a Portugal Portuguese AI Product Evaluator for an upcoming project testing and evaluating leading AI chatbots... .... This is an independent contractor engagement with batches of tasks; you set your hours and may work with other clients. Transitions...SuggestedRemote jobFor contractorsFreelanceFlexible hours
- Simulation-to-Real Task Evaluator is a remote evaluation track for reviewing simulation to real task evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...SuggestedHourly payFor contractorsRemote work10 hours per week
- ...Surgical Robotics Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected...SuggestedRemote jobHourly payFor contractors10 hours per week
- ...You’ll Do Develop Complex Problems: Design advanced, open-ended physics problems (equivalent to PhD qualifying exams) that require... ...physical constant and unit conversion is perfect. Technical Auditing: Evaluate AI-generated simulations and proofs for physical consistency....SuggestedContract workFreelanceRemote workFlexible hours
- ...Job Description Job Description Position Overview We are seeking a qualified Physical Therapist to conduct CPSE evaluations for preschool-aged children. The ideal candidate will have experience working with young children and a strong understanding of motor development...Work from homeFlexible hours
$52k - $57k
...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects... ...and self-direction to complete assigned tasks and identify tools and approaches for analysis... ...and train others. Work Environment/Physical Demands: The individual must possess the...Full timeSummer workLocal area- ...we do. NATURE AND SCOPE: The Lead Evaluator, Early Learning will provide high quality... ...to time, include related or unrelated tasks. JOB REQUIREMENTS: Education & Experience... ..., marital status, national origin, age, physical or mental disability, citizenship,...Part timeWork experience placementWork at officeLocal areaRemote work
$48.3k - $67.7k
...Strong analytical skills, applied in evaluating individual needs and resources. Qualifications... ...: Licensure eligibility required Physical Requirements Standing - 20% Sitting... ...not a comprehensive list and additional tasks may be assigned to the employee from...Full timeRemote workFlexible hours$22 per hour
...About Job Overview As a Content Quality Evaluator, English, you will assess the quality of... ...required Ability to perform repetitive tasks without degradation in quality. Detail-oriented... ..., citizenship status, age, mental or physical disability, medical condition, sex (...Hourly payWork at office- ...Robot Policy Compliance Task Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety...Remote jobHourly payFor contractors10 hours per week
- ...in pay. Under direction of the Nurse Evaluator Supervisor (NE III) and general operational... ...are described below (percentages and tasks may vary depending upon program needs).... ...in the . Working Conditions The physical work location of the position is designated...Full timeWork at officeLocal area
- ...in a health-related field from an accredited college or university preferred. Current licensure in nursing, respiratory therapy, physical therapy, occupational therapy, or speech and language therapy is required. Prior marketing and/or rehabilitation/LTACH experience...Full timeLocal area
- ...ancestry, color, disability (mental and physical), exercising the right to family care and... ...: (***) ***-****-004 Working Title: Nurse Evaluator II - HYBRID Option Classification: NURSE... ...are described below (percentages and tasks may vary depending upon program needs)....Permanent employmentFull timeLocal areaRemote work
$20 per hour
...is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’... .... The position offers flexible hours and pays $20+ USD/hr for general projects and $40+ for design-focused tasks. #J-18808-LjbffrRemote workFlexible hours- ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This... ...background required beyond reliable internet access. You will work on task-based assignments at your own pace, covering a wide range of...Contract workRemote workFlexible hours
$131 - $153 per hour
...disabled children through our ABA, speech, occupational, and physical therapy. We currently offer our services in the entire metro New... .../ Maryland/ DC area. We specialize in conducting initial evaluations and providing ongoing services in home, community and clinic settings...Permanent employmentLocal areaWork from home- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobFull time
- ...Columbus, Ohio invites applicants for its Transfer and Articulation Evaluator. Position Summary The Transfer and Articulation Evaluator will... ...to detail Demonstrated ability to successfully prioritize tasks Preferred Skills and Characteristics Strong interpersonal skills...Full timeImmediate start
$37 per hour
Job Summary Join Acentra Health as a Clinical Evaluator (PASRR) in North Carolina. In this role, you will conduct PASRR Level II pre-Admission... ...from collateral sources, and evaluating the individual's physical, behavioral, and psychological functioning. Responsible for...Hourly payReliefWork at officeLocal areaRemote workWork from homeHome office- ...and language services company, is assembling a pool of British English speakers to test and evaluate leading AI chatbots. Independent, project-based work lets you choose tasks, set hours, and work with multiple clients. This role focuses on hands-on evaluation of Generative...Remote jobFlexible hours
- Productive Playhouse is seeking a Kinyarwanda AI Product Evaluator. This freelancer role involves direct interaction with AI chatbots to test quality, safety, and helpfulness, with iterative task batches and flexible hours. You’ll work remotely from anywhere, choose tasks...Remote jobFreelanceFlexible hours
$15 per hour
Productive Playhouse is building a pool of Spanish (Spain) speakers for evaluating leading AI chatbots. You will work as an independent contractor, choosing tasks, setting your own hours, and collaborating with clients globally. Pay is $15.00 USD per hour, with flexible...Remote jobHourly payFor contractorsFreelanceFlexible hours- ...people find information online? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and... ...concise written explanations to support your ratings Work through task-based assignments independently at your own pace Cover a broad...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
- ...independent contractor role offers flexible hours and work from home. Candidates should have strong English proficiency and be based in the United States. You will be assigned tasks with earnings varying by volume and quality. #J-18808-Ljbffr TELUS Digital AI Data SolutionsFor contractorsWork from homeFlexible hours
- RWS - TrainAI in Albuquerque, New Mexico is seeking a Search Quality Rater for English language tasks. This part‑time, remote position involves testing and evaluating how our clients’ search engine responds to everyday queries from real users. You will need strong online...Remote jobPart timeWork from homeHome office10 hours per week
- Productive Playhouse is building a pool of English-speaking evaluators for testing leading AI chatbots. Apply once and stay in mind for this... ...future projects needing language skills. This is a contractor, task-based engagement with pay per hour and flexible hours. As an AI...Remote jobHourly payFor contractorsFlexible hours
$150 per hour
The Home and Community-Based Program evaluates preschoolers for special education for the Committee on Special Education (CPSE).Education... ...include assessment of children in five learning domains (physical, communication, social-emotional, cognitive, and adaptive). Education...Part timeWork from homeShift work$20 - $26 per hour
Prolific is seeking fluent Kannada speakers to act as evaluators. You will compare text and AI-generated Kannada audio, rating naturalness... ...and providing precise feedback to improve language models. Tasks are paid at $20-$26 per hour, with many assignments taking about...Remote jobHourly payWork from homeFlexible hours- Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S....Remote jobFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physical Affordance Task Evaluator [Remote]. Be the first to apply!



