Image Reasoning Generalist [Remote]
$35 per hourAuraOne Human Data
Remote
- Remote job
Image Reasoning Generalist is a remote evaluation track for reviewing image reasoning generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn image reasoning generalist evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate image reasoning generalist evaluation model outputs against a versioned rubric and assign severity tags for Image Reasoning Generalist assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on image reasoning generalist evaluation or adjacent content for Image Reasoning Generalist work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two image reasoning generalist evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Image Reasoning Generalist evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$35 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Image Reasoning Generalist [Remote] in Remote vacancy
- ...people with the ongoing demands of the workplace by providing high-quality teams and subject matter experts. Position Title: Reasonable Accommodations Specialist Location: Washington, DC / Remote Employment Type: Full-Time Department: Civil Rights / Human...SuggestedRemote jobFull timeContract work
$100k - $167k
...to build beneficial AI systems. Program Overview Many of the questions that will shape our future have no single checkable answer. Reasoning well about them, whether in law, policy, philosophy, economics, cognitive science, or AI safety itself, takes the kind of judgment...SuggestedFull time- ...Combinatorics Reasoning Reviewer is a remote review track for evaluating AI outputs across combinatorics reasoning research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct...SuggestedRemote jobHourly payFor contractors10 hours per week
$46.99k - $112.2k
...Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. The Reasonable Accommodation Case Manager is responsible for managing and supporting the company’s compliance with the Americans with...SuggestedHourly payFull timeTemporary workLocal area- ...Insurance Claims Reasoning Evaluator is a remote review track for evaluating AI outputs across insurance workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so...SuggestedRemote jobHourly payFor contractorsWork experience placement10 hours per week
- Job Responsibilities: Obtain, review, and manage accommodation-related documentation, ensuring timely, confidential, and accurate recordkeeping throughout the accommodation process. Conducting case-related research and gathering relevant information, records, and...Remote jobWork experience placement
- ...Historical Reasoning Learning Content Reviewer is a remote review track for evaluating AI outputs across historical reasoning learning content specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- ...around a scientific figure. You'll use your domain expertise to create challenging questions that test how well advanced AI models reason about visual scientific information, and help show where they fall short. How it works - Work with scientific charts and diagrams...Contract workRemote work
Workada
Remote22 days ago $25 - $50 per hour
...sense judgment, and that's exactly what this role supplies. As a Generalist you'll review and rate AI responses across a wide range of everyday topics. No technical background needed; strong reasoning and writing are the whole job. What you’ll actually do Review...Weekly payFull timeContract workFor contractorsRemote workFlexible hoursDataAnnotation
Remote21 days ago- ...Skills: Compliance and laws Quebec, Ontario, BC Francisation Program (Quebec) Education/Experience: ~5–7+ years of HR generalist experience, preferably in a compliance-heavy role. ~ Bilingual in English and French (written and verbal). ~ Strong knowledge...Remote jobFor contractors
- ...technical writer, editor, translator, etc.) Understanding of Excel and Google Suite. Proficiency in Data interpretation, Logical reasoning and Basic arithmetic is preferred. Benefits Opportunity to work on cutting-edge AI projects. Competitive compensation....Contract workRemote workFlexible hours
- ...Flow Traders is looking for an experienced HR Generalist to join our HR & Recruitment team in Amsterdam. In this role, you will act as a trusted HR partner, providing operational and strategic HR support across our European offices while driving people initiatives, process...Full timeWorldwideRelocation
- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Human Resources Generalist based in Loveland, Colorado, United States. The Human Resources Generalist will play a key role in supporting employee experiences...Full timeRemote work
- ...and onboarding ~ Candidates must be comfortable working on 2D image annotation and editing tasks What You’ll Do Edit,... ...plug-ins/scripts of After Effects, 3ds Max, and Cinema 4D. Reasonable understanding of 3D modeling, topology, lighting, shading, and...Contract workPart timeImmediate startRemote work
$125 per hour
...Medical Imaging Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so...Remote jobFor contractors10 hours per week$50 per hour
...Bengali Generalist Evaluator Expert is a remote Bengali specialist track for evaluating bengali evaluation outputs against native-speaker... ...consistently across long evaluation batches. Clear written reasoning that names the issue and the standard being applied....Remote jobFor contractors10 hours per week$30 - $35 per hour
...collateral, social media graphics, and other branded materials. Layout & Formatting: Format, organize, and lay out existing copy, images, and creative assets into polished, presentation-ready materials. Marketing Asset Development: Support the creation and adaptation...Hourly payContract workFreelanceRemote workFlexible hours- Gridnaut Recruiting is hiring a remote Breast Imaging Radiologist contractor (pay $300/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Read de-identified screening and diagnostic mammography, tomosynthesis, breast ultrasound and breast MRI...Contract workFor contractorsRemote work
- ...Job Responsibilities: Develop, validate, and execute state-of-the-art imaging software simulation tools to enable novel camera HW explorations, machine learning dataset generation, and product architecture tasks for consumer products. Investigate latest imaging simulation...Remote job
- ...Job Responsibilities: Design, develop, and maintain high-performance imaging software frameworks and analytical tools for camera simulation, image processing, and data analysis. Implement and optimize algorithms for image processing and camera simulation using MATLAB...Remote job
- ...evaluation, fine-tuning, feedback, factuality and handling diverse data. Role Overview We are seeking creative and detail-oriented Image Annotation QA who can create high-quality stylized assets from briefs and references. The ideal candidate should have strong skills...Full timeContract workRemote work
- ...pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second,... ...results on the P&L. Role Overview: We are seeking US-based generalist raters to participate in Gemini Personalization Evals. In...Contract workFor contractorsRemote work
- ...accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from...Contract workFor contractors
- ...Robotics Data Generalist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers... ...evaluating them for Robotics Data Generalist work. Comfort reasoning about perception, motion planning, and physical safety...Remote jobHourly payFor contractors10 hours per week
$50 - $60 per hour
Gridnaut Recruiting is hiring a remote Generalist (Must own MacBook) contractor (pay $50-$60/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Required: All experts on this project must have a MacBook or Mac with an Apple M-series chip or Intel...Contract workFor contractorsRemote work$40 - $70 per hour
...frontier AI is graded against. This is a standing listing for generalists who want AI training and evaluation work, not a specific job... ...response has to account for ~ Grading model output on general reasoning: whether the answer is correct, whether it follows the...Odd jobPart time- ...processing millions of transactions seamlessly. What is the role: ~ We are seeking a highly skilled and experienced Senior HR Generalist to join our team. The ideal candidate will be responsible for a wide range of HR functions, including onboarding, employee...Remote jobFull timeWork at officeLocal areaHome office
$16 - $24 per hour
...Label objects in images for AI training, as paid work from home. It suits detail-minded people who are comfortable learning a new web-based tool. Prior annotation experience is a plus, not a requirement. What the work is for Labelled images train computer-vision...Contract workLocal areaWork from homeYPAI
Remotea month ago- ...leading innovation, With Heart®. About the Role We are seeking a highly organized, collaborative Regulatory Affairs Consultant - Generalist to provide end-to-end regulatory support for a strategic pharmaceutical partnership and its development and commercial programs....Remote jobWork at officeLocal areaWorldwide
- ...leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality,... ...companies. Role overview : The Text Situated Alignment Generalist, BA role supports a short-term human-AI interaction...Full timeContract workTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Image Reasoning Generalist [Remote]. Be the first to apply!
Related searches