UX Research Production Reviewer [Remote]
AuraOne Human Data
Remote
- Remote job
UX Research Production Reviewer is a remote review track for evaluating AI outputs across ux research production specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
UX Research Production specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current ux research production specialist operations workflows, playbooks, and firm policy for UX Research Production Reviewer assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in ux research production specialist operations on real teams for UX Research Production Reviewer work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real ux research production specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- UX Research Production specialist operations
- Creative review
- Production quality
- Design critique
- Research
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the UX Research Production Reviewer [Remote] in Remote vacancy
- ...UI Design Production Reviewer is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train...UxRemote jobHourly payFor contractors10 hours per week
$169k - $250k
...code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows... ...and collaboration, join us!The Figma Research team is hiring a top-tier researcher to support... ...if you have:7+ years of experience in UX research or user insights at a high...UxMinimum wageFull timeTemporary workLocal areaRemote workFlexible hours- ...Description Senior Manager, UX Strategy Job Summary: Sparks... ...actively involved in design reviews, user experience improvements... ..., content, and digital production to create seamless, data-driven... ...continuous improvement through user research, experimentation, testing,...UxWork at officeRemote work
Sparks Group
West Mclean, VA7 days ago $20 per hour
A leading AI training company is seeking a UX Web Designer to assess and improve AI systems' design understanding. This remote role involves evaluating UI/UX projects, providing critique, and enhancing user-centered design. Candidates should be fluent in English with a...UxRemote workFlexible hoursDataAnnotation
Juneau, AK10 hours ago- ...by monitoring and responding to reviews Digital Marketing Campaign Creation... ...regulations Brand Management Research and understand the competitive landscape for products and services to develop value differentiation... ...campaigns, through A/B testing, UX optimization, and other...UxWork experience placementWork at officeRemote workAfternoon shift
Ram Enterprise
Elko, NV10 hours ago - ...mission is to increase yield in protein production to help feed the growing world population... ...We are seeking a highly skilled Product Researcher to gather, synthesize, and present deep... ...Design and PMs to test prototypes, assess UX, and validate product-market fit before...UxCasual workRemote workFlexible hoursShift work
- ...Linguistics, English, Communications, or a technical field preferred. Review & Audit Experience: 5+ years of experience in document review,... ...Management Systems (TMS), GitHub, or web-based CMS platforms. UX/UI Intuition: A passion for how Japanese users interact with...UxRemote workShift work
TaskUs
United States2 days ago - Role Description Operations Research Technical Reviewer (Operations Research Analyst, Mathematician, or Statistician) Location: Wright Patterson... ...Windows, Microsoft Office, Microsoft SQL, and Adobe products. ~Perform data creation and administration supporting model...Full timeWork at officeLocal areaRemote workMonday to Friday
Advent Services
Remote9 hours ago - ...remediation. Key Responsibilities • Review, audit, test, and remediate Word and PDF... ...• Collaborate with legal, content, and UX teams to ensure consistency and compliance... ...and manual accessibility testing • Research evolving accessibility regulations and assist...UxContract workRemote work
InterSources
United States4 days ago $153k - $214k
...How we’re using AI today: ~Our Engineering, Product, and Design teams are thoughtfully integrating... ...Engineers use AI-assisted coding tools to accelerate reviews and catch bugs earlier. ~Product managers synthesize user research at scale. ~Designers rapidly prototype and...UxFull timeImmediate startRemote work1Password
Remote7 days ago- Role Description We are seeking a Research Scientist for Smule's Applied Research team who thrives at the intersection of cutting-edge ML research and real-world product impact. You will take ideas from the research frontier, or originate your own, and develop them into...UxInternship
Smule
Remote29 days ago - ...Document Production Specialist Document production Produce all work to the highest standards of accuracy within strict deadlines, including: Creating, formatting and updating a wide range of complex documents, reports, spreadsheets and presentations, adhering...Local areaFlexible hours
Fresh Fields
Raleigh, NC2 days ago - ...innovative molten salt energy storage system designed to be complementary to solar and wind power by evening out the peaks and valleys in production when the sun is not shining, or the wind is not blowing. With the reactor and energy storage output combined, the plant can...Part timeWork at officeLocal areaRemote workRelocationVisa sponsorshipAfternoon shift
Bechtel Global Corporation
Knoxville, TN2 days ago $25 - $33.35 per hour
...applicable programs, procedures, and work aids, in support of the design, construction, and operation of SHINE's medical isotope production facility (the Chrysalis). The Document Control/Record Management Specialist position provides document and data support for the on...Hourly payWork at officeRemote workShine Technologies Corp
Janesville, WI2 days ago$79k - $82k
...Chapman and Cutler LLP is seeking to hire a Document Production Specialist to join our Chicago office. The Document Production Specialist... ...,000. The benefits overview for this position is available for review at the below link. Benefits Overview Benefits Overview To apply...Work at officeRemote workShift workChapman & Cutler
Chicago, IL2 days ago- Job Description: The proposed UX Researcher must have successfully completed at least two (2) full lifecycle, end-to-end projects deriving roadmap priorities from user research data to inform product strategy and design decisions. The candidate must have completed at...UxRemote workWork from homeFlexible hours
$119.8k - $234.7k
...ContributorTravel: Less than 25%Profession: Research, Applied, & Data SciencesDiscipline:... ...experimentation, and marketplace economics, shipping production-grade models and data pipelines that... ...(e.g., patents, libraries, peer-reviewed academic papers).Experience presenting...UxOngoing contractWork at officeLocal areaShift work$25 - $33.35 per hour
...programs, procedures, and work aids, in support of the design, construction, and operation of SHINE's Chrysalis medical isotope production facility. The position provides document and data support for the on-site Engineering, Construction, Procurement, and Operations...Hourly payWork at officeRemote work- TypeContractExperience-1Job Description:Client is looking for User Researcher who will be tasked with providing meaningful insights about... ...) that result in data that supports direct insights about product performance.Create reports, and provide report presentations to...UxRemote work
$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...with clear ground-truth outputs and objective rubrics. Review and improve AI model outputs to ensure alignment with domain...Contract workSummer workRemote workMercor
San Francisco, CA7 days ago- ...UX Researcher Location: Lansing, MI Position: Hybrid Duration: Long Term With our direct client Top Skills & Years of Experience: Five or more years of UX researcher experience Strong understanding of UI Design Responsibilities: Lead...UxRemote work
Software Technology Inc
Lansing, MI2 days ago - ...To support the research team in enhancing operational efficiency, the full-time Research Operations Specialist will coordinate studies,... ...insights Required qualifications At least 2 years of experience in UX research, customer research, or research operations Strong...UxFull timeRemote work
Virtual Vocations Inc
United States1 day ago $120k - $180k
...A high-growth remote-first startup is seeking a Lead Product Designer who will own the product design process from end-to-end. The... ...will have over 5 years of experience and a strong background in UX research. Responsibilities include creating wireframes and visual designs...UxRemote workBreakout Tools
Doral, FL3 days ago$66 per hour
...A leading technology services provider is seeking a Part-time Senior Design Researcher to join their team remotely. This role requires strong experience in UX research, usability testing, and collaboration with interdisciplinary teams. The ideal candidate will have over...UxHourly payPart timeRemote workNTT DATA North America
Kansas City, MO1 day ago$25 - $40 per hour
...from home and involves projects with pay rates starting at $25-$40+ USD/hr depending on project type. Qualifications include fluency in English and a background in UI/UX or graphic design. Only applicants located in the United States will be considered. #J-18808-Ljbffr...UxRemote workDataAnnotation
California, MO10 hours ago$20 per hour
...Designer to evaluate and enhance AI models' design capabilities. The role involves critiquing and improving user-centered designs, from UI/UX to graphics. Candidates should have a strong design background and fluency in English. This independent contract position offers...UxHourly payContract workRemote workFlexible hoursDataAnnotation
Wyoming, OH10 hours ago$20 per hour
A technology firm specializing in AI is seeking a Print Designer to enhance AI models by reviewing and critiquing UI/UX designs. In this role, you will use your design expertise to help shape the next generation of AI tools. This is a remote, independent contract position...UxContract workRemote workDataAnnotation
Sioux Falls, SD10 hours ago- ...bodies and daily lives.WHOOP is hiring a Research Manager to lead the Distributed Research... ...data that accelerates scientific discovery, product innovation, and member impact.... ...research operations, digital health research, UX research, or a related field.2+ years directly...UxRemote work
- .... Job Description• Assumes overall responsibility for research methodologies that are leveraged and incorporated throughout... ...upon research findings.• Work collaboratively with UX team members, Development teams, Product Owners, Users, and other stakeholders as part of an...UxWork experience placementRemote work
$20 per hour
...ll critique AI-generated designs, evaluate quality, and train models on design principles. Fluency in English and a background in UI/UX or graphic design are key. This position is remote and flexible, with competitive pay starting at $20+ per hour for general AI projects...UxHourly payRemote workFlexible hoursDataAnnotation
Columbia, SC10 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UX Research Production Reviewer [Remote]. Be the first to apply!
