Remote Brand Design Quality Evaluator — Rubric Auditor
AuraOne
- Remote job
AuraOne is seeking a Brand Design Quality Evaluator to remotely assess design quality prompts and model outputs. You will compare paired responses, apply a versioned rubric, and provide structured feedback for retraining the modeling team. Responsibilities include labeling inaccuracies, maintaining calibration scores weekly, and documenting failure modes for rubric improvements. This is a contractor, remote US-eligible role. #J-18808-Ljbffr AuraOne
- ...Brand Design Quality Evaluator is a remote evaluation track for reviewing brand design quality evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...Remote jobQualityBrandHourly payFor contractors10 hours per week
$30 per hour
...are building the biggest pool of quality human data in the world.... ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving... ...Motion Graphics. A background in Brand Building, Advertising, or...Remote workQualityBrandWork from homeFlexible hours- AuraOne is seeking a Capability Generalization Model Evaluation Specialist for a remote contractor role. You will evaluate model outputs against AuraOne's quality rubric, compare paired responses, and label edge cases with structured tags to guide retraining. Responsibilities...Remote workQualityFor contractors
- AuraOne is seeking a Remote Receipt and Invoice Understanding Model Evaluator to review outputs against rubrics and provide structured feedback. You will compare paired responses, label edge cases, and contribute to retraining with rationale. Ideal candidates have prior...Remote jobQualityFor contractors10 hours per week
- AuraOne is seeking a Remote Social Engineering Security Evaluator to review prompts and responses against our quality rubric, producing auditable labels, rationales, and regression cases. This role operates as an independent contractor to support the security evaluation...Remote jobQualityFor contractors
- AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning...Remote jobQualityFor contractors10 hours per week
- AuraOne seeks a remote Helpfulness Ranking Reward Model Evaluator to review evaluation prompts and responses under a versioned rubric. You will compare paired outputs, assign severity, and provide... ...prompts, and maintaining reviewer-quality scores through weekly calibration...Remote jobQualityHourly payFor contractors
- AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role...Remote jobQualityFor contractors10 hours per week
- AuraOne is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to help ensure high-quality AI outputs. You will review model responses, apply a versioned rubric, and provide structured feedback to retrain the system. As a contractor based in the US, you will...Remote jobQualityFor contractors
- AuraOne is seeking an Educational Safety AI Evaluator for a remote, contractor-based role. You will review educational safety AI outputs, apply the quality rubric, and produce auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include...Remote jobQualityFor contractors
- AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor...Remote jobQualityHourly payFor contractors10 hours per week
$14.5 per hour
...datasets that are high-quality, ethically sourced, relevant... .... As a Welocalize brand, Welo Data leverages over... ...relevance and quality. Evaluate and rate the... ...beneficial. Seeks a flexible, remote job that can easily fit... ...and pass a quality test designed by our client before starting...Remote workQualityBrandHourly payPart timeImmediate startWork from home10 hours per weekFlexible hours$20 per hour
A leading design technology firm is seeking an Experience Designer to enhance AI systems... ...critique AI outputs and help refine design quality. Applicants should have a background in UI/UX and be fluent in English. This is a remote position with project flexibility and...Remote workQuality$20 per hour
...cutting-edge AI company is seeking a Digital Designer to evaluate and enhance AI understanding of design... .... This position offers flexible remote work options and engaging projects that... ...AI-generated designs and assess their quality, helping shape the future of AI tools for...Remote workQualityFlexible hours$40 per hour
...A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves... .../UX visuals, assessing aesthetic quality, and contributing to various... ...flexibility, the opportunity to work remotely, and competitive pay for...Remote workQuality$80 - $120 per hour
Mercor is looking for a Brand / creative direction / marketing collateral Evaluator to assess AI-generated work for quality. The ideal candidate will have over 5 years of experience... .... This contract position allows for remote work, offering compensation between $80-...Remote jobQualityBrandContract workWork at office- OpenTrain AI is seeking a remote, US-based contractor to evaluate and improve AI models that produce professional enterprise... ...useful evaluation data. The work centers on brand voice, strategic communication, executive-level quality, and the failure modes that can make AI-...Remote jobQualityBrandPart timeFor contractorsWork at office
- ...trust. Working with over 30,000 global brands, retailers, manufacturers and food... ...secure every step of their supply chain with quality inspections, supplier audits, certifications... .... Every day at work, our inspectors, auditors, and lab techs use their expertise to help...Remote workQualityBrandFor contractorsWork experience placementWorldwide
- ...industry, is seeking a SOX Auditor to join their team. As... ...Location: Fully Remote Pay Range: $45/HR W... ...audits. Review and evaluate the design and operating effectiveness... ...Our expert family of brands - Manpower, Experis,... ...a professional, high quality work environment. It...Remote workQualityBrandWeekly payTemporary workFlexible hours
- ...reporting, and produce quality deliverables to both department... ...prevention), external auditors, and regulators,... ...for improvement in the design and effectiveness of key... ...with proven ability to evaluate and determine the... ...J.P. Morgan and Chase brands. Our history spans over...QualityBrandVisa sponsorshipFlexible hours
$89.6k - $149.3k
...HYBRID 4 DAYS/WEEK (1 DAY REMOTE) OUT OF: BUFFALO NY,... ...and oversee Auditors (as applicable) on assigned... ...reporting and produce quality deliverables in accordance... ...reflects the M&T Bank brand.Maintain M&T internal... ...control conceptsExperience evaluating adequacy of the...Remote workQualityBrandFull timeWork experience placement- ...Independent Contractor Collision Center Auditor Do you love working with high end, luxury automotive brands? Do you have a passion for... ...their goals of 'highest quality' and elite Certification status... ...We are currently looking for remote INDEPENDENT CONTRACTORS within...Remote workQualityBrandFull timeFor contractorsWork at officeWork from homeWorldwide
$107.5k - $179.1k
...DAYS/WEEK ONSITE (1 DAY REMOTE) BASED OUT OF: BUFFALO... ...to deliver high‑quality audit results in line... ...standards.Lead a team of auditors in the identification,... ...staffing, performance evaluations, promotions, compensation... ...reflects the M&T Bank brand and values.Perform...Remote workQualityBrandFull timeRelocation$32 - $37 per hour
...Risk Adjustment Coding Auditor to support the accuracy... ...prospective chart reviews to evaluate risk adjustment... ...maintaining compliance and high-quality audit standards.Job... ...TypeThis is a fully remote position.Application DeadlineThis... ...expertise in strategy, design, execution and...Remote workQualityContract workTemporary workWork at office$68k - $85k
...in Pittsburgh, PA* Monro's family of brands is one of the leading automotive service... ...mission to bring our guests the highest quality tire and auto service in the industry.... ...Operations Support, this individual will evaluate, inspect, audit, and determine the effectiveness...Remote workQualityBrandWork at officeFlexible hours$14.5 per hour
...provide datasets that are high-quality, ethically sourced, relevant,... ...AI models. As a Welocalize brand, Welo Data leverages over 25... ...Join our team as a Web Search Evaluator and help shape the future of... ...and achieve work-life balance. Remote Work: Enjoy the freedom of...Remote workQualityBrandBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Brand / creative direction / marketing collateral Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote workQualityBrandContract workSummer workWork at office$85k - $114k
...Technology Auditor Location – Irvine, CA Company Overview... ...and support to top brands including Kia, Genesis,... ...deliver consistent, top‑quality solutions while serving... ...Audit Manager, you will design and execute a risk‑... ...rule governance, secure remote access) Infrastructure...Remote workQualityBrand- ...Company builds and grows iconic brands including Merrell®, Saucony®,... ...To Work®. The Staff Auditor supports internal audit and SOX... ...the delivery of high-quality, risk-based audit work. Primary... ...three days in office and two days remote. #LI-MM1 The above...Remote workQualityBrandWork at officeWorldwideFlexible hours
- ...qualified raters to support a project evaluating personalized visual design and geospatial recommendations. You will assess the aesthetic quality, readability, and overall polish of digital... ...consistency with user needs and brand standards. Candidates should have a professional...QualityBrandFreelance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Brand Design Quality Evaluator — Rubric Auditor. Be the first to apply!
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- quality control associate New York, NY

