Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Brand Design Quality Evaluator — Rubric Auditor

AuraOne

New York, NY
  • Remote job

AuraOne is seeking a Brand Design Quality Evaluator to remotely assess design quality prompts and model outputs. You will compare paired responses, apply a versioned rubric, and provide structured feedback for retraining the modeling team. Responsibilities include labeling inaccuracies, maintaining calibration scores weekly, and documenting failure modes for rubric improvements. This is a contractor, remote US-eligible role. #J-18808-Ljbffr AuraOne

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Brand Design Quality Evaluator — Rubric Auditor in New York, NY vacancy
  •  ...Brand Design Quality Evaluator is a remote evaluation track for reviewing brand design quality evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling... 
    Remote job
    Quality
    Brand
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    10 days ago
  • $30 per hour

     ...are building the biggest pool of quality human data in the world....  ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving...  ...Motion Graphics. A background in Brand Building, Advertising, or... 
    Remote work
    Quality
    Brand
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • AuraOne is seeking a Capability Generalization Model Evaluation Specialist for a remote contractor role. You will evaluate model outputs against AuraOne's quality rubric, compare paired responses, and label edge cases with structured tags to guide retraining. Responsibilities... 
    Remote work
    Quality
    For contractors

    AuraOne

    New York, NY
    3 days ago
  • AuraOne is seeking a Remote Receipt and Invoice Understanding Model Evaluator to review outputs against rubrics and provide structured feedback. You will compare paired responses, label edge cases, and contribute to retraining with rationale. Ideal candidates have prior... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    8 hours ago
  • AuraOne is seeking a Remote Social Engineering Security Evaluator to review prompts and responses against our quality rubric, producing auditable labels, rationales, and regression cases. This role operates as an independent contractor to support the security evaluation... 
    Remote job
    Quality
    For contractors

    AuraOne

    New York, NY
    8 hours ago
  • AuraOne is seeking a remote Retrieval Relevance Task Evaluator to review prompts and responses against our quality rubric. You will compare outputs, assign severity tags, and provide structured feedback for model retraining. This contractor role requires careful reasoning... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • AuraOne seeks a remote Helpfulness Ranking Reward Model Evaluator to review evaluation prompts and responses under a versioned rubric. You will compare paired outputs, assign severity, and provide...  ...prompts, and maintaining reviewer-quality scores through weekly calibration... 
    Remote job
    Quality
    Hourly pay
    For contractors

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking a Prompt Robustness Model Evaluation Specialist to remotely review prompts and model outputs, applying AuraOne's quality rubric. You will compare paired responses, label edge cases, and provide structured feedback for retraining. This contractor role... 
    Remote job
    Quality
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking a remote Spreadsheet QA / workbook maintenance Evaluator to help ensure high-quality AI outputs. You will review model responses, apply a versioned rubric, and provide structured feedback to retrain the system. As a contractor based in the US, you will... 
    Remote job
    Quality
    For contractors

    AuraOne

    New York, NY
    1 day ago
  • AuraOne is seeking an Educational Safety AI Evaluator for a remote, contractor-based role. You will review educational safety AI outputs, apply the quality rubric, and produce auditable labels, rationales, and regression cases for AuraOne Human Data. Responsibilities include... 
    Remote job
    Quality
    For contractors

    AuraOne

    New York, NY
    8 hours ago
  • AuraOne is seeking a remote Pairwise Preference Reward Model Evaluator to review prompts and responses against our quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain the modeling team. This independent contractor... 
    Remote job
    Quality
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • $14.5 per hour

     ...datasets that are high-quality, ethically sourced, relevant...  .... As a Welocalize brand, Welo Data leverages over...  ...relevance and quality. Evaluate and rate the...  ...beneficial. Seeks a flexible, remote job that can easily fit...  ...and pass a quality test designed by our client before starting... 
    Remote work
    Quality
    Brand
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Kanz.us

    Dallas, TX
    2 days ago
  • $20 per hour

    A leading design technology firm is seeking an Experience Designer to enhance AI systems...  ...critique AI outputs and help refine design quality. Applicants should have a background in UI/UX and be fluent in English. This is a remote position with project flexibility and... 
    Remote work
    Quality

    DataAnnotation

    Nevada, IA
    2 days ago
  • $20 per hour

     ...cutting-edge AI company is seeking a Digital Designer to evaluate and enhance AI understanding of design...  .... This position offers flexible remote work options and engaging projects that...  ...AI-generated designs and assess their quality, helping shape the future of AI tools for... 
    Remote work
    Quality
    Flexible hours

    DataAnnotation

    Wisconsin
    2 days ago
  • $40 per hour

     ...A cutting-edge AI design firm is seeking a Digital Designer to evaluate and enhance AI-generated designs. This role involves...  .../UX visuals, assessing aesthetic quality, and contributing to various...  ...flexibility, the opportunity to work remotely, and competitive pay for... 
    Remote work
    Quality

    DataAnnotation

    Providence, RI
    2 days ago
  • $80 - $120 per hour

    Mercor is looking for a Brand / creative direction / marketing collateral Evaluator to assess AI-generated work for quality. The ideal candidate will have over 5 years of experience...  .... This contract position allows for remote work, offering compensation between $80-... 
    Remote job
    Quality
    Brand
    Contract work
    Work at office

    Mercor

    New York, NY
    2 days ago
  • OpenTrain AI is seeking a remote, US-based contractor to evaluate and improve AI models that produce professional enterprise...  ...useful evaluation data. The work centers on brand voice, strategic communication, executive-level quality, and the failure modes that can make AI-... 
    Remote job
    Quality
    Brand
    Part time
    For contractors
    Work at office

    OpenTrain AI

    Brooklyn, NY
    1 day ago
  •  ...trust. Working with over 30,000 global brands, retailers, manufacturers and food...  ...secure every step of their supply chain with quality inspections, supplier audits, certifications...  .... Every day at work, our inspectors, auditors, and lab techs use their expertise to help... 
    Remote work
    Quality
    Brand
    For contractors
    Work experience placement
    Worldwide

    Qima

    United States
    2 days ago
  •  ...industry, is seeking a SOX Auditor to join their team. As...  ...Location: Fully Remote Pay Range: $45/HR W...  ...audits. Review and evaluate the design and operating effectiveness...  ...Our expert family of brands - Manpower, Experis,...  ...a professional, high quality work environment. It... 
    Remote work
    Quality
    Brand
    Weekly pay
    Temporary work
    Flexible hours

    Manpower Inc

    Milwaukee, WI
    5 days ago
  •  ...reporting, and produce quality deliverables to both department...  ...prevention), external auditors, and regulators,...  ...for improvement in the design and effectiveness of key...  ...with proven ability to evaluate and determine the...  ...J.P. Morgan and Chase brands. Our history spans over... 
    Quality
    Brand
    Visa sponsorship
    Flexible hours

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • $89.6k - $149.3k

     ...HYBRID 4 DAYS/WEEK (1 DAY REMOTE) OUT OF: BUFFALO NY,...  ...and oversee Auditors (as applicable) on assigned...  ...reporting and produce quality deliverables in accordance...  ...reflects the M&T Bank brand.Maintain M&T internal...  ...control conceptsExperience evaluating adequacy of the... 
    Remote work
    Quality
    Brand
    Full time
    Work experience placement

    M&T Bank

    Buffalo, NY
    2 days ago
  •  ...Independent Contractor Collision Center Auditor Do you love working with high end, luxury automotive brands? Do you have a passion for...  ...their goals of 'highest quality' and elite Certification status...  ...We are currently looking for remote INDEPENDENT CONTRACTORS within... 
    Remote work
    Quality
    Brand
    Full time
    For contractors
    Work at office
    Work from home
    Worldwide

    DEKRA North America

    United States
    4 days ago
  • $107.5k - $179.1k

     ...DAYS/WEEK ONSITE (1 DAY REMOTE) BASED OUT OF: BUFFALO...  ...to deliver high‑quality audit results in line...  ...standards.Lead a team of auditors in the identification,...  ...staffing, performance evaluations, promotions, compensation...  ...reflects the M&T Bank brand and values.Perform... 
    Remote work
    Quality
    Brand
    Full time
    Relocation

    M&T Bank

    Wilmington, DE
    3 days ago
  • $32 - $37 per hour

     ...Risk Adjustment Coding Auditor to support the accuracy...  ...prospective chart reviews to evaluate risk adjustment...  ...maintaining compliance and high-quality audit standards.Job...  ...TypeThis is a fully remote position.Application DeadlineThis...  ...expertise in strategy, design, execution and... 
    Remote work
    Quality
    Contract work
    Temporary work
    Work at office

    TEKsystems

    Phoenix, AZ
    1 day ago
  • $68k - $85k

     ...in Pittsburgh, PA* Monro's family of brands is one of the leading automotive service...  ...mission to bring our guests the highest quality tire and auto service in the industry....  ...Operations Support, this individual will evaluate, inspect, audit, and determine the effectiveness... 
    Remote work
    Quality
    Brand
    Work at office
    Flexible hours

    Monro, Inc.

    United States
    1 day ago
  • $14.5 per hour

     ...provide datasets that are high-quality, ethically sourced, relevant,...  ...AI models. As a Welocalize brand, Welo Data leverages over 25...  ...Join our team as a Web Search Evaluator and help shape the future of...  ...and achieve work-life balance. Remote Work: Enjoy the freedom of... 
    Remote work
    Quality
    Brand
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    19 hours ago
  • $80 - $120 per hour

     ...Jack Dorsey . Position: Brand / creative direction / marketing collateral Evaluator Type: Contract Compensation...  ...$80–$120/hour Location: Remote Role Responsibilities...  ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic... 
    Remote work
    Quality
    Brand
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    5 days ago
  • $85k - $114k

     ...Technology Auditor Location – Irvine, CA Company Overview...  ...and support to top brands including Kia, Genesis,...  ...deliver consistent, top‑quality solutions while serving...  ...Audit Manager, you will design and execute a risk‑...  ...rule governance, secure remote access) Infrastructure... 
    Remote work
    Quality
    Brand

    Hyundai AutoEver America

    Irvine, CA
    1 day ago
  •  ...Company builds and grows iconic brands including Merrell®, Saucony®,...  ...To Work®. The Staff Auditor supports internal audit and SOX...  ...the delivery of high-quality, risk-based audit work. Primary...  ...three days in office and two days remote. #LI-MM1 The above... 
    Remote work
    Quality
    Brand
    Work at office
    Worldwide
    Flexible hours

    Wolverine Worldwide

    Rockford, MI
    2 days ago
  •  ...qualified raters to support a project evaluating personalized visual design and geospatial recommendations. You will assess the aesthetic quality, readability, and overall polish of digital...  ...consistency with user needs and brand standards. Candidates should have a professional... 
    Quality
    Brand
    Freelance

    Dorado

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Brand Design Quality Evaluator — Rubric Auditor. Be the first to apply!