Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

QA Engineer - 2D & Creative Applications (AI Evaluation)

AuraOne

Category: Creative, Media & Design Evaluation · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor QA Engineer - 2D & Creative Applications (AI Evaluation) is a remote review track for evaluating AI outputs across 2d design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it. Why this role matters 2D design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope. Responsibilities Review AI outputs against current 2d design craft and tooling standards for QA Engineer - 2D & Creative Applications (AI Evaluation) assignments. Grade composition, constraint adherence, and production-readiness on a structured rubric. Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags. Capture the corrected approach or reference so the modeling team can train on it. Adjudicate disputed creative judgments against published references or firm style guides. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications Portfolio or production experience in 2d design or an adjacent creative discipline for QA Engineer - 2D & Creative Applications (AI Evaluation) work. Hands-on familiarity with the standard tooling for the discipline. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the craft issue and the standard being applied. Reliable async availability for at least 10 hours per week. Example tasks Grade a model's 2d design output against the brief and rate craft, constraints, and production-readiness. Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity. Adjudicate a disputed creative judgment between two reviewers using a firm style guide. Audit a 25-asset batch for rubric consistency and report drift to the program lead. Nice to have Studio, agency, or in-house team experience shipping production work. Prior experience reviewing AI-assisted creative tooling and its failure modes. Familiarity with AAA or feature-grade pipelines and asset standards. Skills Creative review Production-grade craft Tooling fluency Asset evaluation 2D design Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation Hourly rate confirmed after the interview process. #J-18808-Ljbffr AuraOne

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the QA Engineer - 2D & Creative Applications (AI Evaluation) in New York, NY vacancy
  •  ...Description Job Description Role Title: QA Engineer – 2D & Creative Applications Role Type: Contractor Location:...  ..., and creative applications. You'll evaluate real-world workflows, identify...  ...to improve software quality and AI systems. Key Responsibilities... 
    Application
    Creative
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    2 days ago
  •  ...company, which manages all applications and next steps. Our...  ...looking for a Senior QA Engineer based in United...  ...technical problem-solving, creative collaboration, and meaningful...  ...Works We use an AI-powered matching process...  ...your personal data to evaluate your candidacy and... 
    Application
    Creative
    Remote work

    Jobgether SRL

    New York, NY
    1 day ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered...  .... Position: QA/Test Engineer Type: Contract...  ...AI training , model evaluation, or quality review of AI...  ...overlooked issues. Application Process (Takes 20–30 mins... 
    Application
    Creative
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    9 days ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered...  ...: DevOps / SRE / Cloud Engineer (Coding Agent Experience...  ...agents to complete and evaluate complex infrastructure...  ...to accepted work. Application Process (Takes 20–30... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    2 days ago
  • $45 - $70 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...Health Expert, AI Safety and Model Evaluation Type: Contract...  ...psychology of misinformation. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    11 days ago
  • $80 - $120 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...response with financial-services AI Evaluator Type: Contract...  ...from a reputable institution. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    22 days ago
  • $70 - $110 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...week Role Responsibilities Evaluate AI-generated operational plans...  ...the remainder of the project. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $60 - $70 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...Remote Role Responsibilities Evaluate AI-generated responses for...  ...high-risk, or ambiguous content. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    29 days ago
  • $30 - $60 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: QA / Software Engineering Reviewer – Browser Test Validation...  ...for AI-generated web applications . Assess technical feasibility... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $70 - $110 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...week Role Responsibilities Evaluate AI-generated investigation plans...  ...the remainder of the project. Application Process (Takes 20–30 mins to... 
    Application
    Creative
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $60 - $90 per hour

     ...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type:...  ...benchmark/task authoring. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    27 days ago
  • $100 - $150 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...pipelines , and technical reports. Evaluate AI-generated or human-created...  ...to evaluating complex work. Application Process (Takes 20–30 mins to... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    9 days ago
  • $120 - $170 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    1 day ago
  • $120 - $170 per hour

     ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit... 
    Application
    Creative
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    19 days ago
  • $43 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered...  ...Responsibilities Evaluate AI model output lyrics...  ...a music producer, audio engineer, and/or sound mixer. ~...  ...Date ~ Immediate Application Process (Takes 20–30 mins... 
    Application
    Creative
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $70 - $110 per hour

     ...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in...  ...week Role Responsibilities Evaluate AI-generated financial plans ,...  ...the remainder of the project. Application Process (Takes 20–30 mins to complete... 
    Application
    Creative
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    20 days ago
  • $90k - $110k

     ...Multimedia Graphic Designer (Trial/Legal/Litigation Graphics) is a creative, highly motivated, organized self-starter. We are looking for...  ...with 3D animation tools (Maya, Blender, SketchUp) and AI applications in design is a bonus. Experience with video editing software... 
    Application
    Creative
    Full time
    Immediate start
    Remote work
    Shift work

    icreatives

    New York, NY
    1 day ago
  • $105.4k - $207.8k

    Position Summary Senior QA Engineer -AI & EngineeringJoin our AI & Engineering...  ...technology.Experience evaluating or testing AI/LLM-based application features (e.g., chatbots, copilots...  ...and perspectives, and bring more creativity and innovation to help solve our... 
    Application
    Local area
    Visa sponsorship
    Flexible hours

    Deloitte

    New York, NY
    5 days ago
  •  ...Defold) is a remote review track for evaluating AI outputs across game art workflows. Reviewers...  ...team can train on it. Category: Creative, Media & Design Evaluation · Pay:...  ...fluency Asset evaluation Game art Software engineering Application boundary Creating a specialist... 
    Application
    Creative
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AI Trainer Jobs

    New York, NY
    2 days ago
  •  ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment Type...  ...Language Models (LLMs) and generative AI applications. The ideal candidate will develop...  ...data scientists, product managers, and QA teams throughout the AI development lifecycle... 
    Application
    Full time
    Remote work

    Ova Technologies

    New York, NY
    2 days ago
  • $84k - $115k

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential...  .... Driving that mission is the Brand & Creative team: a dynamic group of art directors,...  .... In addition, Okta offers equity (where applicable), bonus, and benefits, including health,... 
    Application
    Creative
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    1 day ago
  •  ...Enterprise AI is moving from pilots to production...  ..., modernize their application and integration landscape...  ...and streamline the evaluation process, guiding prospects...  ..., Product, and Engineering to ensure customer success...  ...to have a good time.• Creative culture – We’ve got a... 
    Application
    Creative
    Worldwide

    Solace

    New York, NY
    4 days ago
  • $100k - $143k

     ...Business UnitTechnology, Data, AI and Ventures (TDAV)Within...  ...are seeking an experienced QA Test Engineer/Lead to join our Service Technology...  ...Management (CRM) applications in the FinTech ecosystem (Life...  ...software quality.Continuously evaluate the effectiveness of the test... 
    Application
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    4 days ago
  • $130k - $200k

     ...analytics, Generative AI, transformative technologies, and creative design. We can enhance...  ...creatives, designers, engineers, and architects. Our team...  ...management, and enterprise applications.Support architecture...  ...implementations or platform evaluations.Experience with IAM,... 
    Application
    Creative
    Local area

    Deloitte

    New York, NY
    6 days ago
  • $122k - $240.5k

     ...Modernization Experience- AI & Engineering/EaaSAssociate ArchitectJoin...  ...development of enterprise-grade application architecture applications...  ...implement technology and creative business solutions for large...  ...architecturesReview and evaluation of key attributes of existing... 
    Application
    Creative
    Local area
    Remote work
    Flexible hours

    Deloitte

    New York, NY
    4 days ago
  • $123.1k - $186.3k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents...  ...and Strategic customers to evaluate and recommend optimization strategies...  ...capability or identify creative Architect solutions through...  ...reasonable accommodation during the application or the recruiting process,... 
    Application
    Creative
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Salesforce

    New York, NY
    3 days ago
  • $131k - $164k

     ...Senior Manager, Platform Engineering, you’ll lead the team...  ...processes to enabling AI safely through...  ...engineering, enterprise applications or a similar environment...  ...passionate, smart, and creative people who not only want...  ...All final screening, evaluation, and hiring decisions... 
    Application
    Creative
    Work at office
    Local area
    Worldwide
    Visa sponsorship
    Flexible hours

    Diligent

    New York, NY
    4 days ago
  •  ...possible.As a Lead Software Engineer at JPMorgan Chase within...  ...responsibilitiesExecutes creative software solutions, design...  ...operational stability of software applications and systemsLeads evaluation sessions with external...  ...of enterprise-authorized AI-assisted engineering... 
    Application
    Creative

    JP Morgan Chase

    New York, NY
    3 days ago
  •  ...Senior Motion Designer (Project-Based) CG Creative Studios is a creative communications and...  ...for live events, web, video and digital applications Develop concepts, look and style frames...  ...apply current creative technologies and AI-assisted workflows where they improve... 
    Application
    Creative
    Flexible hours
    Shift work

    Cg Creative

    New York, NY
    4 days ago
  • $155k - $215k

     ...communities. This is a Generative AI, Backend Engineering position at the Vice...  ...-grade platforms and applications, including the next generation...  ...where applicable, MLOps. Evaluate emerging technologies across...  ...collaborators and creative thinkers, fueled by their... 
    Application
    Creative
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to QA Engineer - 2D & Creative Applications (AI Evaluation). Be the first to apply!