QA Engineer - 2D & Creative Applications (AI Evaluation)
AuraOne
Category: Creative, Media & Design Evaluation · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor QA Engineer - 2D & Creative Applications (AI Evaluation) is a remote review track for evaluating AI outputs across 2d design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling team can train on it. Why this role matters 2D design AI is only useful if a working professional would actually ship the output. AuraOne uses portfolio-credentialed reviewers to grade outputs the way a senior creative would — with craft, constraints, and tooling all in scope. Responsibilities Review AI outputs against current 2d design craft and tooling standards for QA Engineer - 2D & Creative Applications (AI Evaluation) assignments. Grade composition, constraint adherence, and production-readiness on a structured rubric. Flag tooling-specific failures (file format, scale, naming, layer hygiene) with severity tags. Capture the corrected approach or reference so the modeling team can train on it. Adjudicate disputed creative judgments against published references or firm style guides. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications Portfolio or production experience in 2d design or an adjacent creative discipline for QA Engineer - 2D & Creative Applications (AI Evaluation) work. Hands-on familiarity with the standard tooling for the discipline. Comfort applying multi-page rubrics consistently across long batches. Clear written reasoning that names the craft issue and the standard being applied. Reliable async availability for at least 10 hours per week. Example tasks Grade a model's 2d design output against the brief and rate craft, constraints, and production-readiness. Flag a tooling-specific failure (incorrect file format, unsupported feature, naming convention) with severity. Adjudicate a disputed creative judgment between two reviewers using a firm style guide. Audit a 25-asset batch for rubric consistency and report drift to the program lead. Nice to have Studio, agency, or in-house team experience shipping production work. Prior experience reviewing AI-assisted creative tooling and its failure modes. Familiarity with AAA or feature-grade pipelines and asset standards. Skills Creative review Production-grade craft Tooling fluency Asset evaluation 2D design Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation Hourly rate confirmed after the interview process. #J-18808-Ljbffr AuraOne
- ...Description Job Description Role Title: QA Engineer – 2D & Creative Applications Role Type: Contractor Location:... ..., and creative applications. You'll evaluate real-world workflows, identify... ...to improve software quality and AI systems. Key Responsibilities...ApplicationCreativeRemote jobFor contractors
- ...company, which manages all applications and next steps. Our... ...looking for a Senior QA Engineer based in United... ...technical problem-solving, creative collaboration, and meaningful... ...Works We use an AI-powered matching process... ...your personal data to evaluate your candidacy and...ApplicationCreativeRemote work
$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered... .... Position: QA/Test Engineer Type: Contract... ...AI training , model evaluation, or quality review of AI... ...overlooked issues. Application Process (Takes 20–30 mins...ApplicationCreativeRemote jobContract workSummer work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered... ...: DevOps / SRE / Cloud Engineer (Coding Agent Experience... ...agents to complete and evaluate complex infrastructure... ...to accepted work. Application Process (Takes 20–30...ApplicationCreativeContract workSummer workRemote work$45 - $70 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...Health Expert, AI Safety and Model Evaluation Type: Contract... ...psychology of misinformation. Application Process (Takes 20–30 mins to complete...ApplicationCreativeContract workSummer workRemote workWeekday work$80 - $120 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...response with financial-services AI Evaluator Type: Contract... ...from a reputable institution. Application Process (Takes 20–30 mins to complete...ApplicationCreativeContract workSummer workWork at officeRemote work$70 - $110 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...week Role Responsibilities Evaluate AI-generated operational plans... ...the remainder of the project. Application Process (Takes 20–30 mins to complete...ApplicationCreativeHourly payContract workSummer workImmediate startRemote work$60 - $70 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...Remote Role Responsibilities Evaluate AI-generated responses for... ...high-risk, or ambiguous content. Application Process (Takes 20–30 mins to complete...ApplicationCreativeContract workSummer workRemote work$30 - $60 per hour
...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: QA / Software Engineering Reviewer – Browser Test Validation... ...for AI-generated web applications . Assess technical feasibility...ApplicationCreativeContract workSummer workRemote work$70 - $110 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...week Role Responsibilities Evaluate AI-generated investigation plans... ...the remainder of the project. Application Process (Takes 20–30 mins to...ApplicationCreativeHourly payContract workSummer workImmediate startRemote work$60 - $90 per hour
...job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type:... ...benchmark/task authoring. Application Process (Takes 20–30 mins to complete...ApplicationCreativeContract workSummer workRemote work$100 - $150 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...pipelines , and technical reports. Evaluate AI-generated or human-created... ...to evaluating complex work. Application Process (Takes 20–30 mins to...ApplicationCreativeContract workSummer workRemote work$120 - $170 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit...ApplicationCreativeContract workSummer workRemote work$120 - $170 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit...ApplicationCreativeContract workSummer workRemote work$43 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered... ...Responsibilities Evaluate AI model output lyrics... ...a music producer, audio engineer, and/or sound mixer. ~... ...Date ~ Immediate Application Process (Takes 20–30 mins...ApplicationCreativeContract workSummer workImmediate startRemote work$70 - $110 per hour
...the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in... ...week Role Responsibilities Evaluate AI-generated financial plans ,... ...the remainder of the project. Application Process (Takes 20–30 mins to complete...ApplicationCreativeHourly payContract workSummer workImmediate startRemote work$90k - $110k
...Multimedia Graphic Designer (Trial/Legal/Litigation Graphics) is a creative, highly motivated, organized self-starter. We are looking for... ...with 3D animation tools (Maya, Blender, SketchUp) and AI applications in design is a bonus. Experience with video editing software...ApplicationCreativeFull timeImmediate startRemote workShift work$105.4k - $207.8k
Position Summary Senior QA Engineer -AI & EngineeringJoin our AI & Engineering... ...technology.Experience evaluating or testing AI/LLM-based application features (e.g., chatbots, copilots... ...and perspectives, and bring more creativity and innovation to help solve our...ApplicationLocal areaVisa sponsorshipFlexible hours- ...Defold) is a remote review track for evaluating AI outputs across game art workflows. Reviewers... ...team can train on it. Category: Creative, Media & Design Evaluation · Pay:... ...fluency Asset evaluation Game art Software engineering Application boundary Creating a specialist...ApplicationCreativeHourly payFor contractorsRemote work10 hours per week
- ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment Type... ...Language Models (LLMs) and generative AI applications. The ideal candidate will develop... ...data scientists, product managers, and QA teams throughout the AI development lifecycle...ApplicationFull timeRemote work
$84k - $115k
...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential... .... Driving that mission is the Brand & Creative team: a dynamic group of art directors,... .... In addition, Okta offers equity (where applicable), bonus, and benefits, including health,...ApplicationCreativeLocal areaWorldwideFlexible hours- ...Enterprise AI is moving from pilots to production... ..., modernize their application and integration landscape... ...and streamline the evaluation process, guiding prospects... ..., Product, and Engineering to ensure customer success... ...to have a good time.• Creative culture – We’ve got a...ApplicationCreativeWorldwide
$100k - $143k
...Business UnitTechnology, Data, AI and Ventures (TDAV)Within... ...are seeking an experienced QA Test Engineer/Lead to join our Service Technology... ...Management (CRM) applications in the FinTech ecosystem (Life... ...software quality.Continuously evaluate the effectiveness of the test...ApplicationLocal area3 days per week$130k - $200k
...analytics, Generative AI, transformative technologies, and creative design. We can enhance... ...creatives, designers, engineers, and architects. Our team... ...management, and enterprise applications.Support architecture... ...implementations or platform evaluations.Experience with IAM,...ApplicationCreativeLocal area$122k - $240.5k
...Modernization Experience- AI & Engineering/EaaSAssociate ArchitectJoin... ...development of enterprise-grade application architecture applications... ...implement technology and creative business solutions for large... ...architecturesReview and evaluation of key attributes of existing...ApplicationCreativeLocal areaRemote workFlexible hours$123.1k - $186.3k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...and Strategic customers to evaluate and recommend optimization strategies... ...capability or identify creative Architect solutions through... ...reasonable accommodation during the application or the recruiting process,...ApplicationCreativeFull timeWork experience placementWork at officeRemote workFlexible hours3 days per week$131k - $164k
...Senior Manager, Platform Engineering, you’ll lead the team... ...processes to enabling AI safely through... ...engineering, enterprise applications or a similar environment... ...passionate, smart, and creative people who not only want... ...All final screening, evaluation, and hiring decisions...ApplicationCreativeWork at officeLocal areaWorldwideVisa sponsorshipFlexible hours- ...possible.As a Lead Software Engineer at JPMorgan Chase within... ...responsibilitiesExecutes creative software solutions, design... ...operational stability of software applications and systemsLeads evaluation sessions with external... ...of enterprise-authorized AI-assisted engineering...ApplicationCreative
- ...Senior Motion Designer (Project-Based) CG Creative Studios is a creative communications and... ...for live events, web, video and digital applications Develop concepts, look and style frames... ...apply current creative technologies and AI-assisted workflows where they improve...ApplicationCreativeFlexible hoursShift work
$155k - $215k
...communities. This is a Generative AI, Backend Engineering position at the Vice... ...-grade platforms and applications, including the next generation... ...where applicable, MLOps. Evaluate emerging technologies across... ...collaborators and creative thinkers, fueled by their...ApplicationCreativeTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to QA Engineer - 2D & Creative Applications (AI Evaluation). Be the first to apply!
- junior software test automation engineer New York, NY
- qa automation engineer New York, NY
- senior software quality engineer New York, NY
- sdet qa automation engineer New York, NY
- software quality engineer New York, NY
- software test engineer New York, NY
- software qa engineer New York, NY
- software quality assurance engineer New York, NY
- qa automation engineer remote New York, NY
- qa automation test engineer New York, NY





