Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Administrative Evaluation Designer

SaidGig

SaidGig seeks an experienced administrative professional to design realistic evaluation tasks for next‑generation AI systems. This remote contract role translates complex workflows into benchmark scenarios; no prior AI experience is required. You will create task materials (emails, calendar entries, receipts), define outcomes, and document step‑by‑step decisions. Develop detailed rubrics with 35+ criteria and document workflow improvements. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote AI Administrative Evaluation Designer in New York, NY vacancy
  •  ...Mercor is seeking a remote STEM Computational Scientific Software & Evaluation Designer in Astrophysics & Cosmology. The role focuses on creating graduate-level computational problems and evaluating how AI systems tackle research-grade challenges, from simulations to data... 
    Remote work
    Flexible hours

    Mercor Inc

    San Francisco, CA
    4 days ago
  •  ...seeks experienced scientists and engineers to evaluate frontier AI models on real technical work, including data analysis, design verification, experiments, and simulations....  ...self-directed, long-form work in a fully remote setting, with explicit focus on writing clear... 
    Remote work

    Planet Pharma

    San Francisco, CA
    5 days ago
  •  ...Weekday AI is an AI-native recruiting platform offering a remote, contract-based role for experienced legal professionals. You will design complex legal tasks, judge AI-driven responses, and provide...  ...to guide model training and evaluation. This senior, task-based position... 
    Remote work
    Contract work
    Flexible hours
    Weekday work

    Weekday AI

    New York, NY
    1 day ago
  •  ...AuraOne, Inc. is seeking a Content Designer for AI Output Evaluation (Remote) to review AI outputs against craft, constraints, and tooling standards. This independent contractor role emphasizes producing documented corrected approaches so the modeling team can train on... 
    Remote work
    For contractors
    10 hours per week

    AuraOne, Inc.

    United States
    4 days ago
  •  ...A Frontier AI Company is seeking a Senior Digital Designer for a remote, part-time independent contract role. The work focuses on reviewing, grading, and providing...  ...improvements, with an emphasis on consistent evaluation and growth-design judgment rather than creating original... 
    Remote work
    Contract work
    Part time

    A Frontier AI Company

    United States
    3 days ago
  • $75k - $80k

     ...of product development. Designing and leading the execution...  ..., contextual inquiries, remote usability testing,...  ...executing both generative and evaluation research methodologies....  ...require any accommodations. AI may be used to support certain administrative aspects of our... 
    Remote work
    Administrative

    Closer Conveyancing

    Ontario, CA
    1 day ago
  • $50 per hour

     ...Prolific in Portland, Oregon is seeking Product Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree...  ...relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility,... 
    Remote work
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Portland, OR
    1 day ago
  •  ...Senior UX / Product Designer Remote 12 month contact opportunity About...  ...enjoyable to use We work in an AI-first development...  ...technical realities. Continuously evaluate existing product experiences...  ...configuration experiences, or administrative platforms. Experience creating... 
    Remote work
    Administrative
    Hourly pay
    Immediate start

    InterTech

    Sacramento, CA
    1 day ago
  • $20 per hour

     ...A leading AI technology firm is seeking a Graphic Design Expert to evaluate graphic design elements for AI model training. This part-time contract role offers remote work flexibility and requires expertise in design principles. Ideal candidates should have formal training... 
    Remote work
    Contract work
    Part time

    HumanSignal

    United States
    1 day ago
  •  ...SaidGig is seeking a remote contract designer to apply creative and multimedia expertise to AI systems through structured design, media, evaluation, and feedback workflows. Experience with professional creative tools is valued, while prior AI experience is not required... 
    Remote work
    Contract work

    SaidGig

    United States
    4 days ago
  •  ...AuraOne is seeking a remote Game Designer / Gameplay Developer contractor to evaluate AI outputs across game art workflows. You will grade craft, constraints, and tooling adherence, flag production issues, and document corrected approaches for training the modeling team... 
    Remote work
    For contractors
    10 hours per week

    AuraOne

    United States
    5 days ago
  •  ...to support a customer project focused on evaluating tasks for an AI benchmark. You will coordinate schedules,...  ...AI domain experience required, but strong administrative skills and attention to detail are essential. This remote role offers fast onboarding and distributed... 
    Remote work
    Administrative
    For contractors

    micro1

    United States
    1 day ago
  •  ...DataAnnotation is hiring an experienced Digital Web Designer - AI Trainer for flexible, contract-based work from Evanston, IL, with remote options. You will craft realistic UI/UX...  ...with rigorous design criteria. You will evaluate interfaces, compare model versions, and... 
    Remote work
    Contract work
    Flexible hours

    Designer Jobs

    Evanston, IL
    3 days ago
  • $50 per hour

     ...Mercor is seeking an Architecture Expert to evaluate AI models in visual document understanding within the Architecture domain. The role...  ...with SMEs to improve dataset quality. The contractor role is remote, with a commitment of 15–20 hours per week, at a rate of $50/hour... 
    Remote work
    For contractors
    Flexible hours

    Mercor Inc

    New York, NY
    4 days ago
  •  ...Partner Company, a remote-first AI research initiative, seeks a senior animator-evaluator to assess AI-generated performances and establish rigorous evaluation standards for realism. You will define benchmarks and rubrics, then apply them to character animation, facial... 
    Remote work

    Partner Engineering and Science

    United States
    5 days ago
  •  ...Weekday AI is seeking experienced UI/UX and product design professionals to contribute to an AI research initiative evaluating how AI systems perform real-world digital product design work....  ...production-grade design judgment, with fully remote, contract-based engagement and... 
    Remote work
    Weekly pay
    Contract work
    Weekday work

    Weekday AI

    United States
    1 day ago
  •  ...AuraOne is seeking a remote VFX Artist / 3D Animator reviewer to evaluate AI outputs for 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrections to train the modeling team. This is a contractor... 
    Remote work
    For contractors
    10 hours per week

    AuraOne

    United States
    5 days ago
  • $30 per hour

     ...Prolific Prolific is not just another player in the AI space - we are building the biggest pool of...  ...role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    5 days ago
  •  ...Volga Partners is seeking an experienced Senior Investment Research & Capital Markets SME to support the development, evaluation, and improvement of AI models. This is not a traditional Investment Banking position; you will assess AI-generated financial analyses, validate... 
    Remote work
    Bank staff

    Volga Partners

    New York, NY
    4 days ago
  • $50 per hour

    Prolific is seeking Product Designers and UX Specialists to join their Expert Network. The role involves training and evaluating AI models using real design expertise, with opportunities...  ...skills. Flexible hours and remote work are offered for this role. #J-188... 
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    Jacksonville, FL
    4 days ago
  • $50 per hour

     ...Prolific in the United States is seeking Product Designers and UX Specialists to join our Expert Network to help train and evaluate cutting-edge AI models using real design expertise. If you have the necessary experience, we’ll send you a quick test to assess your skills... 
    Remote work
    Hourly pay

    Prolific

    United States
    3 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology...  ...is beneficial. Seeks a flexible, remote job that can easily fit around other...  ...function ~ Information Technology, Administrative, and Quality Assurance... 
    Remote work
    Administrative
    Hourly pay
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    1 day ago
  • $21.8 - $37.8 per hour

     ...challenges that matter most. We are seeking an AI Evaluations Engineer who will be working in a...  ...graduation equivalent. Three years of administrative/academic related experience....  ...Varies FLSA Status: Non-Exempt Location: Remote Department name: Staff Personnel area:... 
    Remote work
    Administrative
    Casual work
    Local area
    Flexible hours

    Johns Hopkins University

    Baltimore, MD
    3 days ago
  •  ...We take care of you with comprehensive benefits. Heidi Heidi builds clinical AI products to double healthcare capacity and strengthen human connection. With products absorbing administrative chaos for 73 million patient visits, the team supports over 2.5 million sessions... 
    Remote work
    Administrative
    Flexible hours

    Heidi

    United States
    4 days ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network for AI training and evaluation. You’ll test AI-generated designs, provide usability feedback...  ...may take about an hour each, with flexible hours and remote work from home. #J-18808-Ljbffr
    Remote work
    Work from home
    Flexible hours

    Prolific

    United States
    5 days ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    5 days ago
  • DataAnnotation seeks an experienced UI/UX Product Designer - AI Trainer to shape evaluation briefs for frontier AI models on real visual design tasks. This...  ...what works and where approaches break down. Remote work from Evanston, IL with pay per hour. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Evanston, IL
    1 day ago
  •  ...A leading AI research platform is seeking an AI Trainer with expertise in Graphic and Visual Design. The role involves evaluating designs, ensuring they meet professional standards, and providing...  ...competitive pay, flexible hours, and remote work options. #J-18808-Ljbffr... 
    Remote work
    Flexible hours

    Prolific

    Los Angeles, CA
    1 day ago
  • $203.2k - $271.3k

     ...eBay's Payments & Monetization Design team shapes how money moves...  ...explore new technologies like AI, and develop methods that...  ...performance, and market factors.Remote roles are not eligible for U....  ...experience and may use AI tools for administrative tasks in the hiring process.... 
    Remote work
    Administrative
    Immediate start
    Visa sponsorship

    eBay

    San Jose, CA
    4 days ago
  •  ...Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role as Agency Brand Design Expert offers flexible collaboration and the chance to shape evaluation criteria for branding deliverables across AI-driven projects. Ideal... 
    Remote work
    Contract work
    Flexible hours

    Mercor Inc

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Administrative Evaluation Designer. Be the first to apply!