Remote AI Evaluation Scenario Designer
$80 per hourMind Rift
New York, NY
- Remote job
A technology-driven company is seeking an entry-level professional to design evaluation scenarios for AI agents. Responsibilities include creating structured test cases and analyzing agent behaviors. Ideal candidates should have a degree in a relevant field, strong communication skills, and a basic understanding of programming. This part-time role offers flexible hours, with competitive pay rates up to $80/hour based on skills and experience. Contribute to advanced AI projects and enhance your portfolio while working from anywhere. #J-18808-Ljbffr Mind Rift
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Scenario Designer in New York, NY vacancy
- ...thinking technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a...Remote jobPart time
- ...analyst based in the EU or UK to review and refine AI-generated market analyses. This remote freelance role requires 8-20 hours per week and offers... ...other projects. You will craft realistic market scenarios, evaluate AI outputs, and provide structured feedback to improve...Remote workFreelanceFlexible hours
- YO AI Labs is seeking Medical Evaluation Specialists to contribute clinical expertise for evaluating advanced AI systems. The role involves drafting and... ...ensuring accuracy, clarity, and reproducibility in a remote, contractor-based arrangement. #J-18808-Ljbffr YO AI LabsRemote jobFor contractors
- YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving AI systems. You will create and validate high-difficulty medical questions and...Remote job
$70 - $80 per hour
...Role Overview Design evaluation tasks and senior-level scenarios that test AI systems used for rapid prototyping, product design, and human-AI collaborative coding... ...encouraged to apply. Work Terms Location: Remote. Employment type: hourly. Compensation ~...Remote workHourly paySaidGig
United States24 days ago$80 - $150 per hour
...Role Overview Evaluate and define excellence in brand and design work for a leading AI research organization. Instead of creating design deliverables, you will create... ...projects is a strong plus Work Terms Location, remote Engagement type, hourly Compensation ~...Remote workHourly paySaidGig
United Statesa month ago$50 per hour
...Prolific in Portland, Oregon is seeking Product Designers and UX Specialists to join their Expert Network for training AI models. Ideal candidates should hold a degree... ...relevant experience. Responsibilities include evaluating AI-generated designs, auditing accessibility,...Remote workHourly payWork from homeFlexible hoursProlific
Portland, OR4 days ago- ...analytical, detail-oriented contractors to develop prompts, test AI chatbots, and evaluate outputs. You will craft diverse conversations, write high-... ...communications. Projects offer 5-40 hours weekly with remote work and flexible scheduling. #J-18808-Ljbffr SupportFinity...Remote jobFor contractorsSelf employmentFlexible hours
- United States Digital Space LLC offers a remote contract role focusing on fine-tuning large... ...to broken down complex problems for evaluation tasks. You will collaborate with LLM researchers... ...to PhD topics, enabling cutting-edge AI projects while working independently in a...Remote jobContract work
$20 per hour
...A leading AI technology firm is seeking a Graphic Design Expert to evaluate graphic design elements for AI model training. This part-time contract role offers remote work flexibility and requires expertise in design principles. Ideal candidates should have formal training...Remote workContract workPart timeHumanSignal
Austin, TX4 days ago$50 per hour
...Prolific is seeking Product Designers and UX Specialists to join their Expert Network. The role involves training and evaluating AI models using real design expertise, with opportunities... ...skills. Flexible hours and remote work are offered for this role. #J-1880...Remote workHourly payFlexible hoursProlific
Jacksonville, FL4 days ago- Feedinkoo is hiring a Graphic Designer 2 for a remote position focusing on visual content refinement and AI evaluation projects. The role requires a Bachelor's degree and at least 3 years of relevant experience. As a Graphic Designer, you will collaborate with various...Remote job
$80 - $150 per hour
...AI Training Scenario Designer is a remote review track for evaluating AI outputs across ai training scenario designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach...Remote jobFor contractors10 hours per week- YO AI Labs is seeking experienced Personal Trainers to contribute fitness... ...expertise to a project focused on evaluating next-generation AI systems. You will design and review fitness content, assess... ...for exercise programming. Remote role for seasoned professionals with...Remote job
$30 per hour
...Prolific Prolific is not just another player in the AI space - we are building the biggest pool of... ...role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image...Remote jobWork from homeFlexible hours- A leading AI data platform is seeking a Graphic Design Expert for a remote, part-time role. The successful candidate will evaluate and rate graphic design elements to train AI models, contributing to advanced technologies in visual content assessment. Candidates should...Remote jobContract workPart timeFlexible hours
$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Design Expert Type: Contract... ...$80–$150/hour Location: Remote Role Responsibilities Design... ...with AI training , evaluation, or human-data projects....Remote workContract workSummer workMercor
Boston, MA5 days ago- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ3 days ago - ...based in London, UK, Recraft is an AI tool for professional designers, illustrators, and marketers, setting... ...applying our model to real creative scenarios to uncover where it works, where it... ...and early-stage concept ideation Evaluate generated outputs to identify...Remote workFull timeContract workFreelanceWorldwideFlexible hours
ReCraft Home Remodeling
United States3 days ago - ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
Prolific
Arizona City, AZ4 days ago $80 - $120 per hour
...Role Overview Review AI-generated documents, spreadsheets, and slide decks through... ...user and customer research expertise. This remote, hourly role focuses on assessing outputs... ...domain quality, then delivering actionable evaluations. Key Responsibilities Evaluate AI-...Remote workHourly payWork at officeSaidGig
United States16 days ago$20 per hour
Feedinkoo is looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user experiences. This role involves... ...to improve users' experience with AI tools. Working remotely, you'll assess how AI understands design principles...Remote job$80 per hour
A leading AI innovation firm is seeking an Evaluation Scenario Designer to create structured test cases for LLM-based agents. This part-time role allows for flexible project work, focusing on defining gold-standard behaviors and analyzing agent performance. Candidates should...Remote jobPart timeFlexible hours$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ...Learning Engineer — Model Evaluation & Experimentation Type:... ...$60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities Design tasks by transforming real ML...Remote workHourly payWeekly payContract workFor contractorsSummer workMercor
San Francisco, CA5 days ago- Mercor is looking for a Remote Medical Expert to contribute to AI research by designing medical prompts and grading AI-generated responses. This role is fully remote and offers flexible commitment of 20+ hours per week. Ideal candidates include board-certified attending...Remote jobContract workFlexible hours
- A revolutionary AI research lab seeks Private Investigator Experts to design and evaluate investigative scenarios that will enhance AI models. This remote role involves developing challenging case studies and assessing AI responses for accuracy. Candidates should have...Remote workHourly pay
- OpenTrain AI is seeking a Finance and Accounting Task Author to design expert-level accounting reconciliation... ...tasks that train and evaluate advanced AI agents.... ...numerically rigorous scenarios, write scoring rubrics... ...correctness. This is a remote, part-time contractor...Remote jobPart timeFor contractors
$50 per hour
Prolific is seeking Product Designers and UX Specialists to train and evaluate AI models. Candidates should have a degree in HCI or related fields and experience... ...pay up to $50 per hour, with flexible hours and remote work options are offered. #J-18808-Ljbffr ProlificRemote jobHourly payFlexible hours- YO AI Labs is seeking senior Product Design and AI-assisted development experts to craft evaluation tasks for AI systems spanning rapid prototyping,... ...and human-AI collaboration. Remote, flexible schedule,... ...tracks, creating realistic scenarios, rubrics, prototypes, and...Remote jobWeekly payFor contractorsFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Scenario Designer. Be the first to apply!
Related searches
- principal designer New York, NY
- senior plumbing designer New York, NY
- designer part time New York, NY
- utility designer New York, NY
- senior service designer New York, NY
- senior structural designer New York, NY
- tooling designer New York, NY
- experiential designer New York, NY
- senior designer New York, NY
- layout designer New York, NY