AI-Driven UI/UX Design Evaluator
Feedinkoo
Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The role is remote in the United States, with contracts for general AI training projects and design-focused work. You will participate in qualification processes and access diverse design-oriented projects and deliverables. #J-18808-Ljbffr Feedinkoo
- Mercor partners with a leading AI lab to train frontier models on insurance reasoning data. We seek Multiline P&C Underwriters to design risk scenarios, evaluate model outputs, and shape AI reasoning about insurability, pricing, and coverage terms. Candidates should have...Suggested
- Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. You will define what excellent work looks like: designing...Suggested
- Cincinnatus LLC is recruiting a senior character animator to help shape evaluation standards for an AI-driven performance transfer model. The role focuses on facial animation, performance capture, and translating complex visuals into precise data captions, with part-time...SuggestedPart time
- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...SuggestedRemote work
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...SuggestedRemote jobHourly pay$24 per hour
Prolific is seeking Fluent Telugu Speakers from India to assess AI communication models. You will be involved in audio localization, sentiment analysis, and quality control by reviewing audio clips to ensure cultural and emotional relevance. This remote position offers...Remote jobWork from homeFlexible hours- Obsidian is seeking experienced evaluators to test AI systems on complex personal workflows across health, travel, planning, home services, and career search. You will create realistic prompts, execute tasks with screen recording, and use your own plugins to complete actions...
- Mercor seeks experienced brand designers to define grading criteria for real-world brand deliverables and to score AI-generated versus human work with detailed written justifications. You will apply evidence-based judgment, ensure reproducibility, and iteratively incorporate...
- MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote jobContract workTemporary workImmediate start
- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote jobWork at office
- Productive Playhouse is building an Albanian-speaking evaluator pool for AI chatbot testing. As an AI Evaluator, you’ll interact with AI models to assess capabilities, safety, and usefulness, providing data to improve models. Tasks come in batches with flexible hours and...Remote jobFreelanceFlexible hours
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote jobHourly payPart timeFlexible hours$14.5 per hour
Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hours- Mercor is seeking experienced musicians to evaluate generative music AI models in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Urdu and English. This contract runs up to six...Contract workImmediate startRemote work
- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Productive Playhouse is building a talent pool of Armenian speakers to test and evaluate leading AI chatbots. This freelance, project-based opportunity lets you choose tasks, set your own hours, and work with other clients as needed. Open to freelancers outside the U.S....Remote jobFreelanceFlexible hours
- Dorado is hiring expert Evaluators in Legal/compliance to review AI-generated work products for accuracy and domain quality. You will apply deep subject-matter expertise to grade outputs across documents, spreadsheets, and slide decks. This is a remote, hourly engagement...Remote jobHourly payWork at office
- Handshake is seeking an AI Policy Specialist on the Violence & Fiction team to evaluate how AI models handle violent content in fiction and related policy contexts. You will read requests and model replies, determine policy classification, and explain reasoning clearly...
- Mercor is seeking bilingual experts (Thai and English) to help improve how advanced AI models handle sensitive topics in Thai. You will create high-quality prompts in Thai and apply guidelines to classify conversations, ensuring safe and responsible outputs. Training will...
- HumanitApp is seeking proficient bilingual speakers (English & Vietnamese) to help make advanced AI models safer. You’ll apply language fluency and cultural judgment to evaluate how models handle sensitive topics in Vietnamese. No prior AI/ML experience is required—we’ll...
- YO AI Labs is seeking an experienced Adobe Marketing Technology Expert for a remote contractor role. The candidate will test marketing workflows and evaluate AI-generated outcomes across Adobe Workfront, AEM, CJA, Analytics, and Experience Cloud. You will identify workflow...Remote jobFor contractors
- Dorado is seeking expert Evaluators in market research / competitive intelligence to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements...Remote jobHourly payWork at office
- Mercor is seeking expert Evaluators in Clinical/biomedical/pharma to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. Remote, hourly engagement, requiring 5+ years of relevant experience and native/professional English fluency...Remote jobHourly payWork at office
- ...professionals to join a project that defines what excellent AI-assisted marketing work looks like. You will design task-specific grading criteria and rigorously score... ...strategy, and familiarity with AI training or evaluation. This is a highly collaborative, fast-moving effort...
- Mercor is seeking expert Evaluators in Market research / competitive intelligence to review AI-generated artifacts for accuracy, rigor, and domain quality. This is a remote, hourly engagement that allows work from anywhere in the United States. You will apply deep SME to...Remote jobHourly pay
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate; Duration: up to...Immediate startFlexible hours
$55 - $60 per hour
AuraOne is seeking a Real Estate Practice Reviewer — AI Output Evaluation (Remote) to review practice evaluation prompts and responses against AuraOne's quality rubric. You will compare paired outputs, label edge cases, and provide structured feedback to help retrain models...Remote jobHourly payFor contractors10 hours per week$30 per hour
...Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent... .... Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical roles. Proficiency in rubric...Remote jobHourly payContract work- Mercor is hiring expert Evaluators in Product management / roadmap / PRD to review AI-generated work products for accuracy, rigor, and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise to grade outputs, evaluate artifacts...Remote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI-Driven UI/UX Design Evaluator. Be the first to apply!
- education evaluator New York, NY
- program evaluator New York, NY
- social media evaluator New York, NY
- work from home web search evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- ux engineer New York, NY

