UI/UX Design Expert - Evaluator
Obsidian
- Role Overview Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
- Key Responsibilities Design precise, task-specific grading criteria for real-world digital product and UX deliverables (design systems and component libraries, responsive UI layouts and dashboards, end-to-end product flows such as onboarding, checkout, and booking, logged-in customer portals, UX writing and product content, and design-to-engineering/production handoff)
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in New York, NY vacancy
$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedContract workSummer workRemote workMercor
New York, NY5 days ago- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...SuggestedRemote jobContract workFlexible hours
$100 - $150 per hour
...ContractCompensation:$100-$150/hourLocation:Remote Role Responsibilities Design precise, task-specific grading criteria for real-world sales... ...judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital...SuggestedSummer workRemote work- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...SuggestedTemporary work10 hours per week
- Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with...SuggestedRemote jobFor contractorsFlexible hoursWeekday work
- About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade...Hourly payWork at officeRemote work
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY17 days ago$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against...Contract workSummer workImmediate startRemote workMercor
New York, NY3 days ago$50 per hour
..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...Collaborate with project leads to resolve ambiguities and improve task design. Qualifications Must-Have Strong writing, editing,...Contract workSummer work10 hours per weekMercor
New York, NY17 days ago$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY16 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY5 days ago$50 per hour
...Jack Dorsey . Position: Spanish (Mexico) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location:... ...with project leads to resolve ambiguities and improve task design. Qualifications Must-Have Strong writing, editing, and...Contract workSummer workRemote workMercor
New York, NY26 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY16 days ago$90 per hour
...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use... ...review or technical assessment background. Pixel-perfect design-to-code experience. Web accessibility expertise ( WCAG ,...Contract workSummer workLocal areaRemote workMercor
New York, NY10 days ago$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/hour Location... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Contract workSummer workImmediate startRemote workMercor
New York, NY16 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote workMercor
New York, NY10 days ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour... ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other...Contract workSummer workImmediate startRemote workMercor
New York, NY16 days ago- ...to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work.... ...deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work...
$30 per hour
...variety of experiences, knowledge, and skills. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks...Remote jobWork from homeFlexible hours- ...hiring experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical and healthcare settings. This role... ...nursing assessment data for AI training datasets Provide expert feedback on nursing assessments and documentation practices Identify...
$20 per hour
Feedinkoo is looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user experiences. This role involves reviewing AI‑generated visuals and providing feedback to improve users' experience with AI tools. Working remotely...Remote job$151k - $251.6k
LSEG's Evaluated Pricing Service provides end-of-day valuations across global CLO markets. We are seeking an expert Senior Evaluator to own the valuation and market analysis of CLO securities across the capital structure, including debt tranches and equity positions where...Full timePart timeInternship$70 per hour
...synthesis, or product discovery to create, evaluate, and refine AI-generated documents,... ...thematic coding summaries, survey instrument design and analysis writeups, discussion guides... ...findings decks and journey map documents Expert-level document, spreadsheet, and slide craftsmanship...Immediate startRemote workFlexible hours- A leading digital solutions provider is seeking a Personalized Ads Evaluator for a part-time position. This entry-level role involves reviewing online advertisements to assess their relevance to search terms, providing detailed feedback on content and cultural context....Part timeRemote work
TELUS Digital AI Data Solutions
New York, NY3 days ago - ...offices in New York, London, and Hong Kong, JPMorganChase's PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and derivative instruments every day.As a Securities Valuation Analyst or Associate...
- ...with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong command of English and experience as reviewers or evaluators...FreelanceRemote work
Lilt
New York, NY1 day ago - ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY4 days ago - ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
Related searches
- technology expert New York, NY
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- work from home social media evaluator New York, NY
- work from home web search evaluator New York, NY
- social media evaluator New York, NY
- evaluator New York, NY
- quality evaluator New York, NY