Remote Coding Task Designer: Build Hard AI Evaluation Challenges

$80 per hour

WorksHub

Remote job

WorksHub is seeking experienced developers to design and validate complex coding tasks for AI research. This fully remote position allows you to own tasks from creation to evaluation, ensuring they challenge AI capabilities. You’ll earn $80 per accepted task and $90 for exceptional ones, with an average task taking about 2 hours. No minimum hours or meetings are required, offering complete flexibility. #J-18808-Ljbffr WorksHub

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Remote Coding Task Designer: Build Hard AI Evaluation Challenges in San Francisco, CA vacancy

Senior Product Designer for AI Evaluation
$70 - $80 per hour
...Role Overview Design evaluation expert responsible for creating... ...-level evaluation tasks and rubrics for AI systems used in... ...human-AI collaborative coding. Work spans two... ...including UX/UI design challenges, design systems and... ...Terms Location, remote. Employment type,...
Remote work
Hourly pay
SaidGig
United States
4 days ago
Senior Digital Designer
$97.6k - $146.4k
...strategists, designers, and... ...UX/UI design challenges with craft,... ...are open to remote locations across... ...to clients, building trust and alignment... ...variety of tasks at different... ...design (coding is not a requirement... ...(AI): We may use... ...screening, and evaluating candidates....
Remote work
Permanent employment
Temporary work
TEKsystems
Chicago, IL
1 day ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
A cutting-edge AI company is looking for experienced quantitative professionals to evaluate AI-generated statistical analyses and provide... ...feedback. In this fully remote role, you can set your own schedule... ...or economics, along with coding skills and strong English proficiency...
Remote work
Hourly pay
DataAnnotation
Louisiana, MO
4 days ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...A leading AI research company is seeking quantitative professionals to evaluate AI-generated analyses and design technical solutions. This fully remote role offers competitive hourly pay up to $60, allowing... ...experience, familiarity with coding, and a degree in a relevant...
Remote work
Hourly pay
Full time
Flexible hours
DataAnnotation
Nashville, TN
4 days ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...A cutting-edge AI development company is seeking quantitative professionals to evaluate AI-generated work and solve complex problems while working remotely. Candidates should have 2+ years of experience... ...a quantitative field, strong coding skills, and a bachelor's degree...
Remote work
Hourly pay
DataAnnotation
Annapolis, MD
16 hours ago
Product Designer, AI Models
$164k - $294k
...mission to make design accessible to... ...designs into code, or iterating with AI. From idea to... ...and oversee evaluation quality. This... ...US hubs or remotely in the United... ...our AI systems Build thorough... ...models for design tasks, either... ...shaping open‑ended challenges into clear...
Remote work
Full time
For contractors
Work from home
Figma
San Francisco, CA
1 day ago
AI Training: Support Task Designer (Remote)
Alignerr is building a dataset of expert tasks to train and evaluate AI agents in real enterprise support. As a Task Author... ...Customer Support / Success, you will design end-to-end support triage tasks—... ...verification. This is a fully remote, hourly contract role for...
Remote job
Hourly pay
Contract work
Flexible hours
Dorado
Austin, TX
2 days ago
Freelance Senior Software Engineer | AI Evaluation
...Description We're building a dataset to evaluate AI coding agents - how... ...world developer tasks. Essentially,... ...succeeded; ~Designing edge cases and... ...AI - it's very hard to create tasks... ...that genuinely challenges the best models... ...Flexible, fully remote schedule (40 hours...
Remote work
Contract work
Freelance
Flexible hours
Toloka
Remote
2 days ago
Remote: AI Design Evaluator & Visual Graphics Expert
$30 per hour
...just another player in the AI space - we are building the biggest pool of quality... ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are... ...and now tackle complex design tasks such as layout, typography,...
Remote job
Work from home
Flexible hours
Prolific
New York, NY
3 days ago
Senior AI-First Designer
..., Experience & Design, Engineering and... ...Services. We build digital solutions... ...is becoming AI-native and agentic... ...ship them as code into the engineering... ...and multi-step task orchestration).... ...willingness to challenge traditional... ...AI experience evaluation approaches (conversation...
Appnovation
New York, NY
1 day ago
Product Designer, AI Models
$169k - $303k
...mission to make design accessible to all... ...designs into code, or iterating with AI. From idea to product... ...and oversee evaluation quality.This is... ...our US hubs or remotely in the United States... ...for design tasks, either coding or... ...shaping open-ended challenges into clear goalsStrong...
Remote work
Minimum wage
Full time
For contractors
Local area
Flexible hours
Figma
San Francisco, CA
2 days ago
Sr. Product Designer
...DesignerLocation: Remote - Mainland... ...by building a unified, cloud... ...workflows, and AI‑powered intelligence... ...Product Designer, you’ll design... ...through validated, code‑backed... ...criteria to evaluate AI outputs, refining... ...as adoption, task‑time... ...team impact.Challenge assumptions,...
Remote work
Immediate start
Worldwide
Omnicell
Austin, TX
4 days ago
AI Prompt Designer
$100k
...AI Prompt Designer – Remote Bright Vision Technologies is a technology consulting and... ...modern LLMs with the discipline of building reusable design patterns, evaluation frameworks, and developer... ...domains such as customer support, coding assistants, or analytics agents...
Remote work
Full time
H1b
Local area
Immediate start
Visa sponsorship
Bright Vision Technologies
United States
4 days ago
Lead AI Generative Designer
...entertainment platforms designed to connect... ...nomads works remotely from all over the... ...Lead Generative AI Designer . Your main tasks will be: Own... ...performance. Build and optimize scalable... ...hypotheses, evaluate their business value... ...clearly, challenge ideas and make practical...
Remote work
Full time
Work at office
Work from home
Social Discovery Group
Remote
10 days ago
AI Evaluation Specialist
...Join a pioneering AI initiative focused on building next-generation evaluation benchmarks for frontier... ..., you will design challenging, multi-step tasks that expose hidden... ...This is a fully remote, full-time engagement... ...models perform across coding, machine learning,...
Remote work
Full time
Contract work
For contractors
Flexible hours
Weekday
Remote
18 days ago
AI Investigations Challenge Designer
A revolutionary AI research lab seeks Private Investigator Experts to design and evaluate investigative scenarios that will enhance AI models. This remote role involves developing challenging case studies and assessing AI responses for accuracy. Candidates should have a...
Remote work
Hourly pay
AfterQuery Experts
New York, NY
2 days ago
Product Designer
...Product Designer At 1Password At... ...Password, we're building the... ...way people and AI agents work today... ...and to solve hard problems in a... ...complex security challenges into elegant,... ...AI-assisted coding tools to... ...and rigorous evaluation before anything... ...This is a remote opportunity within...
Remote work
Immediate start
1Password
United States
2 days ago
Product Designer
...Product Designer Kyivstar.Tech is looking... ...frame problems, challenge assumptions, build scalable UX concepts... ...framing and task clarification to... ...qualitative feedback to evaluate the impact of... ...Optionally use AI-based tools, prototyping... ...tools, low-code/no-code, or vibe-...
Remote work
Flexible hours
Kyivstar
United States
4 days ago
Senior Product Designer
...Senior Product Designer Board Intelligence... ...our team uses AI, both in the... ...in critique. Build working, high fidelity... ...in front end code or with AI... ...doesn't. You ask hard questions about... ...users complete key tasks on the platform.... ...re inquisitive, challenge convention, think...
Remote work
Hackajob
United States
3 days ago
Lead AI Generative Designer
...for a Lead Generative AI Designer. Your main tasks will be: ~Own the... ...performance. ~Build and optimize scalable... ...techniques, test hypotheses, evaluate their business value... ...clearly, challenge ideas and make practical... .... Benefits ~REMOTE OPPORTUNITY to work...
Remote work
Full time
Social Discovery Group
Remote
4 days ago
Sr. UI Animator / Motion Designer
$81 - $91 per hour
...Monday and Friday remote Duration: 12... ...interactive motion design (7-10 years... ...with modern "vibe coding" workflows and utilizing AI/scripting tools... ...delegating smaller tasks to focus on the... ...and engineers to build out cohesive... ...opportunity employer. We evaluate qualified...
Remote work
Hourly pay
Weekly pay
Temporary work
Work at office
Monday to Friday
Skill
Culver City, CA
4 days ago
Build & Release Engineer - AI Trainer
$104k - $208k
...We ask our team to design and solve a range of coding challenges used to train AI systems. We expect... ...work on programming tasks such as building applications and analyzing... ...DataAnnotation, a remote-first team working... ...coding and evaluation work. Our coding community...
Remote work
Hourly pay
Full time
Contract work
Flexible hours
DataAnnotation
Jacksonville, FL
15 days ago
ML Engineer - Model Evaluation Expert
$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered... ...Machine Learning Engineer — Model Evaluation & Experimentation Type... ...$90/hour Location: Remote Commitment: 35 hours... ...Responsibilities Design tasks by transforming real ML...
Remote work
Hourly pay
Weekly pay
Full time
Contract work
For contractors
Summer work
Mercor
Remote
22 hours ago
Product Design Expert - Vibecoding - AI Trainer
$70 - $80 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: Design Expert Type: Contract... ...0/hour Location: Remote Role... ...engineering collaboration. Build tasks across AI-assisted application... ..., natural-language-to-code workflows, and rapid...
Remote work
Contract work
Summer work
Mercor
Pennsauken, NJ
6 days ago
Senior Python Engineer — AI Task Designer & Evaluator
Mindrift is offering a project-based opportunity to craft and evaluate AI coding tasks. You will build a realistic developer environment—a virtual company... ..., docs, and conversations—to test AI agents. You design tasks from intermediate states, define what constitutes...
Dorado
New York, NY
1 day ago
Senior Frontend Engineer - Editor and Graphics
$95k - $200k
...Pitch You'll be building the content... ...is technically challenging, visually rewarding... ...We're a small remote team located... ...WebGL Turn design mockups into pixel... ...interactions Tackle hard frontend... ..., not just the tasks You... ...verbal You use AI tools to move faster...
Remote job
Full time
Home office
Visa sponsorship
Work visa
Flexible hours
Slate
United States
22 hours ago
AI Benchmark Designer: Advanced Statistical Challenges
...Statistics and Applied Mathematics Expert to design challenging graduate-level problems that require using specialized... ...You will test problems against cutting-edge AI models, refine them through iterative evaluation, and build tasks that require strategic planning and multi-...
Mercor
Los Angeles, CA
1 day ago
AI Builder, Principal Experience Designer
$130k - $232.32k
...follows.26WD100467, AI Builder,... ...an experience design leader who wants... ...enough to the build that your direction... ...credible and hard to dismiss. ResponsibilitiesResearch... ...Decide what to challenge: actively... ...Exposure to evaluative and usability... ...Alberta, CAN - Remote; California,...
Remote work
Full time
For contractors
Work experience placement
Autodesk
San Francisco, CA
18 hours ago
Senior Salesforce Developer
$185k - $205k
...role in the design, development,... ...collaborative, AI-driven... ...Systems team is to build and optimize... ..., conducting code reviews, and... ...handle multi-step tasks such as... ...country's biggest challenges - closing the... .... We value hard work and recognize... ...critically evaluate whether they...
Remote work
Local area
Immediate start
Work from home
Human Interest
United States
1 day ago
UX Designer for AI Training & Evaluation (Remote, Flexible)
$50 per hour
...Prolific is seeking Product Designers and UX Specialists to join their... ...role involves training and evaluating AI models using real design expertise... ...to complete paid tasks earning up to $50 per hour. Candidates... ...skills. Flexible hours and remote work are offered for this role...
Remote work
Hourly pay
Flexible hours
Prolific
Jacksonville, FL
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Coding Task Designer: Build Hard AI Evaluation Challenges. Be the first to apply!