Domain Experts: Paid Assessment on AI Prompt Design

$50 per hour

Temporary

Terac

What You'll Do

Translate a familiar, complex workflow into a demanding prompt for an AI model Test your prompt using ChatGPT to identify where the model fails to produce a complete file Record your screen, camera, and microphone while thinking through the task Write a clear, structured rubric that allows a stranger to grade the AI's response

Who Should Apply
Deep knowledge of a specialized workflow from your job or personal life Access to a laptop or desktop computer Active ChatGPT account (the free tier is acceptable) Comfortable sharing a screen recording with audio and video during the task

Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payment is issued as soon as your work is approved. We are unable to support H1-B or STEM OPT candidates at this time.

Pay: $50 one-time

Apply

Vacancy posted 13 days ago

Similar jobs that could be interesting for youBased on the Domain Experts: Paid Assessment on AI Prompt Design in San Francisco, CA vacancy

Domain Expert - Art
...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is... ...seeking a highly qualified Art Domain Expert to evaluate and improve... ...challenging prompts, assess factual accuracy and reasoning... ...assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Turing
San Francisco, CA
13 days ago
Senior Domain Expert — Multi-Discipline AI Research Program
...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems... ...kernels, enterprise operations, security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-...
Suggested
Contract work
AfterQuery
San Francisco, CA
13 days ago
Scientific Computing / Research Engineering Expert — Earth Sciences (Terminal Bench Science)
...Design scientific tasks for AI training in Earth Sciences. About Turing: Turing... ...experienced Earth Sciences experts to develop realistic, terminal... ...Python, R, Bash, Julia, or domain-specific scientific... ...Contractor assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Remote work
Turing
San Francisco, CA
2 days ago
Domain Expert - Python
...Evaluate and improve AI responses using your domain expertise. About Turing... ...highly qualified Domain Experts (SMEs) to support the evaluation... ...-matter expertise to assess AI-generated responses,... ...knowledge gaps, design challenging prompts, and improve model accuracy...
Suggested
Part time
Turing
San Francisco, CA
2 days ago
Domain Expert- Politics
...Evaluate and improve AI responses in political science... ...highly qualified Politics Domain Expert to evaluate and improve Large... ...Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning... ...assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Turing
San Francisco, CA
13 days ago
Domain Expert - TV Show & Movies
...Evaluate and improve AI responses about film and television... ...TV Shows & Movies Domain Expert to evaluate and improve Large... ...Language Models (LLMs). You will design challenging prompts, assess factual accuracy and... ...Contractor assignment (no medical/paid leave) Duration of...
Contract work
Part time
For contractors
Turing
San Francisco, CA
13 days ago
Expert Senior Manager, Data Sciences, Software and Data Services, Coro
$164.5k - $219k
...Information Job Title Expert Senior Manager,... ...opportunity, designing effective sales... ...online capability assessments, and advanced analytics... ...work with major AI ecosystem partners... ...team applies to prompt design, evaluation... ...paycheckGenerous paid time off, including...
Permanent employment
Full time
Apprenticeship
Local area
Home office
3 days per week
Bain & Company
San Francisco, CA
7 days ago
Scientific Computing / Research Engineering Expert — Engineering
$300 per unit
...Design terminal-based engineering tasks for AI training and evaluation. Role Overview: We are staffing a frontier... ...that requires strong Engineering experts to develop realistic, terminal-based... ...Contractor assignment (no medical/paid leave) Duration of contract : 5 week...
Contract work
Part time
For contractors
Turing
San Francisco, CA
2 days ago
Domain Expert - Python
...Turing is one of the world’s fastest-growing AI companies accelerating the advancement and... ..., you might have to put together a prompt that contains code and questions, then elaborate... ...type : Contractor assignment (no medical/paid leave) Duration of contract : 3...
Contract work
For contractors
Work experience placement
Freelance
Remote work
Turing
San Francisco, CA
2 days ago
STEM PhD Expert for AI Reasoning & Evaluation
$50 - $150 per hour
...Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work... ...You may contribute your expertise by: Assessing the factuality and relevance of domain-specific text produced by AI models Crafting...
Contract work
Temporary work
Remote work
Flexible hours
Braintrust
San Francisco, CA
2 days ago
Domain Expert - Python
...accelerator for frontier AI labs and a trusted... ...Sciences Subject Matter Experts to develop advanced scientific... ...Responsibilities Design novel, graduate-level... ...-level problems, assessments, or research exercises.... ...freelancer (no medical/paid leave) Duration of...
Contract work
Part time
For contractors
Freelance
Remote work
Flexible hours
Turing
San Francisco, CA
2 days ago
AI Safety Red Teamer Expert
$70 - $84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models .... ...political content, and other sensitive domains. Document vulnerabilities and contribute...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
10 days ago
Domain Expert: Chemistry
...chemistry problems and evaluate AI-generated solutions for... ...advisor to client teams assessing AI model outputs. This opportunity is designed for chemistry faculty... ...standards. Provide expert advisory support to... ...consulting, research-funding, or paid relationships with:...
Contract work
Part time
For contractors
Freelance
Remote work
Flexible hours
Turing
San Francisco, CA
2 days ago
Remote Chemistry Expert — AI Training & Evaluation
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise... ...candidates will be invited to assess and review AI-generated... ...reach up to $60 per hour for paid tasks requiring one hour of work...
Remote job
Hourly pay
Flexible hours
Prolific
San Francisco, CA
2 days ago
AI Research Expert - Fully Remote | Upto $145/hr
$145 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications... ...research for alignment with domain principles and methodologies.... ...rubrics and benchmarks for assessing AI-generated tasks and solutions...
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
7 days ago
STEM Domain Expert - Fully Remote | Upto $80/hr
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $... ...short interview and task (20–30 mins ). Paid onboarding time includes this and a few onboarding...
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
7 days ago
Clinical Medicine Expert - AI Integration
$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Clinical Medicine Domain Expert Type: Contract Compensation... ...real medical practice. Design challenging clinical tasks and... ...Legal Hourly contractor Paid weekly via Stripe Connect...
Hourly pay
Weekly pay
Contract work
For contractors
Summer work
Mercor
San Francisco, CA
23 days ago
Chemical Safety Expert for AI Model Safety Audit
$100 per hour
...chemical safety professionals to audit how AI models respond to sensitive questions in... ...with safety data sheets, exposure assessment, incident reports or regulatory review is... ...Develop AI Training Content: Create detailed prompts in various topics and responses to guide...
Permanent employment
Full time
SuperAnnotate
San Francisco, CA
2 days ago
Child Psychiatry Expert - AI Safety
$80 - $150 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...conversations and provide expert judgment to calibrate automated evaluation... .... Advise on best practices for assessing AI behavior across key mental health domains, including suicide risk,...
Contract work
Traineeship
Summer work
Remote work
Mercor
San Francisco, CA
29 days ago
Board Game Reasoning Expert (AI Training & Evaluation)
...tasks to enhance AI reasoning skills.... ...Board Game Reasoning Experts to help train and... ...based reasoning tasks designed to evaluate AI... ...quality. Develop prompts, rubrics, and... ...assignment (no medical/paid leave)... ...# Take home Assessment Skills: Game...
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
13 days ago
Pharmacists as AI Domain Expert — Remote, Flexible Hours
$120 per hour
Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...
Remote job
Hourly pay
Work from home
Flexible hours
Prolific
San Francisco, CA
3 days ago
UI/UX Designer Expert
...UI/UX designers to build the design evaluation and Figma... ...workflow scenarios frontier AI labs use to test model... ...AfterQuery builds the expert evaluation data that... ...and pay $60 to $120/hr , paid weekly via Stripe. Your... ...a decision. Written assessment. You may be asked to take...
Weekly pay
Contract work
For contractors
Live in
Remote work
10 hours per week
AfterQuery
San Francisco, CA
13 days ago
STEM Expert Task Designer AI Trainer
$2,000 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract... ...agents on expert-level technical work. Design open-ended tasks with no single right answer...
Full time
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
8 days ago
Expert Senior Manager, AI Engineering
$293.5k
...Information Job Title Expert Senior Manager, AI Engineering Job ID 104... ...team works with clients to design and deliver AI-powered solutions... ...including RAG, agents, prompt engineering, and AI safetyWhat... ...impacting your paycheck Generous paid time off, including parental...
Permanent employment
Full time
Apprenticeship
Work at office
Local area
Work from home
Home office
3 days per week
Bain & Company
San Francisco, CA
4 days ago
Subject Matter Expert - VFX Artists (Remote - San Francisco)
$15 - $30 per hour
...VFX/CGI – Fully Remote Subject Matter Expert We are inviting 3D Artists and VFX experts with experience creating computer generated scenes... .... This is an exciting opportunity to contribute to improving AI systems for video generation and to impact how AI models understand...
Hourly pay
Remote work
Prolific
San Francisco, CA
3 days ago
Expert Interviewer - AI Trainer
$50 - $60 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Expert Interviewer Type: Contract Compensation... ...interviews with shortlisted experts. Assess technical depth, communication, and AI-evaluation...
Contract work
Summer work
Remote work
Weekday work
Mercor
San Francisco, CA
22 days ago
Software Engineer - AI Expert
$103k - $143k
...economics, or quantitative finance ~ Prior AI experience is not required... ...unsupported assumptions, risks, and edge cases Assess valuations, forecasts, investment analyses... ...building intelligence for frontier AI. We offer paid, project-based opportunities to help train...
Full time
Temporary work
Remote work
Flexible hours
Alpheva AI
San Francisco, CA
9 days ago
Education Expert - AI Trainer
$60 per hour
...and technical talent with leading AI research labs. Headquartered in... ...instruction-following in the Education domain. Develop and refine evaluation rubrics to assess AI-generated educational content... ...Collaborate with subject matter experts to ensure task relevance and...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
29 days ago
Software & Firmware Engineering Experts
$100 - $120 per hour
...support an advanced engineering and AI research initiative with a... ...hands-on engineers who have designed, implemented, integrated, tested... .../software integration . Assess the technical correctness, robustness... ...in at least one core domain: embedded firmware and real-time...
Part time
Remote work
Flexible hours
Mercor
San Francisco, CA
2 days ago
Graphic Designer Expert
...Graphic designers with brand and typography depth to rate and prompt the image generation work frontier AI labs run. AfterQuery builds the expert evaluation data that frontier... ...pay $40 to $80/hr , paid weekly via Stripe.... ...decision. Written assessment. You may be asked to...
Weekly pay
Contract work
For contractors
Remote work
10 hours per week
AfterQuery
San Francisco, CA
13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Domain Experts: Paid Assessment on AI Prompt Design. Be the first to apply!