Domain Experts: Paid Assessment on AI Prompt Design

$50 per hour

Temporary

Terac

San Francisco, CA

What You'll Do
Translate a familiar, complex workflow into a demanding prompt for an AI model Test your prompt using ChatGPT to identify where the model fails to produce a complete file Record your screen, camera, and microphone while thinking through the task Write a clear, structured rubric that allows a stranger to grade the AI's response
Who Should Apply
Deep knowledge of a specialized workflow from your job or personal life Access to a laptop or desktop computer Active ChatGPT account (the free tier is acceptable) Comfortable sharing a screen recording with audio and video during the task
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payment is issued as soon as your work is approved. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $50 one-time

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Domain Experts: Paid Assessment on AI Prompt Design in San Francisco, CA vacancy

Domain Expert - Art
...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is... ...seeking a highly qualified Art Domain Expert to evaluate and improve... ...challenging prompts, assess factual accuracy and reasoning... ...assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Turing
San Francisco, CA
2 days ago
Domain Expert - TV Show & Movies
...Evaluate and improve AI responses about film and television... ...TV Shows & Movies Domain Expert to evaluate and improve Large... ...Language Models (LLMs). You will design challenging prompts, assess factual accuracy and... ...Contractor assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Turing
San Francisco, CA
2 days ago
Domain Expert- Music
...Evaluate and improve AI responses in music theory and... ...a highly qualified Music Domain Expert to evaluate and improve Large... ...Language Models (LLMs). You will design challenging prompts, assess factual accuracy and... ...assignment (no medical/paid leave) Duration of contract...
Suggested
Contract work
Part time
For contractors
Turing
San Francisco, CA
2 days ago
Scientific Computing / Research Engineering Expert — Earth Sciences (Terminal Bench Science)
...Design scientific tasks for AI training in Earth Sciences. About Turing: Turing... ...experienced Earth Sciences experts to develop realistic, terminal... ...Python, R, Bash, Julia, or domain-specific scientific... ...Contractor assignment (no medical/paid leave) Duration of...
Suggested
Contract work
Part time
For contractors
Remote work
Turing
San Francisco, CA
2 days ago
Domain Expert - Python
...Design and build coding-agent benchmark tasks... ...'s fastest-growing AI companies, accelerating... ...high-quality data, expert human feedback, and... ...Package tasks with prompts, metadata, runnable... ...Code and Codex to assess utility completion... ...(no medical/paid leave) Duration...
Suggested
Contract work
Part time
For contractors
Freelance
Remote work
Worldwide
Turing
San Francisco, CA
8 days ago
Senior Domain Expert — Multi-Discipline AI Research Program
...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems... ...kernels, enterprise operations, security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-...
Contract work
AfterQuery
San Francisco, CA
14 days ago
Presentation Design Expert - Remote
...Description Creative & Design Specialist Role Type:... ...to evaluate and improve AI-generated creative... ...for AI training. Prior paid experience in human-data... ...workflows and tool usage. Assess elements such as... ...internet connection and readiness to begin promptly....
Remote job
For contractors
Worldwide
Flexible hours
YO AI Labs
San Francisco, CA
3 days ago
Domain Expert - Python
...Evaluate and improve AI responses using your domain expertise. About Turing... ...highly qualified Domain Experts (SMEs) to support the evaluation... ...-matter expertise to assess AI-generated responses,... ...knowledge gaps, design challenging prompts, and improve model accuracy...
Part time
Turing
San Francisco, CA
2 days ago
Board Game Reasoning Expert (AI Training & Evaluation)
...tasks to enhance AI reasoning skills.... ...Board Game Reasoning Experts to help train and... ...based reasoning tasks designed to evaluate AI... ...quality. Develop prompts, rubrics, and... ...assignment (no medical/paid leave)... ...# Take home Assessment Skills: Game...
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
2 days ago
UI/UX Designer Expert
...UI/UX designers to build the design evaluation and Figma... ...workflow scenarios frontier AI labs use to test model... ...AfterQuery builds the expert evaluation data that... ...and pay $60 to $120/hr , paid weekly via Stripe. Your... ...a decision. Written assessment. You may be asked to take...
Weekly pay
Contract work
Temporary work
For contractors
Live in
Remote work
10 hours per week
AfterQuery
San Francisco, CA
2 days ago
Scientific Computing / Research Engineering Expert — Engineering
$300 per unit
...Design terminal tasks to simulate real-world engineering workflows. Role... ...: We are staffing a frontier AI initiative that requires strong Engineering experts to develop realistic, terminal-... ...Contractor assignment (no medical/paid leave) Duration of contract : 5...
Contract work
Part time
For contractors
Turing
San Francisco, CA
2 days ago
Expert Senior Manager, Data Sciences, Software and Data Services, Coro
$164.5k - $219k
...Information Job Title Expert Senior Manager,... ...opportunity, designing effective sales... ...online capability assessments, and advanced analytics... ...work with major AI ecosystem partners... ...team applies to prompt design, evaluation... ...paycheckGenerous paid time off, including...
Permanent employment
Full time
Apprenticeship
Local area
Home office
3 days per week
Bain & Company
San Francisco, CA
3 days ago
Graphic Designer Expert
...Graphic designers with brand and typography depth to rate and prompt the image generation work frontier AI labs run. AfterQuery builds the expert evaluation data that frontier... ...pay $40 to $80/hr , paid weekly via Stripe.... ...decision. Written assessment. You may be asked to...
Weekly pay
Contract work
Temporary work
For contractors
Remote work
10 hours per week
AfterQuery
San Francisco, CA
2 days ago
Adversarial Prompt Expert
$65 per hour
...Employers Job seekers Career centers AI Skills Studio Handshake AI... ...Log in Sign up ADVERSARIAL PROMPT EXPERT Sign up now Up to $65/hr... ...is not limited to developing domain-specific prompts and evaluating... ...Handshake AI. Work with your Designated School Official to determine...
Hourly pay
Part time
Remote work
10 hours per week
Flexible hours
Handshake
San Francisco, CA
2 days ago
Domain Expert: Biology
...Evaluate AI nutrition content for scientific accuracy and relevance. About Turing:... ...dietary habits, and healthy eating. You’ll assess AI-generated content for scientific accuracy... ...assignment/freelancer (no medical/paid leave) Duration: 8 weeks Evaluation...
Part time
For contractors
Freelance
Remote work
Flexible hours
Turing
San Francisco, CA
2 days ago
Domain Expert: Chemistry
...chemistry problems and evaluate AI-generated solutions for... ...advisor to client teams assessing AI model outputs. This opportunity is designed for chemistry faculty... ...standards. Provide expert advisory support to... ...consulting, research-funding, or paid relationships with:...
Contract work
Part time
For contractors
Freelance
Remote work
Flexible hours
Turing
San Francisco, CA
2 days ago
Engineering Expert
...Design graduate-level life sciences problems based on... ...accelerator for frontier AI labs and a trusted... ...Sciences Subject Matter Experts to design advanced scientific... ...-level problems, assessments, or research exercises.... ...freelancer (no medical/paid leave) Duration of...
Contract work
Part time
For contractors
Freelance
Remote work
Flexible hours
Turing
San Francisco, CA
2 days ago
Chemistry Expert
...is seeking a Chemistry PhD Expert to help design, create and evaluate challenging... ...that train and refine our AI models. In this flexible,... ...authentic, thought-provoking prompts based on real-world chemical... ...apply your deep expertise to assess model responses. You'll play...
Temporary work
Remote work
Flexible hours
AfterQuery
San Francisco, CA
2 days ago
Remote Chemistry Expert — AI Training & Evaluation
$60 per hour
Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise... ...candidates will be invited to assess and review AI-generated... ...reach up to $60 per hour for paid tasks requiring one hour of work...
Remote job
Hourly pay
Flexible hours
Prolific
San Francisco, CA
3 days ago
AI Research Expert - Fully Remote | Upto $145/hr
$145 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications... ...research for alignment with domain principles and methodologies.... ...rubrics and benchmarks for assessing AI-generated tasks and solutions...
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
8 days ago
AI Consulting Expert - Remote
...Description Job Description Job Title: AI Consulting Domain Remote Job Type: Contractor (Part-... ...experienced AI Consulting Domain Experts to contribute their consulting expertise... .... Develop, refine, and evaluate prompts for AI models. Conduct quality assurance...
Remote job
Part time
For contractors
YO AI Labs
San Francisco, CA
3 days ago
AI Safety Red Teamer Expert
$70 - $84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models .... ...political content, and other sensitive domains. Document vulnerabilities and contribute...
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
12 days ago
STEM Domain Expert - Fully Remote | Upto $80/hr
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $... ...short interview and task (20–30 mins ). Paid onboarding time includes this and a few onboarding...
Remote job
Contract work
Summer work
Mercor
San Francisco, CA
8 days ago
Circuit Design Expert- Remote
...Job Description Circuit Design Expert Role Type: Contractor Location... ...Design Expert to support an AI training project involving... ...minute AI interview Technical assessment (if required) Hiring manager... ...Output-based compensation is paid per approved task. Selected experts...
Remote job
For contractors
Flexible hours
YO AI Labs
San Francisco, CA
3 days ago
Clinical Medicine Expert - AI Integration
$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Clinical Medicine Domain Expert Type: Contract Compensation... ...real medical practice. Design challenging clinical tasks and... ...Legal Hourly contractor Paid weekly via Stripe Connect...
Hourly pay
Weekly pay
Contract work
For contractors
Summer work
Mercor
San Francisco, CA
24 days ago
Professional Engineer Expert
...professional engineers to build the design and review scenarios frontier AI labs use to test model... .... AfterQuery builds the expert evaluation data that... ...pay $105 to $190/hr , paid weekly via Stripe. Your rate... ...gets a decision. Written assessment. You may be asked to take...
Weekly pay
Contract work
Temporary work
For contractors
Remote work
10 hours per week
AfterQuery
San Francisco, CA
2 days ago
Mathematics Expert (Master’s/Ph.D.)
...Design and solve advanced math problems to evaluate language models... ...research accelerator for frontier AI labs and a trusted partner for... ...design precise, closed-ended prompts, write reliable Python code,... .../freelancer (no medical/paid leave) Skills: Algebra, Calculus...
Contract work
Part time
For contractors
Freelance
Remote work
Turing
San Francisco, CA
2 days ago
Chemical Safety Expert for AI Model Safety Audit
$100 per hour
...chemical safety professionals to audit how AI models respond to sensitive questions in... ...with safety data sheets, exposure assessment, incident reports or regulatory review is... ...Develop AI Training Content: Create detailed prompts in various topics and responses to guide...
Permanent employment
Full time
SuperAnnotate
San Francisco, CA
2 days ago
Pharmacists as AI Domain Expert — Remote, Flexible Hours
$120 per hour
Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...
Remote job
Hourly pay
Work from home
Flexible hours
Prolific
San Francisco, CA
4 days ago
STEM Expert Task Designer AI Trainer
$2,000 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract... ...agents on expert-level technical work. Design open-ended tasks with no single right answer...
Full time
Contract work
Summer work
Remote work
Mercor
San Francisco, CA
9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Domain Experts: Paid Assessment on AI Prompt Design. Be the first to apply!