Remote PhD Research Architect: AI Task Designer & Evaluator
Vettedlance
- Remote job
Vettedlance seeks PhD scientists in physics, chemistry, biology, microbiology and neuroscience to craft and evaluate research-level AI tasks. You will write questions with verified answers and assess model reasoning against rubrics, handling both physics and biology tracks as described. This is a remote, hourly contract with flexible part-time hours. Experts must have a PhD in a relevant field, a publication record, and fluent English. #J-18808-Ljbffr Vettedlance
$120k - $150k
...Overview Learning Architect - Curriculum & Learning Experience Designer (Remote) This role is with... ...delivered through a research-based, tech-... ...cognitive science, AI, and game-based learning... .... You might be: A PhD-level learning... ...since lunch A co-play task reveals...Remote workFor phdFull timeFlexible hours$70 per hour
Ethos is seeking experienced research lecturers to assist in training their latest... ...professional presentation and slide deck tasks. The role requires a PhD with 3+ years of active research and... ...of 5-20 hours per week, fully remote and on your own schedule, starting ASAP...Remote jobFor phdImmediate startFlexible hours$65 per hour
OpenTrain AI, Inc. is seeking a physics problem designer and evaluator for a remote, part-time contract. You will create physics problems across... ...accuracy. The role requires a master’s or PhD in physics, at least two years in academic research, fluent English, and the ability to...Remote jobFor phdHourly payContract workPart time$50 per hour
Prolific is seeking Product Designers and UX Specialists to join its... ...Expert Network for training and evaluating AI models. After a quick test,... ...and get paid for AI tasks, typically up to $50 per hour... ...Requirements include a BS/MS/PhD in HCI/UX or related field, at...Remote jobFor phdHourly payFlexible hours- Handshake AI is seeking experienced Political Science PhDs for flexible, hourly contract work to evaluate AI-generated content and provide structured feedback. This ongoing opportunity... ...include professors, postdocs, and senior PhD candidates with expertise in political...Remote jobFor phdHourly payContract workFlexible hours
- ...seeking Subject Matter Experts from legal practice to design and validate realistic Excel tasks that test AI performance on legal work. Tasks draw from disputes,... ...damages calculations and spend trackers. This fully remote independent contractor role starts immediately and...Remote jobWeekly payFor contractorsImmediate start
- ...Research Synthesis Task Evaluator is a remote review track for evaluating AI outputs across research synthesis task research review reasoning, calculations, and research... ...drift to the program lead. Nice to have PhD, postdoc, or industry research experience in the...Remote jobFor phdHourly payFor contractors10 hours per week
- Synthires seeks PhD-level scientists with hands-on research to design and evaluate challenging AI-focused problems from their own research areas, and to develop verified solutions... ...to advanced AI system development in a remote, worldwide setting. #J-18808-Ljbffr...Remote jobFor phdWorldwide
- ...Arlo’s deep expertise in AI- and CV-powered... ...user experience, product design, and innovative wireless... ...seeking an experienced UX Researcher to lead critical research... ...Experience Master’s or PhD degree in Psychology,... ...collaborating effectively with remote teams. Research...Remote workFor phdContract work
- ...the firm. We're fully remote, with team members across... ...role Ondo's user research team is small but mighty... ...from product, design, GTM and leadership. Turn... ...with product data. Evaluate AI-assisted experiences. Design... ...products. A master’s or PhD in a quantitative field...Remote workFor phdFull timeFlexible hours
$84 per hour
...technical talent with leading AI research labs. Headquartered in San... ...: $84/hour Location: Remote Commitment: 10–40 hours/... ...Role Responsibilities Evaluate advanced scientific problems... ...Qualifications Must-Have PhD in Computational Materials...Remote workFor phdContract workSummer work$159k - $230k
Develop a research roadmap addressing product and business questions using methods such as remote in-depth interviews, diary studies, prototype testing... ...:Master's degree or PhD in Human-Computer Interaction... ...Google Ads is at the forefront of AI innovation, applying cutting-...Remote workFor phd$130.1k - $176k
...seeking a mixed-methodology researcher to join our team. We... ...-based building toward AI-augmented, agent-... ...research — from study design through synthesis — to... ...lab-based user testing, remote testing, iterative prototype... ...methods within a study- PhD in a Social Science/...Remote workFor phdWork experience placementFlexible hoursShift work$80 per hour
...Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and... ...task statement, define held-out evaluation workloads and per-metric pass thresholds...Remote workFor phdContract work- OpenTrain AI, Inc. is seeking a Logistics And Planning Professionals AI Evaluator for a remote, part-time engagement in the United States. You will create prompts grounded in... ...judge whether AI outputs reflect real-world tasks. Flexible asynchronous schedule and a...Remote jobPart timeFlexible hours
- Anyone AI Inc. is seeking Chemistry experts to design advanced, deterministic problems for frontier AI models. You will craft tasks with exactly one verifiable answer and provide fully verified solutions, leveraging domain knowledge in computational chemistry and chemical...Remote jobFor phd
$50 - $150 per hour
...Canada + 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative reasoning. This is remote, flexible contract work where... ...clearly Nice to Have Research experience (academic or industry...Remote workFor phdContract workTemporary workFlexible hours$66 - $84 per hour
...Science Benchmark Specialist for a remote, contract engagement. The... ...hour. You will create and evaluate CS questions, rate difficulty... ...flag any issues in verification tasks. A PhD or doctoral candidate in CS/... ...theory, algorithms, systems design, and ML knowledge are essential...Remote jobFor phdHourly payContract work10 hours per week- Location: Remote (approved countries) Type: Independent... ...Engineering AI Safety Hazmat... ...paid hourly or per task depending on the engagement... ...the Role AI Safety Evaluation Project | Remote |... ..., laboratory research, engineering, blast... ...SMEs and Auditors PhD or equivalent advanced...Remote workFor phdHourly payContract workFor contractors
$180k - $207k
...seeking a Principal AI & ML Architect to design and build the AI and... ...layers Guardrails, evaluation, observability, and... ...quantitative field. Master’s or PhD is strongly preferred... ...Prioritize multiple tasks and projects... ...Terms, please see here #LI-REMOTE #LI-CB1...Remote workFor phdFull timeWork at office$35 - $105 per hour
Compare real and AI-generated images and pinpoint flaws in lighting, composition... ..., texture and realism. Work is remote and part-time, and you start paid tasks after a short recorded interview.... ...need Professional photography, design or art background A trained eye for...Remote workHourly payWeekly payContract workPart timeFor contractorsFlexible hours$30 per hour
...another player in the AI space – we are building... ...35,000 AI developers, researchers, and organizations use... ...Graphic and Visual Designers to act as Domain Experts... ...Experts for a high-level AI evaluation project. AI models are... ...tackle complex design tasks such as layout,...Remote workWork from homeFlexible hours$201.3k - $352.3k
...automated a tedious task for his coworker... ...is the AI control tower for... ...outcome reliability.• Design model-agnostic... ...benchmarks and evaluation methods for tool... ...turning ambiguous research questions into... ...master's degree or PhD in computer... ...personas (flexible, remote, or required in...Remote workFor phdWork at officeImmediate startFlexible hours$154k - $180k
...tooling, including AI, thoughtfully... ...(UX) Researcher, Mixed Methods... ...combining generative, evaluative, and quantitative... ...with Product, Design, and other partners... ...’s degree, or PhD in Psychology,... ...made up of remote employees who live... ...computer-centric tasks. onX will...Remote jobFor phdPermanent employmentFull timeWork at officeLocal areaFlexible hoursShift work$175k - $190k
..., Software AG’s AI-enabled process... ...you, join us. AI Architect Full timeLocation... ...East Coast, Remote.Software AG customers... ....Solution Design & Architecture:... ...Design, build, and evaluate prototypes that... ...such as Masters or PhD is preferred.Technical... ...solve complex tasks.Effective...Remote workFor phdWork experience placementHome office- Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review cases, score... ...contact or malpractice exposure. Contributors work remotely, choose tasks, and earn fixed per-task rates plus onboarding rewards...Remote jobFor contractorsFlexible hours
- Prolific is seeking fluent Kannada speakers to act as evaluators for AI training tasks conducted remotely with flexible hours. You will listen to audio, compare text and voice, and rate naturalness and cultural accuracy, helping AI understand Kannada nuances. Tasks are...Remote jobFlexible hours
- Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases,... ...reasoning quality, and write concise rationales. This is a task-based, independent contractor role with fully self-...Remote jobFor contractorsFlexible hours
- ...responsibility for research methodologies that... ..., interviews, task analysis, field and... ...is responsible for designing, planning, implementing... ...techniques to evaluate product requirements... ...user testing, remote testing, field research... ...:· Masters or PhD degree in Cognitive...Remote workFor phdWork experience placement
$125k - $225k
...world’s most advanced AI-native platform. We work... ...Intelligence and Threat Research Work closely with... ...reliability on real security tasks Devise AI agents and... ..., and experimental design PhD-level depth of understanding... ..., and concepts #LI-Remote #LI-RC1 Benefits...Remote workFor phdPermanent employmentWork experience placementWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote PhD Research Architect: AI Task Designer & Evaluator. Be the first to apply!
- junior designer remote New York, NY
- brand designer New York, NY
- travel designer New York, NY
- remote character designer New York, NY
- civil designer New York, NY
- senior brand designer New York, NY
- weekend designer New York, NY
- junior brand designer New York, NY
- environmental designer New York, NY
- senior exhibit designer New York, NY






