Psychiatry AI Evaluation & Case Design Specialist
mpathic
mpathic.ai is seeking experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. You will create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge. You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model #J-18808-Ljbffr mpathic
$50 per hour
Prolific Academic Ltd is seeking Product Designers and UX Specialists to join our Expert Network to train and evaluate AI models using real design expertise. If selected, you’ll complete a brief test and, upon success, join Prolific as a paid participant to work on AI...SuggestedRemote jobHourly payWork from homeFlexible hours$70 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...and Jack Dorsey . Position: Editorial Deck & Document Designer (AI Evaluation) Type: Contract Compensation: $70$120/hour...SuggestedFull timeContract workSummer workRemote work$70 - $120 per hour
Editorial, Deck & Document Designer (AI Evaluation) $70-120/hr $70-120/hr Mercor Full time, 40 hours a week About the role We are still writing this role up. The facts below are current. The facts Pay $70-120/hr Hours Full time, 40 hours a week Where Remote, United States...SuggestedFull timeRemote work$70 - $120 per hour
Mercor is seeking an Editorial, Deck & Document Designer (AI Evaluation) to join our remote team in the United States. This full-time, 40-hour-per-week role focuses on high‑quality editorial and visual design for decks and documents, with an emphasis on AI evaluation workflows...SuggestedRemote jobHourly payFull time- ...seeking an experienced Healthcare SME for an hourly remote contractor role. You will create expert healthcare questions, design scoring rubrics, evaluate AI-generated content, and provide precise feedback to improve clinical accuracy and reliability. The role emphasizes...SuggestedRemote jobHourly payFor contractors
$55 per hour
OpenTrain AI, Inc. is seeking a part-time, remote contractor with advanced psychology knowledge to create domain-specific prompts and evaluate AI model responses for accuracy and clarity. You will research psychology topics with AI assistance, develop prompts to test knowledge...Remote jobHourly payPart timeFor contractors$50 - $150 per hour
Rise Data Labs seeks experienced healthcare professionals to contribute to AI training and evaluation projects on a remote basis. As an independent contractor, you will apply your domain expertise to craft realistic scenarios and clear reference answers. You will work...Remote jobHourly payFor contractors- Softechub is seeking a remote Graphic Designer contractor to evaluate AI-generated images and contribute to improving visual outputs. You will apply your eye for detail, assess image quality, and provide constructive feedback to help train next-generation AI systems. The...Remote jobFor contractors
- ...Digital Artist for a remote contractor role within the United States. You will contribute creative and technical expertise to evaluate and enhance AI-generated images for a cutting-edge project. Responsibilities include evaluating visuals, providing constructive feedback,...Remote jobHourly payFor contractors
$30 per hour
...Prolific Prolific is not just another player in the AI space – we are building the biggest pool of... ...role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image...Remote workWork from homeFlexible hours- Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include...Remote jobFor contractors
$21 - $65 per hour
Compare original artwork and photographs with AI-generated images, identify visual flaws,... ...in United States The work You will evaluate AI-generated images by comparing them with... ..., compositing, 3D rendering, graphic design, color grading, or photography. A portfolio...Hourly payContract workPart timeFor contractorsRemote work- Actalent is hiring a remote Visual Designer to evaluate frontier AI models on real design tasks such as interfaces, layouts, typography, and visual systems. You will create briefs from your practice, test them with AI tools, and judge outputs against professional standards...Remote job
$60 - $90 per hour
Acting and Animation Evaluation Specialist is a remote review track for evaluating AI outputs across animation review workflows. Reviewers grade craft, constraints... ...team can train on it. Category: Creative, Media & Design Evaluation · Pay: $60-$90 / hr · Location: Remote...For contractorsRemote work10 hours per week- Partner Company, a remote-first AI research initiative, seeks a senior animator-evaluator to assess AI-generated performances and establish rigorous evaluation standards for realism. You will define benchmarks and rubrics, then apply them to character animation, facial...Remote job
- A revolutionary AI research lab seeks Private Investigator Experts to design and evaluate investigative scenarios that will enhance AI models. This remote role involves developing challenging case studies and assessing AI responses for accuracy. Candidates should have...Hourly payRemote work
$100k
AI Prompt Designer - Remote Bright Vision Technologies is a technology consulting and software development... ...of building reusable design patterns, evaluation frameworks, and developer tooling that scale across many teams and use cases. The ideal candidate has shipped LLM-...Full timeH1bLocal areaRemote workVisa sponsorship- Recraft is a graphic design research lab building state-of-the-art image... ...early-stage concept ideation Evaluate generated outputs to identify quality gaps, edge cases, and opportunities for improvement... ...feedback Hands-on experience with AI image tools (and ideally chat-...Full timeContract workFreelanceWorldwideFlexible hours
- ...us!The Role: As our Senior Instructional Designer, AI & Simulation Enablement, you'll drive... ...licensed platforms and/or custom-built tools.Evaluate and pilot AI simulation vendors and in-... ...constraints relevant to training use cases, translating this into realistic scope and...Shift work
- Synthires is seeking a Senior Motion Designer and Creative Technologist for a remote, full-time role focused on AI model evaluation. You’ll craft real-world motion tasks, evaluate AI-generated outputs, and contribute to training data quality through rigorous feedback and...Remote jobFull time
- AuraOne is seeking a remote VFX Artist / 3D Animator reviewer to evaluate AI outputs for 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrections to train the modeling team. This is a contractor...Remote jobFor contractors10 hours per week
$70 - $120 per hour
...~40 h/week Open to: USA Join a leading AI lab's cutting-edge GenAI team to be at the... .... We're seeking a talented Senior Motion Designer and Creative Technologist with deep, hands... ...like Remotion, Canvas, SVG or Three.js. Evaluate AI-generated motion graphics and video...Full timeContract workWeekday work$150k - $185k
...leaders who want to get AI right, Gladly is the... ...Ulta Beauty, Gladly was designed for devotion, not deflection... ...the fix, make their case clearly, and hold... ...configure, steer, and evaluate AI agents. The shared design... ...Product. This is not a specialist role in a single discipline...Local areaRemote workHome office$203k - $214k
...work. ABOUT THE TEAM The Growth Design Team focuses on driving... ...foundations for Growth and the AI workflows that put them to work... ...principles, product experiences, evaluation, and evolving technology,... ...declare tokens, states, and edge cases Take point on building agents...Permanent employmentWork at officeRemote workWork from homeFlexible hours$175.8k - $293k
...ordinary. Across BMC, our AI teams are building the... ...for a Principal UX Designer to define and lead the... ...-value agentic use cases and unmet needs. * Prototype... ...and usability evaluation. * Define experience... ...designers, and domain specialists from concept through production...$130k - $200k
Position Summary AI Conversation Design Senior ConsultantOur Deloitte Sales & Service team empowers... ...client-facing POCs and demos.Define evaluation frameworks and test suites for LLM-... ...the facts and circumstances of each case. A reasonable estimate of the current...Local areaVisa sponsorship- ...online. We work across brand design, marketing, communications, and... ...capabilities and business use cases into clear stories and compelling... ...business audiences discover, evaluate, and take action. Partner... ...help people understand and use AI. About OpenAI OpenAI is an AI...Work at officeRelocation package
$112.52k - $140.65k
...Responsibilities: Run generative and evaluative research across the customer... ...worth doing, and help PMs and designers run simple studies themselves.... .... Hands-on fluency with AI tools across the research workflow... ...new customers. A portfolio or case studies showing how your...Temporary workWork at officeRemote workFlexible hours$151.6k - $205k
...journey. We are passionate about designing, building, and launching... ...the ASV team. It is Amazon's AI-powered content-to-commerce second... ...business teams to develop use cases, define success metrics, and shape... ...through data-driven evaluation and A/B testing.Basic qualifications...Flexible hours$165k - $200k
AI is rapidly transforming the world. As generative AI reshapes... ...Engineering observability and evaluation platform , empowering AI engineers... ...We're looking for a UX Design Engineer to own and perfect the... ...engineers You think about edge cases, loading states, and empty states...Remote jobContract workFor contractorsWork experience placementFor subcontractorWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychiatry AI Evaluation & Case Design Specialist. Be the first to apply!
- ai data scientist New York, NY
- ai scientist New York, NY
- junior designer remote New York, NY
- brand designer New York, NY
- travel designer New York, NY
- remote character designer New York, NY
- civil designer New York, NY
- senior brand designer New York, NY
- weekend designer New York, NY
- junior brand designer New York, NY



