Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Psychiatry AI Evaluation & Case Design Specialist

mpathic

mpathic.ai is seeking experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. You will create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge. You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model #J-18808-Ljbffr mpathic

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Psychiatry AI Evaluation & Case Design Specialist in New York, NY vacancy
  • $50 per hour

    Prolific Academic Ltd is seeking Product Designers and UX Specialists to join our Expert Network to train and evaluate AI models using real design expertise. If selected, you’ll complete a brief test and, upon success, join Prolific as a paid participant to work on AI... 
    Suggested
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific Academic Ltd

    New York, NY
    20 hours ago
  • $70 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...and Jack Dorsey . Position: Editorial Deck & Document Designer (AI Evaluation) Type: Contract Compensation: $70$120/hour... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    5 days ago
  • $70 - $120 per hour

    Editorial, Deck & Document Designer (AI Evaluation) $70-120/hr $70-120/hr Mercor Full time, 40 hours a week About the role We are still writing this role up. The facts below are current. The facts Pay $70-120/hr Hours Full time, 40 hours a week Where Remote, United States... 
    Suggested
    Full time
    Remote work

    Training Turk

    New York, NY
    3 days ago
  • $70 - $120 per hour

    Mercor is seeking an Editorial, Deck & Document Designer (AI Evaluation) to join our remote team in the United States. This full-time, 40-hour-per-week role focuses on high‑quality editorial and visual design for decks and documents, with an emphasis on AI evaluation workflows... 
    Suggested
    Remote job
    Hourly pay
    Full time

    Training Turk

    New York, NY
    3 days ago
  •  ...seeking an experienced Healthcare SME for an hourly remote contractor role. You will create expert healthcare questions, design scoring rubrics, evaluate AI-generated content, and provide precise feedback to improve clinical accuracy and reliability. The role emphasizes... 
    Suggested
    Remote job
    Hourly pay
    For contractors

    Joinkeywork

    New York, NY
    1 day ago
  • $55 per hour

    OpenTrain AI, Inc. is seeking a part-time, remote contractor with advanced psychology knowledge to create domain-specific prompts and evaluate AI model responses for accuracy and clarity. You will research psychology topics with AI assistance, develop prompts to test knowledge... 
    Remote job
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    20 hours ago
  • $50 - $150 per hour

    Rise Data Labs seeks experienced healthcare professionals to contribute to AI training and evaluation projects on a remote basis. As an independent contractor, you will apply your domain expertise to craft realistic scenarios and clear reference answers. You will work... 
    Remote job
    Hourly pay
    For contractors

    Risedatalabs

    New York, NY
    1 day ago
  • Softechub is seeking a remote Graphic Designer contractor to evaluate AI-generated images and contribute to improving visual outputs. You will apply your eye for detail, assess image quality, and provide constructive feedback to help train next-generation AI systems. The... 
    Remote job
    For contractors

    Softechub

    New York, NY
    20 hours ago
  •  ...Digital Artist for a remote contractor role within the United States. You will contribute creative and technical expertise to evaluate and enhance AI-generated images for a cutting-edge project. Responsibilities include evaluating visuals, providing constructive feedback,... 
    Remote job
    Hourly pay
    For contractors

    Softechub

    New York, NY
    20 hours ago
  • $30 per hour

     ...Prolific Prolific is not just another player in the AI space – we are building the biggest pool of...  ...role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    New York, NY
    2 days ago
  • Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    20 hours ago
  • $21 - $65 per hour

    Compare original artwork and photographs with AI-generated images, identify visual flaws,...  ...in United States The work You will evaluate AI-generated images by comparing them with...  ..., compositing, 3D rendering, graphic design, color grading, or photography. A portfolio... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • Actalent is hiring a remote Visual Designer to evaluate frontier AI models on real design tasks such as interfaces, layouts, typography, and visual systems. You will create briefs from your practice, test them with AI tools, and judge outputs against professional standards... 
    Remote job

    Actalent

    New York, NY
    1 day ago
  • $60 - $90 per hour

    Acting and Animation Evaluation Specialist is a remote review track for evaluating AI outputs across animation review workflows. Reviewers grade craft, constraints...  ...team can train on it. Category: Creative, Media & Design Evaluation · Pay: $60-$90 / hr · Location: Remote... 
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • Partner Company, a remote-first AI research initiative, seeks a senior animator-evaluator to assess AI-generated performances and establish rigorous evaluation standards for realism. You will define benchmarks and rubrics, then apply them to character animation, facial... 
    Remote job

    Partner Company

    New York, NY
    1 day ago
  • A revolutionary AI research lab seeks Private Investigator Experts to design and evaluate investigative scenarios that will enhance AI models. This remote role involves developing challenging case studies and assessing AI responses for accuracy. Candidates should have... 
    Hourly pay
    Remote work

    AfterQuery Experts

    New York, NY
    1 day ago
  • $100k

    AI Prompt Designer - Remote Bright Vision Technologies is a technology consulting and software development...  ...of building reusable design patterns, evaluation frameworks, and developer tooling that scale across many teams and use cases. The ideal candidate has shipped LLM-... 
    Full time
    H1b
    Local area
    Remote work
    Visa sponsorship

    Latitude

    New York, NY
    1 day ago
  • Recraft is a graphic design research lab building state-of-the-art image...  ...early-stage concept ideation Evaluate generated outputs to identify quality gaps, edge cases, and opportunities for improvement...  ...feedback Hands-on experience with AI image tools (and ideally chat-... 
    Full time
    Contract work
    Freelance
    Worldwide
    Flexible hours

    Recraft

    New York, NY
    1 day ago
  •  ...us!The Role: As our Senior Instructional Designer, AI & Simulation Enablement, you'll drive...  ...licensed platforms and/or custom-built tools.Evaluate and pilot AI simulation vendors and in-...  ...constraints relevant to training use cases, translating this into realistic scope and... 
    Shift work

    Blink Health

    New York, NY
    4 days ago
  • Synthires is seeking a Senior Motion Designer and Creative Technologist for a remote, full-time role focused on AI model evaluation. You’ll craft real-world motion tasks, evaluate AI-generated outputs, and contribute to training data quality through rigorous feedback and... 
    Remote job
    Full time

    Synthires

    New York, NY
    1 day ago
  • AuraOne is seeking a remote VFX Artist / 3D Animator reviewer to evaluate AI outputs for 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrections to train the modeling team. This is a contractor... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    2 days ago
  • $70 - $120 per hour

     ...~40 h/week Open to: USA Join a leading AI lab's cutting-edge GenAI team to be at the...  .... We're seeking a talented Senior Motion Designer and Creative Technologist with deep, hands...  ...like Remotion, Canvas, SVG or Three.js. Evaluate AI-generated motion graphics and video... 
    Full time
    Contract work
    Weekday work

    Mercor

    New York, NY
    20 hours ago
  • $150k - $185k

     ...leaders who want to get AI right, Gladly is the...  ...Ulta Beauty, Gladly was designed for devotion, not deflection...  ...the fix, make their case clearly, and hold...  ...configure, steer, and evaluate AI agents. The shared design...  ...Product. This is not a specialist role in a single discipline... 
    Local area
    Remote work
    Home office

    Notable Capital

    New York, NY
    3 days ago
  • $203k - $214k

     ...work. ABOUT THE TEAM The Growth Design Team focuses on driving...  ...foundations for Growth and the AI workflows that put them to work...  ...principles, product experiences, evaluation, and evolving technology,...  ...declare tokens, states, and edge cases Take point on building agents... 
    Permanent employment
    Work at office
    Remote work
    Work from home
    Flexible hours

    Design Better Podcast

    New York, NY
    20 hours ago
  • $175.8k - $293k

     ...ordinary. Across BMC, our AI teams are building the...  ...for a Principal UX Designer to define and lead the...  ...-value agentic use cases and unmet needs. * Prototype...  ...and usability evaluation. * Define experience...  ...designers, and domain specialists from concept through production... 

    BMC Software

    New York, NY
    20 hours ago
  • $130k - $200k

    Position Summary AI Conversation Design Senior ConsultantOur Deloitte Sales & Service team empowers...  ...client-facing POCs and demos.Define evaluation frameworks and test suites for LLM-...  ...the facts and circumstances of each case. A reasonable estimate of the current... 
    Local area
    Visa sponsorship

    Deloitte

    New York, NY
    2 days ago
  •  ...online. We work across brand design, marketing, communications, and...  ...capabilities and business use cases into clear stories and compelling...  ...business audiences discover, evaluate, and take action. Partner...  ...help people understand and use AI. About OpenAI OpenAI is an AI... 
    Work at office
    Relocation package

    Precision Labs

    New York, NY
    1 day ago
  • $112.52k - $140.65k

     ...Responsibilities: Run generative and evaluative research across the customer...  ...worth doing, and help PMs and designers run simple studies themselves....  .... Hands-on fluency with AI tools across the research workflow...  ...new customers. A portfolio or case studies showing how your... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    PetPlace

    New York, NY
    1 day ago
  • $151.6k - $205k

     ...journey. We are passionate about designing, building, and launching...  ...the ASV team. It is Amazon's AI-powered content-to-commerce second...  ...business teams to develop use cases, define success metrics, and shape...  ...through data-driven evaluation and A/B testing.Basic qualifications... 
    Flexible hours

    Amazon

    New York, NY
    20 hours ago
  • $165k - $200k

    AI is rapidly transforming the world. As generative AI reshapes...  ...Engineering observability and evaluation platform , empowering AI engineers...  ...We're looking for a UX Design Engineer to own and perfect the...  ...engineers You think about edge cases, loading states, and empty states... 
    Remote job
    Contract work
    For contractors
    Work experience placement
    For subcontractor
    Work at office

    Arize

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Psychiatry AI Evaluation & Case Design Specialist. Be the first to apply!