Psychiatry Evaluation Specialist [Remote]
AuraOne Human Data
- Remote job
Psychiatry Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch psychiatry. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.
Why this role matters
Psychiatry AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.
Responsibilities
- Review AI outputs against current psychiatry clinical guidelines and standard of care for Psychiatry Evaluation Specialist assignments.
- Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
- Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
- Capture the corrected clinical reasoning so the modeling team can train on it.
- Adjudicate disputed cases against published evidence or specialty guidelines.
- Maintain reviewer-quality scores in weekly inter-rater calibration cycles.
Qualifications
- Active or recent license / board certification in psychiatry or an adjacent specialty for Psychiatry Evaluation Specialist work.
- Hands-on clinical experience reading patient cases and writing structured assessments.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites guidelines, evidence, or standard of care.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's differential-diagnosis reasoning on a psychiatry case and write a 2-3 sentence assessment.
- Flag a dosing miscalculation with the right severity tag and corrected dose.
- Adjudicate a disputed case between two reviewers using current specialty guidelines.
- Audit a 25-case batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior work as a guideline reviewer, peer reviewer, or clinical educator.
- Familiarity with AI-assisted clinical decision support and its failure modes.
- Bilingual clinical experience for non-English patient cases.
Skills
- Clinical reasoning
- Guideline review
- Patient-safety assessment
- Structured clinical writing
- Psychiatry
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...Government Agencies. Learn More About ProSidian Consulting at .Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0139138] for Program Support on a Exempt W2: No Overtime Pay Basis Contract Contingent generally located across...SuggestedFull timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
- ...given the means and mentorship needed to succeed, and your creativity will be rewarded.About the PositionThe Monitoring and Evaluation (M&E) Specialist will provide technical support to the Office of Monitoring and Evaluation (OME), Division of Global Health Protection (...SuggestedWork at officeRemote work
$70k - $140k
...Program Evaluation SpecialistWe are seeking driven, thoughtful candidates with experience in program evaluation to support impactful initiatives... ...the U.S. Department of State (DOS). As a Program Evaluation Specialist with Censeo, you will support quantitative and qualitative...SuggestedFull timeWork at officeRemote workWork from homeFlexible hoursNight shift$75.22k - $94.02k
...Impact Evaluation Specialist IIWhen you join Wounded Warrior Project® (WWP), you're committing to making a difference. We make a commitment to you, too – helping you to find that spark, ignite your passion to serve, and embark on a career with meaning and purpose.The Wounded...SuggestedTemporary workWork at office- ...Monitoring and Evaluation Support for El Salvador Team Lead Peace is our commitment. The United States Institute of Peace represents the American people's shared values and commitment to peace worldwide. We know that Peace is Security – it advances both U.S. and international...SuggestedFull timeContract workFor contractorsWork experience placementWork at officeLocal areaWork from homeWorldwideHome officeNight shift
$24 - $30 per hour
Mercor is seeking a Moonlight MCQA - Arabic Generalist to draft Arabic MCQs for an AI evaluation dataset. This contract role offers remote work with flexible hours and a process including AI interview based on your resume. Must hold a master's or PhD, 2-6 years of experience...Remote jobHourly payContract workFreelanceFlexible hours- ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...Full timeRemote work
$5,540 - $5,780 per month
...Reporting to the Director of Graduate Admissions and Program Evaluations (GAPE) in the College of Graduate Studies, this position is responsible... ...are completed efficiently and on schedule. The Evaluation Specialist interprets and applies complex policies, handles exceptions,...Permanent employmentFull timeWork experience placementInternshipWork at officeVisa sponsorship- OpenTrain AI is seeking a GPU Kernel Evaluation Expert to assess the quality, correctness, and completeness of GPU and accelerator kernel development tasks used to train and evaluate frontier AI models. You will evaluate numerical correctness, benchmarking fairness, task...Remote jobContract work
$5,540 - $5,780 per month
...Reporting to the Director of Graduate Admissions and Program Evaluations (GAPE) in the College of Graduate Studies, this position is responsible... ...are completed efficiently and on schedule. The Evaluation Specialist is responsible for interpreting and applying complex policies...Permanent employmentFull timeWork experience placementInternshipWork at officeImmediate startVisa sponsorship- ...consulting firm in Colby, Kansas, is seeking a Nurse Practitioner or Physician Assistant to conduct examinations for veteran compensation evaluations. Responsibilities include conducting assessments, reviewing medical histories, and completing reports, all while collaborating...Remote jobWork from homeFlexible hours
- YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world...Remote work
- ...Office Specialist Vi: Transcript Evaluator St. Edward's University of Austin, Texas invites applications for the position of Office Specialist VI: Transcript Evaluator. The Office Specialist VI: Transcript Evaluator provides accurate, timely evaluations of academic...Temporary workInternshipWork at officeImmediate startFlexible hours
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...Remote jobContract workImmediate startFlexible hours
$70 - $110 per hour
...Role Overview Evaluate and help improve AI systems by applying practical project management expertise to AI-generated content and workflows... ...~4+ years of experience as a Project Management Specialist, Project Manager, Technical Project Manager, Program Manager,...Hourly payImmediate startRemote work$19 per hour
Clinic Assistant - Veterans Evaluation Services (VES) Maximus is currently hiring a Clinic Assistant to join our Veterans Evaluation Services (VES) team in Mississippi. This part‑time position supports providers and veterans on exam days by assisting as needed, addressing...Hourly payPart timeCurrently hiringWork at officeLocal areaHome officeFlexible hoursShift workWeekend work- ...AI-focused manufacturing project. You will apply your expertise in Fusion 360, CAM, CNC machining, and manufacturing workflows to evaluate processes and AI-generated recommendations. No prior AI experience is required, but you will provide critical feedback, develop evaluation...Remote jobFor contractors
- A national recruiting firm is seeking an Online Candidate Specialist in Austin, TX. The role involves evaluating resumes for technical positions, partnering with recruiters, and maintaining data integrity in an applicant tracking system. Ideal candidates will have 2-4...
- Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny....Remote job
- ...a fully remote School Psychologist to support a Colorado district for the 2026-2027 year. The role focuses on psychoeducational evaluations and eligibility processes across the district on a part-time, independent contractor basis. Responsibilities include conducting cognitive...Remote jobPart timeFor contractors
- ...Job Description Job Description Graham Technologies is seeking an experienced Project Manager / Senior Monitoring & Evaluation Specialist to support global public health monitoring and evaluation initiatives for a federal client. This role combines hands-on monitoring...Remote workFlexible hours
$55k - $58.6k
...Junior Specialist - Berendzen Lab Job #JPF06013 Psychiatry / SCHOOL OF MEDICINE / UC San Francisco Application Window Open date: March 30, 2026 Most recent review date: Tuesday, Apr 14, 2026 at 11:59pm (Pacific Time) Applications received after this date...Local area$73.6k - $110.3k
...and surrounding regions. The Government & Community Relations Specialist will play a pivotal role focused on Honda's external presence... ...stakeholders and government officials, representing Honda at events, evaluating community engagement and branding opportunities, supporting...Full timeTemporary workWork experience placementWork at officeLocal areaRemote workRelocation packageShift work- PRN Consultant For Patient Education Company We are seeking a psychiatrist or licensed psychologist with specialized expertise in addiction medicine to join our innovative patient education company as a PRN consultant. In this role, you'll contribute your clinical...ReliefRemote work
- ...Repository Navigation Evaluation Specialist is a remote review track for evaluating AI outputs across repository navigation evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$50 per hour
...Basque Audio Evaluation Specialist is a remote evaluation track for reviewing audio annotation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use...Remote jobFor contractors10 hours per week- Job Title Program Evaluator & Grants Specialist (Consultant) Department Grants & Community Engagement Reporting Structure Pay Grade/Salary Exempt/non-exempt: n/a Detroit Wayne Integrated Health Network Job Description Job Title Program Evaluator & Grants Specialist (Consultant...Work at officeLocal areaRemote work
- ...Robotics Evaluation Specialist is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior...Remote jobHourly payFor contractors10 hours per week
$38 - $43 per hour
...Bilingual German STEM Evaluation Specialist is a remote review track for evaluating AI outputs across german stem review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method...Remote jobFor contractors10 hours per week$40 - $50 per hour
...Role Overview Apply your linguistics expertise to evaluate large language model outputs and help train next-generation AI systems. You will analyze model-human conversations for linguistic precision, assess adherence to instructions, and deliver clear, actionable feedback...Remote jobHourly payFor contractorsImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychiatry Evaluation Specialist [Remote]. Be the first to apply!
- configuration specialist Remote
- localization specialist Remote
- intervention specialist Remote
- investigations specialist Remote
- ecommerce specialist Remote
- workforce management specialist Remote
- community health promotion specialist Remote
- title specialist Remote
- infectious disease specialist Remote
- credit specialist Remote




