Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Psychology QA Lead - Remote

YO IT Consulting

Job Title Psychology Quality Assurance Lead Job Type Contract Location Remote About This Role In this hourly, remote contractor role, you will work as a Psychology Quality Assurance Lead to oversee quality, consistency, and trainer performance across psychology-focused AI training projects. You will review AI-generated psychology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong psychology expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is a fast-growing AI Data Services company delivering training data for many of the world’s largest AI companies and foundation-model labs. Your psychology quality leadership will directly help improve the world’s premier AI models by ensuring that psychology training data is accurate, ethical, appropriately cautious, research-informed, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network. Your Profile Bachelor’s, Master’s, PhD, PsyD, or equivalent professional background in Psychology, Clinical Psychology, Counseling, Behavioral Science, Cognitive Science, Neuroscience, Social Work, Psychiatry-adjacent research, Education, or a closely related field. Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback. 3+ years of experience in psychology research, clinical/counseling settings, behavioral science, teaching, academic writing, mental-health content review, psychological assessment, or related workflows. Strong understanding of psychological theories, research methods, cognitive and social psychology, developmental psychology, abnormal psychology, ethics, evidence-based practice, and mental-health safety considerations. Ability to evaluate psychology content against detailed rubrics and identify issues such as overdiagnosis, unsafe advice, unsupported claims, flawed study interpretation, pseudoscience, stigmatizing language, or inappropriate therapeutic recommendations. Familiarity with areas such as CBT, developmental psychology, personality, trauma-informed communication, behavioral interventions, mental-health literacy, research design, statistics, and ethical guidelines is preferred. Experience leading or supporting remote teams of researchers, clinicians, educators, reviewers, annotators, or QAs is strongly preferred. Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems. Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation. Experience with AI training, data annotation, LLM evaluation, psychology QA, mental-health content review, or rubric-based review is a strong plus. Key Responsibilities Quality monitoring: Spot-check psychology items, identify quality issues, provide ongoing feedback through DMs, and elevate recurring or critical issues. Psychology review: Evaluate AI-generated psychology explanations, mental-health content, research summaries, behavioral guidance, theory applications, and safety-sensitive responses for accuracy and appropriateness. Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and psychology-specific review standards. Question handling: Respond to trainer/QA questions clearly and promptly, especially around psychological concepts, evidence quality, ethical boundaries, mental-health safety, diagnostic caution, and rubric interpretation. Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed. Documentation: Create and maintain psychology project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials. Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and psychology-specific review requirements. Quality alignment: Ensure all trainers and QAs apply psychology-review guidelines consistently and understand updates as projects evolve. Safety and ethics review: Flag unsafe, overconfident, stigmatizing, pseudoscientific, diagnostically inappropriate, or crisis-insensitive psychology content. Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for psychology AI training projects. #J-18808-Ljbffr YO IT Consulting

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Psychology QA Lead - Remote in San Francisco, CA vacancy
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to oversee quality, consistency, and performance in psychology-focused AI training...  ...skills, and a detail-oriented approach to work. This remote contract role will involve managing workflows across expert... 
    Remote job
    Contract work

    YO IT Consulting

    Chicago, IL
    4 days ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to manage quality in psychology-focused AI projects remotely. In this role, you will assess AI-generated psychology content and ensure quality standards are met through precise feedback and evaluations... 
    Remote job

    YO IT Consulting

    Atlanta, GA
    4 days ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to oversee quality and trainer performance on psychology-focused AI projects. This remote, contract position requires expertise in psychology, strong communication skills, and the ability to maintain quality... 
    Remote job
    Contract work

    YO IT Consulting

    Austin, CO
    4 days ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead for a remote contractor role. This position involves overseeing quality and performance across psychology-focused AI projects. Your expertise will ensure that psychology training data is accurate and ethical... 
    Remote job
    For contractors

    YO IT Consulting

    Phoenix, AZ
    5 days ago
  • JobsInMass.com is seeking a Psychology Quality Assurance Lead for a remote role. You will oversee quality and consistency in psychology-focused AI training projects, ensuring accurate, ethical, and research-informed content. This role requires strong psychology expertise... 
    Remote job

    JobsInMass.com

    Sharon, MA
    3 days ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to ensure quality in AI-generated psychology projects. This remote contractor role involves oversight of content accuracy, evaluating trainer performance, and providing feedback on psychological accuracy... 
    Remote job
    For contractors

    YO IT Consulting

    San Francisco, CA
    2 days ago
  • $40 per hour

    A leading AI development firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to cutting-edge AI systems. This fully remote position offers a flexible schedule and competitive hourly pay starting at $40+ USD. Candidates... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Providence, RI
    1 day ago
  • $40 per hour

    A leading AI development firm is looking for experienced quantitative professionals to evaluate AI-generated quantitative analysis and...  ...relevant experience, alongside coding skills. This position is fully remote, allowing you to work from anywhere in the US, Canada, UK,... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    1 day ago
  • $40 per hour

    A remote work-focused analytics company seeks experienced quantitative professionals to assess AI-generated quantitative work and provide technical feedback. The role requires a strong background in statistics, predictive modeling, or similar fields, and offers flexibility... 
    Remote work
    Hourly pay

    DataAnnotation

    Columbia, SC
    1 day ago
  • $20 per hour

    A healthcare technology company is looking for an RCM Operations Manager to enhance AI models related to healthcare. This remote position calls for an individual with expertise in areas like Revenue Cycle Management, Patient Finance, or Clinical Support. Responsibilities... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Wausau, WI
    1 day ago
  • $20 per hour

     ...healthcare-related problems for AI chatbots and evaluating their output for accuracy. This independent contractor position offers flexible remote work with projects starting at $20+ per hour. Applicants must be located in the U.S. and possess a relevant degree or be in... 
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Santa Fe, NM
    2 days ago
  • $20 per hour

     ...Responsibilities encompass evaluating AI outputs for accuracy and providing complex healthcare-related problems to train the models. This is a remote position with flexible hours and an attractive pay structure starting at $20 per hour, with opportunities for bonuses. #J-18808-... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Charleston, WV
    1 day ago
  • $40 per hour

     ...expertise. The ideal candidate has a background in data science, economics, or related fields and is fluent in English. Enjoy fully remote work and a flexible schedule with competitive pay starting at $40 per hour, available only to residents in specified countries. #J-... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Springfield, IL
    2 days ago
  • $20 per hour

    A technology firm specializing in AI is seeking an RCM Operations Manager to enhance AI models through diverse healthcare-related problems. The ideal candidate will possess a medical or healthcare-related degree. This independent contractor position offers a flexible schedule...
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Montgomery, AL
    1 day ago
  • $20 per hour

     ...evaluating AI outputs for accuracy, and ensuring high-quality model responses. Candidates should have relevant healthcare degrees and fluency in English. This independent contractor role offers flexible remote work with competitive hourly pay starting at $20. #J-18808-Ljbffr
    Remote work
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    Boston, MA
    2 days ago
  • $20 per hour

     ...a current or in-progress medical degree. Responsibilities include evaluating AI outputs for accuracy and ensuring medical quality. This position offers flexibility with a remote option and pays hourly starting at $20, plus bonuses for high-quality work. #J-18808-Ljbffr
    Remote work
    Hourly pay

    DataAnnotation

    Providence, RI
    1 day ago
  • $20 per hour

    A tech-driven company is seeking an RCM Operations Manager to train AI models in the United States. The role involves evaluating AI outputs and ensuring medical accuracy in responses. Candidates must possess strong healthcare expertise and fluency in English. This position...
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Madison, WI
    1 day ago
  • $20 per hour

     ...RCM Operations Manager to train AI models for evaluating chatbots. This role requires expertise in healthcare and offers a flexible, remote work environment. Ideal candidates will have a relevant healthcare degree and be fluent in English. Responsibilities include... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Columbia, SC
    1 day ago
  •  ...YO IT Consulting is looking for an Anthropology Quality Assurance Lead for a remote contractor role. You will be responsible for ensuring quality and consistency in AI training projects focused on anthropology. Your expertise will support evaluating AI-generated content... 
    Remote work
    For contractors

    YO IT Consulting

    Los Angeles, CA
    4 days ago
  •  ...YO IT Consulting is hiring an Anthropology Quality Assurance Lead to oversee AI training projects. This remote role requires expertise in anthropology and strong communication skills. The ideal candidate will evaluate AI-generated content for accuracy and cultural sensitivity... 
    Remote work

    YO IT Consulting

    Phoenix, AZ
    5 days ago
  •  ...YO IT Consulting is seeking an Anthropology Quality Assurance Lead to oversee the quality and consistency across AI training projects. In this remote role, you'll evaluate anthropology content for accuracy and provide critical feedback to ensure cultural sensitivity and... 
    Remote work

    YO IT Consulting

    San Francisco, CA
    4 days ago
  •  ...YO IT Consulting is seeking an Anthropology Quality Assurance Lead to oversee quality and performance across anthropology-focused AI training projects. In this remote, contractor role, you will ensure the accuracy and cultural sensitivity of anthropology content. Applicants... 
    Remote work
    For contractors

    YO IT Consulting

    San Antonio, TX
    4 days ago
  •  ...YO IT Consulting is looking for an Anthropology Quality Assurance Lead to oversee quality assurance for AI training projects. This remote role requires strong anthropology expertise and communication skills to ensure cultural sensitivity and accuracy in AI-generated anthropology... 
    Remote work

    YO IT Consulting

    Houston, TX
    2 days ago
  • $55 - $65 per hour

     ...Job Description Insight Global is looking for remote QA Lead with ERP experience. This person will be leading and mentoring a team of 12 QA Analysts globally. They will be managing the recent go live of greenfield implementations while being able to partner on the new... 
    Remote work

    Insight Global

    Boston, MA
    1 day ago
  • $60 per hour

     ...Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. We are looking for experienced quantitative professionals to help advance AI development. AI models are... 
    Remote work
    Hourly pay
    Full time
    Flexible hours

    DataAnnotation

    Wisconsin
    1 day ago
  •  ...QA ETL Lead Tester Location: Dallas, TX - REMOTE Skillset: Having knowledge in Software Quality Assurance and Automated, Manual Testing Good knowledge in Tosca Data Integrity Certification in Tosca will be an added advantage Skilled in developing and... 
    Remote work

    Diverse Lynx

    United States
    3 days ago
  •  ...A leading software company is seeking a QA Manager to oversee a team dedicated to improving product quality. The role involves managing Quality Assurance...  ...continuous quality improvement. This position is fully remote, allowing for a flexible work environment. #J-18808-... 
    Remote work
    Flexible hours

    LeadGenius

    San Jose, CA
    1 day ago
  •  ...Seeking an experienced QA Lead to work remotely in a full-time capacity, responsible for leading daily QA operations, coordinating testing initiatives across disciplines, and mentoring team members to ensure a polished player experience throughout game development. Key... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    1 day ago
  •  ...A tech solutions company is hiring an ETL QA Tester in New Jersey for a remote role. This position involves leading a QA team, designing comprehensive testing strategies, and ensuring best practices while collaborating with various stakeholders. Ideal applicants should... 
    Remote work
    Hourly pay

    Blockchain Technologies Corp.

    New York, NY
    2 days ago
  •  ...Sr. Technical Test Analyst in Columbia, MO. This role focuses on leading manual and automated testing efforts for healthcare applications...  ...in computer science or engineering, with 5 years of overall QA experience, including 2 years with the specific skills mentioned... 
    Remote job
    Work from home

    Parallon Revenue Cycle Services

    Columbia, MO
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Psychology QA Lead - Remote. Be the first to apply!