Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Psychology QA Lead - Remote

YO IT Consulting

Job Title Psychology Quality Assurance Lead Job Type Contract Location Remote About This Role In this hourly, remote contractor role, you will work as a Psychology Quality Assurance Lead to oversee quality, consistency, and trainer performance across psychology-focused AI training projects. You will review AI-generated psychology content and trainer/QA work, evaluate output quality against project guidelines, provide precise written feedback, and ensure that all contributors follow the expected quality standards. You will assess work for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong psychology expertise, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams. This role is a fast-growing AI Data Services company delivering training data for many of the world’s largest AI companies and foundation-model labs. Your psychology quality leadership will directly help improve the world’s premier AI models by ensuring that psychology training data is accurate, ethical, appropriately cautious, research-informed, and aligned with client expectations. Selection process involves an AI interview, a domain-specific task, and an interview with a recruiter. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network. Your Profile Bachelor’s, Master’s, PhD, PsyD, or equivalent professional background in Psychology, Clinical Psychology, Counseling, Behavioral Science, Cognitive Science, Neuroscience, Social Work, Psychiatry-adjacent research, Education, or a closely related field. Strong grasp of the English language to follow project guidelines, communicate with teams, and provide clear written feedback. 3+ years of experience in psychology research, clinical/counseling settings, behavioral science, teaching, academic writing, mental-health content review, psychological assessment, or related workflows. Strong understanding of psychological theories, research methods, cognitive and social psychology, developmental psychology, abnormal psychology, ethics, evidence-based practice, and mental-health safety considerations. Ability to evaluate psychology content against detailed rubrics and identify issues such as overdiagnosis, unsafe advice, unsupported claims, flawed study interpretation, pseudoscience, stigmatizing language, or inappropriate therapeutic recommendations. Familiarity with areas such as CBT, developmental psychology, personality, trauma-informed communication, behavioral interventions, mental-health literacy, research design, statistics, and ethical guidelines is preferred. Experience leading or supporting remote teams of researchers, clinicians, educators, reviewers, annotators, or QAs is strongly preferred. Comfortable working in fast-moving remote environments using tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems. Highly detail-oriented and organized, with the ability to maintain style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation. Experience with AI training, data annotation, LLM evaluation, psychology QA, mental-health content review, or rubric-based review is a strong plus. Key Responsibilities Quality monitoring: Spot-check psychology items, identify quality issues, provide ongoing feedback through DMs, and elevate recurring or critical issues. Psychology review: Evaluate AI-generated psychology explanations, mental-health content, research summaries, behavioral guidance, theory applications, and safety-sensitive responses for accuracy and appropriateness. Trainer and QA communication: Update trainers and QAs on Discord about new item guidelines, project changes, workflow updates, quality expectations, and psychology-specific review standards. Question handling: Respond to trainer/QA questions clearly and promptly, especially around psychological concepts, evidence quality, ethical boundaries, mental-health safety, diagnostic caution, and rubric interpretation. Trainer/QA activation management: DM contributors who are inactive or not working, encourage activation, track follow-ups, and flag availability issues when needed. Documentation: Create and maintain psychology project documentation, including style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding materials. Onboarding and training: Schedule and run onboarding/training calls with trainers and QAs to explain project expectations, workflows, rubrics, quality standards, and psychology-specific review requirements. Quality alignment: Ensure all trainers and QAs apply psychology-review guidelines consistently and understand updates as projects evolve. Safety and ethics review: Flag unsafe, overconfident, stigmatizing, pseudoscientific, diagnostically inappropriate, or crisis-insensitive psychology content. Process improvement: Identify recurring quality gaps, propose workflow improvements, and help build scalable QA processes for psychology AI training projects. #J-18808-Ljbffr YO IT Consulting

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Psychology QA Lead - Remote in San Francisco, CA vacancy
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead for a contract role focused on quality oversight in AI training projects. This remote position requires expertise in psychology to evaluate content and ensure adherence to quality standards. Key responsibilities... 
    Remote job
    Contract work

    YO IT Consulting

    New York, NY
    16 hours ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to manage quality in psychology-focused AI projects remotely. In this role, you will assess AI-generated psychology content and ensure quality standards are met through precise feedback and evaluations... 
    Remote job

    YO IT Consulting

    Atlanta, GA
    16 hours ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead for a remote contractor role. This position involves overseeing quality and performance across psychology-focused AI projects. Your expertise will ensure that psychology training data is accurate and ethical... 
    Remote job
    For contractors

    YO IT Consulting

    Phoenix, AZ
    2 days ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to ensure quality in AI-generated psychology projects. This remote contractor role involves oversight of content accuracy, evaluating trainer performance, and providing feedback on psychological accuracy... 
    Remote job
    For contractors

    YO IT Consulting

    San Francisco, CA
    16 hours ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to oversee quality, consistency, and performance in psychology-focused AI training...  ...skills, and a detail-oriented approach to work. This remote contract role will involve managing workflows across expert... 
    Remote job
    Contract work

    YO IT Consulting

    Chicago, IL
    16 hours ago
  • YO IT Consulting is looking for a Psychology Quality Assurance Lead to oversee quality and trainer performance on psychology-focused AI projects. This remote, contract position requires expertise in psychology, strong communication skills, and the ability to maintain quality... 
    Remote job
    Contract work

    YO IT Consulting

    Austin, CO
    16 hours ago
  • .Remote Quality Assurance (QA) Lead - Data Abstraction (Epic)OverviewWe are seeking a QA Lead with strong Epic EMR experience to oversee and ensure the quality of large-scale data abstraction efforts. This role will manage a team of Remote Data Abstractors, ensuring accurate... 
    Remote work
    Contract work

    CSI Companies

    Jacksonville, FL
    1 day ago
  • TypeContractGuidewire QA Lead - P&C InsuranceLocation: Remote Responsibilities Collaborate with client QA teams, developers, and offshore teams to understand requirements, identify gaps, and ensure accurate testing. Design and execute test cases based on business requirements... 
    Remote work

    TalentsBridge

    Atlanta, GA
    4 days ago
  • $81.15k - $137.95k

     ...makes BIG things happen every day. ICF is seeking a Construction QA/QC Lead to assist Los Angeles County with managing federal disaster...  ...collaboratively as part of a multidisciplinary team. Other Job Details: Remote position with possible travel to client sites and field offices... 
    Remote work
    Full time
    Contract work
    For contractors
    Work experience placement
    Work at office

    ICF

    Los Angeles, CA
    2 days ago
  •  ...YO IT Consulting is looking for an Anthropology Quality Assurance Lead to oversee quality and trainer performance across anthropology-focused AI training projects. This remote role requires strong anthropology expertise and excellent communication skills. You will ensure... 
    Remote work

    YO IT Consulting

    Austin, CO
    2 days ago
  •  ...Required Qualifications ~ Strong knowledge of API testing and integration workflows. ~5-7 years of hands-on QA coordination/lead experience for complex programs. ~ Proficiency with Postman or similar API testing tools. ~ Excellent communication and... 
    Remote work

    Saxon Global

    United States
    20 hours ago
  •  ...Society Group, we provide the highest quality, leading-edge, industry-tailored data and AI...  ...to hear from you! About the Role The QA Lead owns the end-to-end test strategy for...  ...quality assurance. This role is work-from-home (remote) though must be able to commute to client... 
    Remote work
    Full time
    Contract work
    Local area
    Work from home

    Data Society

    Washington DC
    22 days ago
  • QA Lead (Quality Assurance Lead) Remote
    Remote work

    VDart Inc

    Warren, MI
    1 day ago
  • Job Title : Playwright Automation QA LeadLocation USA - Remote Experience 10 to 15 YearsTechnical Skills PrimaryMust have experience in Playwright with JavaScript and have lead automation teamsGood to have Perform comprehensive testing of PnC Insurance domain agent portals... 
    Remote work

    LTM

    Cincinnati, OH
    3 days ago
  •  ...IT Consulting is looking for an Anthropology Quality Assurance Lead to oversee quality and consistency across AI training projects focused...  ...skills and attention to detail are crucial for success in this remote contractor position. If qualified, you will be prioritized for... 
    Remote work
    For contractors

    YO IT Consulting

    Seattle, WA
    2 days ago
  •  ...QA Lead Location: Remote/Canada Duration: 6+ Months Job Description: Must have skills: Having experience of at least 7 years in manual testing in telecom domain. Proficient in writing and executing test cases. Diligent in reporting the execution... 
    Remote work

    Zortech Solutions

    United States
    16 hours ago
  • Job Title Primary Skill: Playwright, Typescript, C# Roles and Responsibilities Developing test suites Setting up and managing on-demand test environments Certifying the right size and providing input to Dev and SRE teams for UAT and Production environments...
    Remote work

    Omni Inclusive

    United States
    3 days ago
  • $20 per hour

    A healthcare technology company is looking for an RCM Operations Manager to enhance AI models related to healthcare. This remote position calls for an individual with expertise in areas like Revenue Cycle Management, Patient Finance, or Clinical Support. Responsibilities... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Wausau, WI
    3 days ago
  • $100k - $140k

     ...QA Lead (Remote) Are you a hands-on QA professional who enjoys improving processes, mentoring others, and making a real impact? We're looking for a QA Lead to help shape the future of quality assurance within a growing software organization. This is a unique opportunity... 
    Remote work

    Duvari Group

    United States
    3 days ago
  •  ...YO IT Consulting is seeking an Anthropology Quality Assurance Lead to oversee quality and trainer performance across AI training projects in a remote capacity. You will review AI-generated content, assess work for accuracy and sensitivity, and ensure adherence to project... 
    Remote work

    YO IT Consulting

    Boston, MA
    22 hours ago
  •  ...YO IT Consulting is seeking an Anthropology Quality Assurance Lead to work remotely. In this role, you will oversee quality in anthropology-focused AI training projects by evaluating AI-generated content and trainer performance, ensuring high quality and cultural sensitivity... 
    Remote work

    YO IT Consulting

    Raleigh, NC
    2 days ago
  •  ...QA Lead For AI-Native Products Foundation Health is transforming healthcare through an AI-powered digital pharmacy platform that seamlessly connects operational infrastructure with high quality patient experiences. Our mission is to transform patient centric care by... 
    Remote work

    Foundation Health Global Inc

    United States
    16 hours ago
  •  ...Leading a team of QA Engineers, the full-time QA Lead will manage quality assurance processes, oversee release governance, and drive automation strategies while ensuring alignment with engineering and business objectives. Key responsibilities Develop and mentor a team... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    4 days ago
  •  ...Lead QA Engineer Canada 100% Remote 1–3 years of experience with Low-Code/No-Code platforms (e.g., Power Automate, Appian, Mendix, Kissflow, etc.). Strong understanding of basic logic constructs: loops, if-else conditions, switch-case. Ability to write and... 
    Remote work

    E-Solutions

    United States
    20 hours ago
  •  ...QA Automation Lead Location: Remote Responsibilities: Develop automation frameworks using Selenium with Java Perform API testing using Postman and Rest Assured Implement service virtualization using SoapUI or Mockito Integrate automated tests with... 
    Remote work

    Staffing the Universe

    United States
    4 days ago
  •  ...Salesforce QA Lead We are looking for an experienced Salesforce QA Lead – Automation to lead quality assurance efforts across the Salesforce ecosystem. This role requires deep expertise in Salesforce testing, strong automation skills, and the ability to lead QA activities... 
    Remote work

    Epsilon Solutions Ltd

    United States
    16 hours ago
  •  ...YO IT Consulting is looking for an Anthropology Quality Assurance Lead for a remote contract role. You will ensure quality and consistency across anthropology-focused AI training projects, reviewing AI-generated content and evaluating work against project guidelines. The... 
    Remote work
    Contract work

    YO IT Consulting

    California, MO
    1 day ago
  •  ...YO IT Consulting is seeking an Anthropology Quality Assurance Lead for a remote contract position. The role involves overseeing quality across anthropology-focused AI training projects, ensuring accuracy and cultural sensitivity of content. The ideal candidate will have... 
    Remote work
    Contract work

    YO IT Consulting

    San Jose, CA
    23 hours ago
  •  ...QA Lead - Oracle GTM - 100% Remote Location – Pittsburgh, PA Duration: 12 Months Plus QA/Test Lead should have a minimum 6-7 years of experience on Supply chain & Distribution domain. Should have good experience Oracle Global Trade Management (GTM) testing... 
    Remote work

    Staffing the Universe

    United States
    16 hours ago
  •  ...Position-QA Automation Lead Location-Dallas, TX (Remote) Mandatory Skills- Selenium, browser-based web application testing. Must have experience in automation code develop, debug, execution using any IDE like Eclipse, IntelliJ etc. Must have... 
    Remote work

    Apptad

    United States
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Psychology QA Lead - Remote. Be the first to apply!