Senior Psychometrician (Remote, Full-Time)

The Senior Psychometrician is a member of the Research & Psychometrics team responsible for providing psychometric oversight, analysis, and consultation in support of assessments that measure the competency of occupational therapy professionals. This role supports NBCOT’s certification programs by performing operational psychometric work, including practice analysis and standard setting, and performing applied research to provide actionable insights for improving assessments and processes.

Operates with minimal supervision.
Contributes to complex projects and workflows and is recognized as a subject matter expert.
Exercises independent judgement in applying policies and solving routine to moderately complex problems.
Practice Analysis, Competency Modeling & Exam Specifications
Designs and conducts practice analysis and competency modeling studies to identify and define the knowledge, skills, competencies, and other requirements necessary for effective occupational therapy practice.
Develops examination specifications and content outlines based on empirical practice analysis findings.
Psychometric Analysis, Scoring, and Standard Setting
Performs advanced psychometric and statistical analyses, including Rasch calibrations, DIF analyses, equating, scaling, and other related methodologies, to support assessment quality and fairness.
Designs, programs, and implements AI-driven tools and solutions to support psychometric analysis, exam development, and operational efficiency across NBCOT’s assessment programs.
Researches, develops, and evaluates innovative item types and assessment methods to enhance the measurement of knowledge, skills, abilities, and competencies relevant to occupational therapy practice.
Research, Data Analysis, and Reporting
Prepares technical documentation and reports by summarizing complex psychometric and statistical information and clearly communicates findings to technical and nontechnical audiences, orally, in writing, and through data visualization.
Designs, programs, and implements AI-driven tools and solutions to support psychometric analysis, exam development, and operational efficiency supporting NBCOT’s assessment programs.
Manages large datasets and databases to support psychometric analyses, reporting, and research while ensuring data integrity, documentation, and reproducibility.
Provides psychometric consultation on the design, development, interpretation, and use of assessments that measure the competencies of occupational therapy professionals.
Contributes expertise to professional organizations and participates in conferences, mentoring emerging professionals, and supporting initiatives that advance the field of psychometrics and certification.
Doctoral degree in a field directly related to measurement, assessment, psychometrics, statistics, educational measurement, quantitative psychology, industrial-organizational psychology or similar, along with 3+ years of experience in a psychometrician role, or equivalent is required.
Knowledge of research methods, including survey design, data collection, and interpretation of research findings.
Applied experience conducting job/practice analyses, standard-setting, and statistical and psychometric analyses to support assessment development, scoring, and evaluation.
Experience supporting certification, licensure, credentialing assessment programs is preferred.
Experience with practice analysis studies, standard-setting activities, or exam development processes is preferred.
Knowledge of machine learning and natural language processing is an asset.
Demonstrates expert knowledge of statistical and productivity software, such as R, SPSS, Winsteps, and Microsoft Excel.
Able to perform expert level tasks including advanced statistical and psychometric analysis, conducting research studies, and facilitating psychometric meetings.
Data analysis and interpretation
Technical writing
Planning and organization
Work environment – Remote
Work schedule – 35 hours per week (full-time)
Travel expectations – 5-10% domestic travel.
Fine hand manipulation and grasping/handling (typing, using small tools) – frequently (2.5-5.5 hours/day)
The National Board for Certification in Occupational Therapy, Inc. (NBCOT®) is a national not-for-profit organization that provides certification to over 180,000 occupational therapy professionals. NBCOT develops, administers, and continually reviews its certification process based on current and valid standards that provide reliable indicators of competence of occupational therapy practice. Above all else, our mission is to serve the public interest. We also work with state regulators and employers to provide information on credentials, professional conduct, and regulatory issues. Serving the public interest by advancing client care and professional practice through evidence-based certification standards and the validation of knowledge essential for effective practice in occupational therapy.
Certified occupational therapy professionals providing effective evidence-based services across all areas of practice worldwide.
At NBCOT , justice, equity, diversity, and inclusion (JEDI) are an integral part of our mission and vision and having a diverse staff and inclusive workplace is one of the ways we put our values into action. We promote a culture where employees collaborate in an energizing environment while focusing on the high-quality work that makes us stand out in the certification industry.
paid medical insurance

• annual bonus and salary adjustments
• covered life insurance and short-term and long-term disability