Psychometrist I - Psychology

Artemis Connection is a strategic management consultancy working across the for-profit, public and social sectors. We help clients around the world identify their most pressing strategic issues and we staff teams of strategy consultants to roll up their sleeves and deliver impact. We are passionate about helping innovative and entrepreneurial leaders reach their goals through a customized project-based approach, typically focused around:

Bespoke Innovation, Sales, and Marketing Strategy
Purpose-driven Transformation
Embedded Strategy and Operations roles
Our advisors include HR officers, executive coaches, academics, entrepreneurs, and neuroscientists. Our team is made up of seasoned consultants, trained at organizations such as McKinsey & Company, Boston Consulting Group (BCG), Bain, Big 4 Strategy, and elite educational institutions.
Our client, an education company, is seeking a detail-oriented Psychometrician to lead the design, validation, and analysis of the assessments underpinning its academic programs. This engagement is directly tied to the organization's upcoming re-accreditation review: the Psychometrician will ensure that assessment practices, evidence, and documentation meet accrediting body standards, while also strengthening the validity, reliability, and fairness of assessments for all test-takers.
Conduct item analysis, reliability testing, and validity studies (content, construct, criterion)
Conduct differential item functioning (DIF) analysis to identify and address potential bias across demographic groups
Analyze assessment data and produce technical reports summarizing psychometric properties, score interpretations, and recommendations
APA/AERA/NCME Standards for Educational and Psychological Testing) and legal/regulatory requirements
Compile and organize psychometric evidence, technical documentation, and validity/reliability reports needed to support the re-accreditation self-study and site visit
Serve as the assessment subject-matter expert in preparing responses to accreditor inquiries and addressing any prior findings or areas of concern
Support the design of pilot studies and field tests for new or revised instruments
Collaborate with academic leadership, product, research, and data teams to translate psychometric findings into actionable improvements
Stay current on advances in measurement theory, testing technology, and accreditation requirements in the education sector
D. in Psychometrics, Educational Measurement, Quantitative Psychology, Statistics, or a related field
Strong foundation in CTT, IRT, and test validity/reliability frameworks
Proficiency with statistical software (e.g., R, SPSS, SAS, Python) and psychometric-specific tools (e.g., Experience analyzing large-scale assessment data sets
Experience with computerized adaptive testing (CAT) or automated test assembly
DIF, disparate impact analysis)
Background in credentialing, certification, educational, or workforce assessment contexts
Prior experience supporting an accreditation self-study, site visit, or accreditor response process
Experience presenting findings to stakeholders, academic leadership, or accreditation committees