Senior Psychometrician and Data Manager
University of California, San Francisco
Description
Multitudes is seeking a senior Psychometrician and Data Manager to lead the design validation analysis and strategic use of data across its educational implementation initiatives. This individual will oversee the organizations measurement framework and data systems ensuring that assessments and analytics meet the highest standards of scientific rigor validity reliability equity accessibility and usability.
Reporting to the Chief Operating Officer (COO) the Psychometrician and Data Manager serves as the scientific and technical lead for the Multitudes Project across its research education and product initiatives. The role combines expertise in psychometrics educational measurement quantitative methods and applied data science with strategic leadership to translate complex statistical findings into actionable insights that advance the development and implementation of the Multitudes screening platform.
The ideal candidate holds deep expertise in psychometrics educational measurement quantitative psychology statistics or a related discipline with experience in literacy education neuroscience developmental science or behavioral research. This individual will collaborate across multidisciplinary teams contribute to assessment development oversee data infrastructure mentor analysts and ensure data quality governance and regulatory compliance across multiple institutional partners.
In addition we expect the ideal candidate to lead the organizational data architecture and analytics strategy. Build together with their team scalable systems for data collection management quality control visualization and reporting. Oversee complex statistical analyses and interpretation of longitudinal and intervention data. Develop dashboards technical reports white papers and presentations for internal and external stakeholders. Translate data into actionable recommendations for program improvement policy and research dissemination.
Because our implementation work is grounded in research we expect the ideal candidate to collaborate with interdisciplinary teams including neuroscientists literacy researchers educators clinicians and software developers. Contribute to grant writing research publications conference presentations and external partnerships. Support the development of innovative measures that integrate educational cognitive and behavioral data and help establish Multitudes as a national leader in evidence-based measurement and evaluation.
In addition the ideal candidate is expected to build and mentor a high-performing analytics and research team. Establish best practices for data governance reproducibility documentation and ethical data use and supervise external research and evaluation partners as needed.
The role will provide psychometric and measurement leadership for the development validation refinement and scaling of Multitudes assessments and related measurement systems. Responsibilities will include supporting the research team in designing and overseeing studies of reliability validity measurement invariance item functioning growth and sensitivity to intervention effects while applying appropriate modern psychometric and statistical approaches including Item Response Theory (IRT) Classical Test Theory multilevel and structural equation modeling latent growth modeling and Bayesian methods. The role will also help ensure that assessments and measurement approaches are culturally responsive equitable and appropriate for multilingual and diverse student populations.
The role will lead data strategy analytics and research collaboration including developing scalable approaches to data collection management quality assurance analysis visualization and reporting. This includes overseeing analyses of large-scale longitudinal and intervention datasets and translating findings into actionable recommendations for assessment refinement program improvement policy and research dissemination. The role will collaborate closely with interdisciplinary partnersincluding literacy researchers neuroscientists educators clinicians data scientists and software developersand contribute to grant proposals peer-reviewed publications technical reports white papers conference presentations and external research partnerships. The work will also support the development of innovative measures integrating educational cognitive behavioral and other relevant data.
The role will strengthen research and analytics infrastructure and organizational capacity by establishing best practices for data governance reproducibility documentation ethical data use fairness and bias evaluation. Responsibilities may include building and mentoring a high-performing research and analytics team and overseeing external research or evaluation partners. The ideal candidate will bring advanced training in psychometrics quantitative psychology educational measurement statistics biostatistics or a related field; substantial experience with assessment development validation advanced statistical modeling and large and complex datasets; and strong quantitative programming and communication skills. Experience in literacy language development bilingual education developmental science neuroscience educational technology responsible AI or school-based research is particularly valuable.
Department Overview
Multitudes is a State of California-funded initiative that bridges neuroscience and education to identify reading difficulties including dyslexia in early childhood and support timely intervention. The project has developed English and Spanish screening instruments and is expanding into mathematics additional languages and other domains related to brain health.
Multitudes is part of the UCSF Dyslexia Center within the Edward and Pearl Fein Memory and Aging Center. The Dyslexia Center brings together neuroscientists clinicians geneticists and educators to improve diagnosis intervention and lifelong outcomes for individuals with learning differences through multidisciplinary research spanning language cognition aging and brain health.
The Department of Neurology is one of the nations leading academic neurology departments with over $120 million in annual operations and the highest NIH funding among U.S. neurology departments. Its mission is to deliver exceptional clinical care conduct transformative research and educate future leaders in neurology and neuroscience.
Responsibilities% of time | Essential Function (Yes/No ) | Key Responsibilities (To be completed by Supervisor) |
20 | Yes | Lead and oversee psychometric analyses using Classical Test Theory Item Response Theory (IRT) equating measurement invariance latent growth modeling multilevel modeling structural equation modeling Bayesian methods and related approaches. |
10 | yes | Direct and provide technical oversight to the research team in planning research studies including sampling strategies instrument development validation studies longitudinal analyses and intervention evaluations. |
10 | yes | Lead and oversee the development validation refinement and scaling of educational assessments that are reliable valid equitable culturally responsive and appropriate for multilingual populations. |
5 | yes | Define technical requirements for research studies product development and platform analytics. |
10 | yes | Develop and oversee scalable data architecture pipelines quality assurance processes dashboards and reporting systems. Manage complex datasets supporting research collaborations across UCSF schools universities and external partners. |
5 | yes | Translate complex quantitative findings into actionable recommendations for researchers educators clinicians and product teams. |
15 | yes | Supervise and mentor junior analysts and research staff. Assign and prioritize work; establish deliverables and performance expectations; review work products and technical approaches; provide coaching and technical direction; manage workload and resource allocation; address performance and workflow issues; and ensure staff accountability for data quality documentation timelines and program objectives. |
5 | yes | Collaborate on scientific publications grant proposals technical reports conference presentations and external partnerships. |
5 | yes | Establish best practices for data governance reproducibility documentation ethical data use and regulatory compliance. |
15 | yes | Support long-term data strategies including infrastructure for artificial intelligence predictive analytics and precision education initiatives. |
100% | (To update total % enter the amount of time in whole numbers (without the % symbol - e.g. 15 20) then highlight the total sum (e.g. 1%) at the bottom of the column and press F9. The total sum should add up to 100%.) |
Required Qualifications
Bachelors degree in related area and five or more years of relevant experience which includes three or more years of supervisory experience and / or equivalent experience / training
5 years of advanced experience in psychometrics and quantitative research.
Experience managing large and complex datasets
Strong communication skills with the ability to explain technical findings to non-technical audiences.
Familiarity with highly complex logical data design and data mapping or data conversion.
Experience building and leading multidisciplinary research and analytics teams.
Demonstrated ability to work with others from diverse backgrounds. Demonstrated effective communication and interpersonal skills. Demonstrated service orientation skills.
Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization.
Self-motivated and works independently and as part of a team. Strong organizational skills.
Demonstrated advanced problem-solving skills. Able to learn effectively and meet deadlines.
Advanced analytical and design skills including the ability to abstract information requirements from real-world processes to understand information flows in computer systems.
Ability to represent relevant information in abstract models. Critical thinking skills and attention to detail.
Demonstrated skill in managing technical staff.
Requires critical thinking persuasion / negotiation mentoring leadership / management problem solving human resources policies and procedures relating to management responsibilities verbal and written communication quantitative abilities analytical strong technical database systems skills.
Demonstrated expertise in assessment development IRT and advanced statistical modeling longitudinal data analysis validation studies and educational or behavioral measurement.
Strong programming and analytic skills in R Python SAS or SPSS.
Preferred Qualifications
PhD in Psychometrics Quantitative Psychology Educational Measurement Statistics Biostatistics or related field.
Experience in data integration and the specification of data services.
Experience in literacy language development bilingual education neuroscience
Experience working with schools universities nonprofit organizations or public-sector initiatives.
Familiarity with AI-enabled educational technologies digital assessment platforms and predictive analytics.
Required Experience:
Manager
- ...Duties: The Manager, Clinical Data Management leads the data management components of a clinical trial ranging from small early phase to large... ...serving as the primary data management liaison with vendors and senior management. This position will manage essential duties and...SeniorPermanent employmentLocal area
- ...Responsibilities Represent Data Management in study team meetings, providing metrics and guidance on data-related issues. Oversee Data Management activities from study start-up to close-out. Develop and manage study timelines and ensure the quality and timeliness of data...Senior
- ...and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,... ...enterprise migration platforms.Minimum of 5 years of experience managing cross-functional delivery teams in a program or workstream lead...SeniorWork experience placementLive inWork at officeLocal area
- ...by combining creativity, technology, and data-driven intelligence. Within Song, the Customer... ...product data specialists, mentoring L7 Managers and elevating the practice capability... ...RoleAs a Product Data & Agentic Commerce Senior Manager, you will help define and execute...SeniorLive inWork at officeLocal area
- Genentech is seeking a Senior Data Product Manager - Analytics & AI to drive forecasting data products and AI strategy across the organization. You will partner with leadership to define roadmaps and manage cross-functional execution, mentoring agile squads and aligning...Senior
- Katalyst CRO is seeking an experienced Data Management professional to lead data activities in clinical trials in San Francisco. Represent DM in study teams, oversee DM from start-up to close-out, and ensure timely, high-quality data from providers. The role requires 7+...Senior
- Salesforce is seeking a data-driven Product Manager for the Data Products team to shape data experiences across Slack integrations and agents. You will partner with engineering, data teams, and executives to define strategy, prototype with coding agents, and drive metrics...Senior
- Superhuman is hiring a Senior Product Manager to own the core data model and shared data services powering multiple products across the Superhuman suite. You will design data structures that enable intelligent, connected experiences for internal teams and customers. You...Senior
- Reddit is seeking a Staff Operations Program Manager to lead the central data labeling function and scale LLM-assisted workflows. This high-visibility role engages with product and engineering teams to translate requirements into scalable labeling directives and drive...SeniorRemote work
- Jaquith Consulting Group is seeking an experienced Commissioning Lead Project Manager to oversee the end-to-end validation of mission-critical facilities, ensuring they are delivered safely, efficiently, and to the highest standards of quality and readiness at the San Francisco...Senior
- Salesforce, Inc. is seeking a skilled Product Manager for its Data Products space to shape AI-driven data experiences for Slack. You will work with engineers and data teams to prototype with coding agents, build dashboards, and deliver actionable insights within workflows...Senior
- Headway is redefining access to mental healthcare in the United States. As Senior Data Science Manager for Provider Growth Product, you will shape data science strategy, partner with Product, Engineering, Operations, Design, Clinical and Customer Success leadership, and...Senior
- CLOUDSUFI is seeking a seasoned Program Lead for a Data Platform program to own end-to-end delivery across a multi-year enterprise initiative. You will manage a distributed team of 20+ engineers across the US and India, ensure technical excellence, delivery performance,...Senior
- ...connected vehicle intelligence leader to drive analytics for fleet operators, rental companies, dealerships, and lenders. The Senior Data Product Manager will own strategy, delivery, adoption, and commercial growth of data and analytics products behind an AI layer in...Senior
- ...25 automotive OEM brands. Their platform turns raw vehicle data into analytics and actionable insights for fleet operators,... ...AI product layer now in development. They're now hiring a Senior Data Product Manager to lead the strategy, delivery, adoption, and commercial growth...SeniorImmediate start
- Breakout Ventures is seeking a Senior Scientist to join our frontier team at the interface of spatial biology and AI model development.... ...generation AI models. The role emphasizes independent execution, data quality enforcement across high-volume runs, and mentorship of...Senior
$140.3k - $260.5k
...health challenges and transforming society. Who We Are Our Data, Digital,and Analytics (DDA) team is dedicated to solving... ...built on collaboration and innovation. The Opportunity As a Senior Data Product Manager - Analytics & AI , you will drive the development,...SeniorLocal areaRelocation package3 days per week$154.7k - $224.25k
Boeing is seeking a Senior AI/ML Developer in San Francisco, CA. Candidates must possess a solid background in artificial intelligence,... ...extensive experience with R or Python. The role involves leading data science teams, working on complex analytics projects, and...Senior$86.8k - $217.1k
IQVIA is growing! Hiring multiple Senior Data Team Leads across our FSP (Functional Service Provider) and Traditional (Sponsor-Agnostic... ...Senior Data Team Leads to oversee end-to-end data management delivery for global clinical trials. You’ll ensure quality, accuracy...SeniorFull timePart timeImmediate startRemote workWork from homeWorldwide- EY is seeking an Associate Director for Data Product and Asset Governance to shape governance for enterprise data products and assets. You will blend governance, product management and hands‑on implementation to enable trusted, searchable data assets and federated stewardship...Senior
- ...of integrated cloud capabilities across data, edge, integrated infrastructure and applications... ...; deep experience in cloud change management; and cloud-ready operating models with a... ...specific team sales activities.Interacts with senior management levels at clients and within...SeniorWork experience placementLive inWork at officeLocal areaShift work
- ...Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately... ...power of advanced technologies.The Work:Accenture is seeking a Senior Manager to lead Planning transformation work within our Supply Chain &...SeniorLive inWork at officeLocal areaShift work
- A leading biotechnology company in San Francisco is seeking an experienced professional to oversee clinical data collection and validation. The ideal candidate will have 5-10 years of experience, strong problem-solving and communication skills, and knowledge of GCP and...Senior
$124k - $280k
...ApplicableSpecialismData ScienceManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist - Senior Manager you will leverage advanced analytics, statistical modeling, and data visualization to help clients solve complex business...SeniorFull timeH1b- Katalyst CRO seeks an experienced Clinical Data Manager to lead data quality evaluations across clinical and operational data, guiding studies managed by data teams. You will apply CDISC standards, supervise contractors, and ensure data systems meet timelines and budgets...SeniorFor contractors
$230k - $317k
...Cloudflare is looking for a principal individual contributor to drive data strategy and execution for the Revenue Operations team! This is... ...Analytics and IT teams to implement and optimize hardened data management tools and technologies ensuring alignment with business needs...SeniorTemporary workLocal areaFlexible hours- ...Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We... ...forward in cost-out, strategic category management, and procurement operations. You are:A... ...integrationsExperience working directly with senior stakeholders (CTO, CFO, CISO) on AI...SeniorContract workWork experience placementLive inWork at officeLocal area
$124k - $280k
...ManagerJob Description & SummaryThe OpportunityAs a Google AI & Data Solutions Architect you will lead client-focused solution... ...approaches within our Data and Analytics Engineering practice. As a Senior Manager you will lead large projects, apply sound judgment, coach...SeniorFull timeH1b- Anthropic is seeking a Senior Data Center Capacity Delivery Manager to embed with project teams delivering leased and partnered data center capacity. You will lead partners to meet the fastest schedule while keeping a safe site and ensuring high-quality data centers. You...Senior
$124k - $280k
...ServicesSpecialismOperationsManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Payer Healthcare Data Engineer, Senior Manager you will lead data and analytics engineering efforts that support payer modernization, design data solutions, and turn complex...SeniorFull timeH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Psychometrician and Data Manager. Be the first to apply!
- remote data manager San Francisco, CA
- director data architecture San Francisco, CA
- data product manager San Francisco, CA
- entry level clinical data manager San Francisco, CA
- healthcare data manager San Francisco, CA
- data engineer manager San Francisco, CA
- data operations manager San Francisco, CA
- junior clinical data manager San Francisco, CA
- data manager San Francisco, CA
- senior manager data analytics San Francisco, CA



