Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Psychometrician and Data Manager

Full-time

University of California, San Francisco

Description

Multitudes is seeking a senior Psychometrician and Data Manager to lead the design validation analysis and strategic use of data across its educational implementation initiatives. This individual will oversee the organizations measurement framework and data systems ensuring that assessments and analytics meet the highest standards of scientific rigor validity reliability equity accessibility and usability.

Reporting to the Chief Operating Officer (COO) the Psychometrician and Data Manager serves as the scientific and technical lead for the Multitudes Project across its research education and product initiatives. The role combines expertise in psychometrics educational measurement quantitative methods and applied data science with strategic leadership to translate complex statistical findings into actionable insights that advance the development and implementation of the Multitudes screening platform.

The ideal candidate holds deep expertise in psychometrics educational measurement quantitative psychology statistics or a related discipline with experience in literacy education neuroscience developmental science or behavioral research. This individual will collaborate across multidisciplinary teams contribute to assessment development oversee data infrastructure mentor analysts and ensure data quality governance and regulatory compliance across multiple institutional partners.

In addition we expect the ideal candidate to lead the organizational data architecture and analytics strategy. Build together with their team scalable systems for data collection management quality control visualization and reporting. Oversee complex statistical analyses and interpretation of longitudinal and intervention data. Develop dashboards technical reports white papers and presentations for internal and external stakeholders. Translate data into actionable recommendations for program improvement policy and research dissemination.

Because our implementation work is grounded in research we expect the ideal candidate to collaborate with interdisciplinary teams including neuroscientists literacy researchers educators clinicians and software developers. Contribute to grant writing research publications conference presentations and external partnerships. Support the development of innovative measures that integrate educational cognitive and behavioral data and help establish Multitudes as a national leader in evidence-based measurement and evaluation.

In addition the ideal candidate is expected to build and mentor a high-performing analytics and research team. Establish best practices for data governance reproducibility documentation and ethical data use and supervise external research and evaluation partners as needed.

The role will provide psychometric and measurement leadership for the development validation refinement and scaling of Multitudes assessments and related measurement systems. Responsibilities will include supporting the research team in designing and overseeing studies of reliability validity measurement invariance item functioning growth and sensitivity to intervention effects while applying appropriate modern psychometric and statistical approaches including Item Response Theory (IRT) Classical Test Theory multilevel and structural equation modeling latent growth modeling and Bayesian methods. The role will also help ensure that assessments and measurement approaches are culturally responsive equitable and appropriate for multilingual and diverse student populations.

The role will lead data strategy analytics and research collaboration including developing scalable approaches to data collection management quality assurance analysis visualization and reporting. This includes overseeing analyses of large-scale longitudinal and intervention datasets and translating findings into actionable recommendations for assessment refinement program improvement policy and research dissemination. The role will collaborate closely with interdisciplinary partnersincluding literacy researchers neuroscientists educators clinicians data scientists and software developersand contribute to grant proposals peer-reviewed publications technical reports white papers conference presentations and external research partnerships. The work will also support the development of innovative measures integrating educational cognitive behavioral and other relevant data.

The role will strengthen research and analytics infrastructure and organizational capacity by establishing best practices for data governance reproducibility documentation ethical data use fairness and bias evaluation. Responsibilities may include building and mentoring a high-performing research and analytics team and overseeing external research or evaluation partners. The ideal candidate will bring advanced training in psychometrics quantitative psychology educational measurement statistics biostatistics or a related field; substantial experience with assessment development validation advanced statistical modeling and large and complex datasets; and strong quantitative programming and communication skills. Experience in literacy language development bilingual education developmental science neuroscience educational technology responsible AI or school-based research is particularly valuable.

Department Overview

Multitudes is a State of California-funded initiative that bridges neuroscience and education to identify reading difficulties including dyslexia in early childhood and support timely intervention. The project has developed English and Spanish screening instruments and is expanding into mathematics additional languages and other domains related to brain health.

Multitudes is part of the UCSF Dyslexia Center within the Edward and Pearl Fein Memory and Aging Center. The Dyslexia Center brings together neuroscientists clinicians geneticists and educators to improve diagnosis intervention and lifelong outcomes for individuals with learning differences through multidisciplinary research spanning language cognition aging and brain health.

The Department of Neurology is one of the nations leading academic neurology departments with over $120 million in annual operations and the highest NIH funding among U.S. neurology departments. Its mission is to deliver exceptional clinical care conduct transformative research and educate future leaders in neurology and neuroscience.

Responsibilities

%

of time

Essential Function (Yes/No )

Key Responsibilities

(To be completed by Supervisor)

20

Yes Lead and oversee psychometric analyses using Classical Test Theory Item Response Theory (IRT) equating measurement invariance latent growth modeling multilevel modeling structural equation modeling Bayesian methods and related approaches.

10

yes Direct and provide technical oversight to the research team in planning research studies including sampling strategies instrument development validation studies longitudinal analyses and intervention evaluations.

10

yes Lead and oversee the development validation refinement and scaling of educational assessments that are reliable valid equitable culturally responsive and appropriate for multilingual populations.

5

yes Define technical requirements for research studies product development and platform analytics.

10

yes Develop and oversee scalable data architecture pipelines quality assurance processes dashboards and reporting systems. Manage complex datasets supporting research collaborations across UCSF schools universities and external partners.

5

yes Translate complex quantitative findings into actionable recommendations for researchers educators clinicians and product teams.

15

yes

Supervise and mentor junior analysts and research staff.

Assign and prioritize work; establish deliverables and performance expectations; review work products and technical approaches; provide coaching and technical direction; manage workload and resource allocation; address performance and workflow issues; and ensure staff accountability for data quality documentation timelines and program objectives.

5

yes Collaborate on scientific publications grant proposals technical reports conference presentations and external partnerships.

5

yes Establish best practices for data governance reproducibility documentation ethical data use and regulatory compliance.

15

yes Support long-term data strategies including infrastructure for artificial intelligence predictive analytics and precision education initiatives.

100%

(To update total % enter the amount of time in whole numbers (without the % symbol - e.g. 15 20) then highlight the total sum (e.g. 1%) at the bottom of the column and press F9. The total sum should add up to 100%.)

Qualifications

Required Qualifications


Bachelors degree in related area and five or more years of relevant experience which includes three or more years of supervisory experience and / or equivalent experience / training
5 years of advanced experience in psychometrics and quantitative research.
Experience managing large and complex datasets
Strong communication skills with the ability to explain technical findings to non-technical audiences.
Familiarity with highly complex logical data design and data mapping or data conversion.
Experience building and leading multidisciplinary research and analytics teams.
Demonstrated ability to work with others from diverse backgrounds. Demonstrated effective communication and interpersonal skills. Demonstrated service orientation skills.
Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization.
Self-motivated and works independently and as part of a team. Strong organizational skills.
Demonstrated advanced problem-solving skills. Able to learn effectively and meet deadlines.
Advanced analytical and design skills including the ability to abstract information requirements from real-world processes to understand information flows in computer systems.
Ability to represent relevant information in abstract models. Critical thinking skills and attention to detail.
Demonstrated skill in managing technical staff.
Requires critical thinking persuasion / negotiation mentoring leadership / management problem solving human resources policies and procedures relating to management responsibilities verbal and written communication quantitative abilities analytical strong technical database systems skills.
Demonstrated expertise in assessment development IRT and advanced statistical modeling longitudinal data analysis validation studies and educational or behavioral measurement.
Strong programming and analytic skills in R Python SAS or SPSS.

Preferred Qualifications


PhD in Psychometrics Quantitative Psychology Educational Measurement Statistics Biostatistics or related field.
Experience in data integration and the specification of data services.
Experience in literacy language development bilingual education neuroscience
Experience working with schools universities nonprofit organizations or public-sector initiatives.
Familiarity with AI-enabled educational technologies digital assessment platforms and predictive analytics.

Required Experience:

Manager

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Psychometrician and Data Manager in San Francisco, CA vacancy
  •  ...Duties: The Manager, Clinical Data Management leads the data management components of a clinical trial ranging from small early phase to large...  ...serving as the primary data management liaison with vendors and senior management. This position will manage essential duties and... 
    Senior
    Permanent employment
    Local area

    Integrated Resources, Inc.

    San Francisco, CA
    16 hours ago
  •  ...Responsibilities Represent Data Management in study team meetings, providing metrics and guidance on data-related issues. Oversee Data Management activities from study start-up to close-out. Develop and manage study timelines and ensure the quality and timeliness of data... 
    Senior

    Katalyst CRO

    San Francisco, CA
    5 days ago
  •  ...and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,...  ...enterprise migration platforms.Minimum of 5 years of experience managing cross-functional delivery teams in a program or workstream lead... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    3 days ago
  •  ...by combining creativity, technology, and data-driven intelligence. Within Song, the Customer...  ...product data specialists, mentoring L7 Managers and elevating the practice capability...  ...RoleAs a Product Data & Agentic Commerce Senior Manager, you will help define and execute... 
    Senior
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    2 days ago
  • Genentech is seeking a Senior Data Product Manager - Analytics & AI to drive forecasting data products and AI strategy across the organization. You will partner with leadership to define roadmaps and manage cross-functional execution, mentoring agile squads and aligning... 
    Senior

    Genentech

    San Francisco, CA
    1 day ago
  • Katalyst CRO is seeking an experienced Data Management professional to lead data activities in clinical trials in San Francisco. Represent DM in study teams, oversee DM from start-up to close-out, and ensure timely, high-quality data from providers. The role requires 7+... 
    Senior

    Katalyst CRO

    San Francisco, CA
    6 hours ago
  • Salesforce is seeking a data-driven Product Manager for the Data Products team to shape data experiences across Slack integrations and agents. You will partner with engineering, data teams, and executives to define strategy, prototype with coding agents, and drive metrics... 
    Senior

    Salesforce, Inc.

    San Francisco, CA
    1 day ago
  • Superhuman is hiring a Senior Product Manager to own the core data model and shared data services powering multiple products across the Superhuman suite. You will design data structures that enable intelligent, connected experiences for internal teams and customers. You... 
    Senior

    Coda

    San Francisco, CA
    1 day ago
  • Reddit is seeking a Staff Operations Program Manager to lead the central data labeling function and scale LLM-assisted workflows. This high-visibility role engages with product and engineering teams to translate requirements into scalable labeling directives and drive... 
    Senior
    Remote work

    Localization Unlocked

    San Francisco, CA
    1 day ago
  • Jaquith Consulting Group is seeking an experienced Commissioning Lead Project Manager to oversee the end-to-end validation of mission-critical facilities, ensuring they are delivered safely, efficiently, and to the highest standards of quality and readiness at the San Francisco... 
    Senior

    Jaquith Consulting Group Inc

    San Francisco, CA
    1 day ago
  • Salesforce, Inc. is seeking a skilled Product Manager for its Data Products space to shape AI-driven data experiences for Slack. You will work with engineers and data teams to prototype with coding agents, build dashboards, and deliver actionable insights within workflows... 
    Senior

    Salesforce, Inc.

    San Francisco, CA
    1 day ago
  • Headway is redefining access to mental healthcare in the United States. As Senior Data Science Manager for Provider Growth Product, you will shape data science strategy, partner with Product, Engineering, Operations, Design, Clinical and Customer Success leadership, and... 
    Senior

    Headway

    San Francisco, CA
    1 day ago
  • CLOUDSUFI is seeking a seasoned Program Lead for a Data Platform program to own end-to-end delivery across a multi-year enterprise initiative. You will manage a distributed team of 20+ engineers across the US and India, ensure technical excellence, delivery performance,... 
    Senior

    Cloudsufi

    San Francisco, CA
    1 day ago
  •  ...connected vehicle intelligence leader to drive analytics for fleet operators, rental companies, dealerships, and lenders. The Senior Data Product Manager will own strategy, delivery, adoption, and commercial growth of data and analytics products behind an AI layer in... 
    Senior

    Harnham

    San Francisco, CA
    1 day ago
  •  ...25 automotive OEM brands. Their platform turns raw vehicle data into analytics and actionable insights for fleet operators,...  ...AI product layer now in development. They're now hiring a Senior Data Product Manager to lead the strategy, delivery, adoption, and commercial growth... 
    Senior
    Immediate start

    Harnham

    San Francisco, CA
    1 day ago
  • Breakout Ventures is seeking a Senior Scientist to join our frontier team at the interface of spatial biology and AI model development....  ...generation AI models. The role emphasizes independent execution, data quality enforcement across high-volume runs, and mentorship of... 
    Senior

    Breakout Ventures

    San Francisco, CA
    4 days ago
  • $140.3k - $260.5k

     ...health challenges and transforming society. Who We Are Our Data, Digital,and Analytics (DDA) team is dedicated to solving...  ...built on collaboration and innovation. The Opportunity As a Senior Data Product Manager - Analytics & AI , you will drive the development,... 
    Senior
    Local area
    Relocation package
    3 days per week

    Genentech

    San Francisco, CA
    1 day ago
  • $154.7k - $224.25k

    Boeing is seeking a Senior AI/ML Developer in San Francisco, CA. Candidates must possess a solid background in artificial intelligence,...  ...extensive experience with R or Python. The role involves leading data science teams, working on complex analytics projects, and... 
    Senior

    Boeing Co.

    San Francisco, CA
    1 day ago
  • $86.8k - $217.1k

    IQVIA is growing! Hiring multiple Senior Data Team Leads across our FSP (Functional Service Provider) and Traditional (Sponsor-Agnostic...  ...Senior Data Team Leads to oversee end-to-end data management delivery for global clinical trials. You’ll ensure quality, accuracy... 
    Senior
    Full time
    Part time
    Immediate start
    Remote work
    Work from home
    Worldwide

    IQVIA

    San Francisco, CA
    1 day ago
  • EY is seeking an Associate Director for Data Product and Asset Governance to shape governance for enterprise data products and assets. You will blend governance, product management and hands‑on implementation to enable trusted, searchable data assets and federated stewardship... 
    Senior

    EY

    San Francisco, CA
    1 day ago
  •  ...of integrated cloud capabilities across data, edge, integrated infrastructure and applications...  ...; deep experience in cloud change management; and cloud-ready operating models with a...  ...specific team sales activities.Interacts with senior management levels at clients and within... 
    Senior
    Work experience placement
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    San Francisco, CA
    2 days ago
  •  ...Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately...  ...power of advanced technologies.The Work:Accenture is seeking a Senior Manager to lead Planning transformation work within our Supply Chain &... 
    Senior
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    San Francisco, CA
    2 days ago
  • A leading biotechnology company in San Francisco is seeking an experienced professional to oversee clinical data collection and validation. The ideal candidate will have 5-10 years of experience, strong problem-solving and communication skills, and knowledge of GCP and... 
    Senior

    Compass Consulting

    San Francisco, CA
    6 hours ago
  • $124k - $280k

     ...ApplicableSpecialismData ScienceManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist - Senior Manager you will leverage advanced analytics, statistical modeling, and data visualization to help clients solve complex business... 
    Senior
    Full time
    H1b

    PwC

    San Francisco, CA
    4 days ago
  • Katalyst CRO seeks an experienced Clinical Data Manager to lead data quality evaluations across clinical and operational data, guiding studies managed by data teams. You will apply CDISC standards, supervise contractors, and ensure data systems meet timelines and budgets... 
    Senior
    For contractors

    Katalyst CRO

    San Francisco, CA
    1 day ago
  • $230k - $317k

     ...Cloudflare is looking for a principal individual contributor to drive data strategy and execution for the Revenue Operations team! This is...  ...Analytics and IT teams to implement and optimize hardened data management tools and technologies ensuring alignment with business needs... 
    Senior
    Temporary work
    Local area
    Flexible hours

    WinsAbove

    San Francisco, CA
    1 day ago
  •  ...Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We...  ...forward in cost-out, strategic category management, and procurement operations. You are:A...  ...integrationsExperience working directly with senior stakeholders (CTO, CFO, CISO) on AI... 
    Senior
    Contract work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    San Francisco, CA
    2 days ago
  • $124k - $280k

     ...ManagerJob Description & SummaryThe OpportunityAs a Google AI & Data Solutions Architect you will lead client-focused solution...  ...approaches within our Data and Analytics Engineering practice. As a Senior Manager you will lead large projects, apply sound judgment, coach... 
    Senior
    Full time
    H1b

    PwC

    San Francisco, CA
    3 days ago
  • Anthropic is seeking a Senior Data Center Capacity Delivery Manager to embed with project teams delivering leased and partnered data center capacity. You will lead partners to meet the fastest schedule while keeping a safe site and ensuring high-quality data centers. You... 
    Senior

    Avenue.io Inc.

    San Francisco, CA
    1 day ago
  • $124k - $280k

     ...ServicesSpecialismOperationsManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Payer Healthcare Data Engineer, Senior Manager you will lead data and analytics engineering efforts that support payer modernization, design data solutions, and turn complex... 
    Senior
    Full time
    H1b

    PwC

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Psychometrician and Data Manager. Be the first to apply!