Senior Evaluation Methodologist / Statistician

Job Description

Job Description

Integrated Business & Technical Consultants, Inc. (IBTCI), a U.S.-based international development consulting company established in 1987, has worked in over 100 countries and implemented over 300 projects. IBTCI serves government agencies, private-sector companies, and donor organizations. IBTCI specializes in monitoring, evaluation, research, and learning (MERL) and institutional support across sectors including conflict and crisis, democracy and governance, agriculture, economic growth, food security, education, environment, and global health.

Assignment Title: Senior Evaluation Methodologist / Statistician

Department/Location: Remote, with potential travel to Ethiopia, Ukraine, Haiti, the Philippines, and/or Türkiye

Technical Point of Contact: Team Leader

Type: Consultant, Short-term / Intermittent

Classification: Consultancy

Overview: IBTCI is seeking a Senior Evaluation Methodologist / Statistician to lead quantitative and causal-design components of a proposed Livelihoods Framework and Evaluations assignment. The expert will design proportionate tiers of rigor, sampling strategies, surveys, comparison-group approaches, statistical analysis, and empirical reliability tests that support credible project-level findings and cross-project comparability. Highly rigorous randomized controlled trials are not sought; the role will emphasize feasible, ethical performance and quasi-experimental approaches appropriate to project size, timing, data availability, and operational realities.

Essential Duties/Tasks and Responsibilities:

• Lead the quantitative methodology for the standardized livelihoods framework and project evaluations, ensuring alignment between evaluation questions, indicators, designs, instruments, samples, and analyses.
• Develop project-specific tiers of rigor and recommend feasible designs based on project budget, status, baseline availability, implementation model, security, and access.
• Design ethical comparison-group and quasi-experimental strategies for larger projects when feasible, including matched comparisons, difference-in-differences, interrupted time series, phased rollout, and other defensible approaches.
• Develop sampling frames, stratification and clustering approaches, sample-size and precision calculations, weighting procedures, nonresponse strategies, replacement rules, and documentation suitable for project-level inference and cross-project comparison.
• Design and review short- and long-term outcome surveys, monitoring checklists, vetting instruments, common indicator specifications, response scales, and quantitative components of scorecards.
• Design and oversee empirical inter-rater reliability testing, including selection of appropriate statistics such as kappa coefficients, intraclass correlation coefficients, or agreement measures; recommend benchmarks and revision rules.
• Prepare statistical analysis plans and reproducible syntax; conduct or oversee data cleaning, descriptive and inferential analysis, regression, subgroup and sensitivity analyses, missing-data treatment, and visualization.
• Use SPSS and/or Stata as primary analysis platforms and review statistical outputs for accuracy, assumptions, robustness, and appropriate interpretation.
• Work with data-management staff to establish validation rules, derived variables, data dictionaries, quality-control checks, and secure transfer procedures.
• Contribute methods, limitations, findings, and technical annexes to evaluation plans, reports, scorecards, slide decks, and presentations; explain complex methods clearly to nontechnical stakeholders.

Minimum Qualifications:

• At least 10 years of professional experience in evaluation methodology, statistics, econometrics, survey research, experimental or quasi-experimental design, or applied quantitative research.
• Demonstrated expertise in sampling, survey design, power or precision calculations, and analysis of complex survey or program data.
• Demonstrated experience with quasi-experimental methods such as difference-in-differences, interrupted time series, matching, or comparable causal-inference approaches.
• Advanced proficiency in SPSS and/or Stata, including reproducible syntax and quality review of statistical analysis.
• Experience designing multi-country or multi-site instruments and harmonized indicators for cross-project or cross-country comparison.
• Experience developing and testing instrument reliability and validity, including inter-rater reliability.
• Ability to communicate technical decisions, assumptions, limitations, and findings to technical and nontechnical audiences.
• Excellent written and oral communication skills in English.

Education: Advanced degree in statistics, econometrics, evaluation, economics, quantitative social science, survey methodology, or a closely related field.

Preferred Knowledge, Skills, and Abilities:

• Experience evaluating livelihoods, agriculture, food security, resilience, enterprise development, or market-systems programs.
• Experience designing ethically defensible comparison groups in humanitarian, fragile, or conflict-affected settings.
• Experience in one or more target countries or regions.

Work environment: This position is primarily remote and requires concentrated computer-based analysis and collaboration across time zones.

Physical Requirements: This position requires the ability to speak, hear, see, use a computer or mobile device, and lift small objects up to 20 lbs. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform essential functions.

Supervisory Responsibility: This position does not have supervisory responsibility.

Travel: Limited international travel may be required.

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities required for this assignment. Duties, responsibilities, and activities may change at any time with or without notice.