Survey Researcher for AI Survey Evaluation

Apply your survey research expertise to help evaluate and improve sophisticated AI-generated survey research. This role focuses on distinguishing rigorous, decision-useful surveys from designs that may introduce noise, bias, or misleading results. Key Responsibilities

• Review surveys for methodological quality, clarity, and fitness for purpose.
• Assess questions for leading language, ambiguity, double-barreled wording, response-option issues, ordering effects, and respondent burden.
• Evaluate screeners, eligibility criteria, survey flow, skip and display logic, scales, and questionnaire structure.
• Identify potential sampling, measurement, response, and selection bias.
• Assess whether survey designs are likely to produce reliable, interpretable data from their intended respondent populations.
• Review fielding approaches, respondent recruitment, quotas, sample composition, and data-quality controls.
• Use practical research judgment to resolve ambiguous survey-design questions.
• Provide clear, structured explanations of methodological concerns and recommended improvements.
• Evaluate AI-generated survey content and research reasoning against professional research standards.

• At least 3 years of professional experience in survey research, market research, consumer insights, behavioural science, UX research, or a closely related field.
• Hands-on professional experience designing, fielding, managing, or evaluating surveys.
• Strong knowledge of questionnaire design and common sources of survey error and bias.
• Ability to critically assess survey methodology, rather than only execute predefined questionnaires.
• Strong written communication skills, including the ability to explain why a survey-design decision is methodologically strong or weak.
• High attention to detail and comfort making nuanced judgments with incomplete or ambiguous information.
• Experience with respondent panels, sampling strategies, screeners, quotas, or survey fieldwork is highly valued.
• Experience with Qualtrics, SurveyMonkey, Alchemer, Decipher/Forsta, QuestionPro, or similar research tools is helpful but not required.

• Market research or consumer insights professionals who have designed and fielded quantitative surveys for agencies, consultancies, or internal insights teams.
• Survey researchers or methodologists with expertise in questionnaire design, sampling, measurement, fieldwork, or survey statistics.
• Behavioural science researchers who use surveys, experiments, or structured questionnaires in applied research.
• Quantitative or mixed-methods UX and customer researchers with substantial survey design and fielding experience.
• Professionals in polling or social research, including public opinion, political, social, policy, or population-based survey research.

Relevant experience may include work as a Senior Research Manager, Consumer Insights Manager, Market Research Manager, Survey Researcher, Survey Methodologist, Quantitative Researcher, Behavioural Scientist, Insights Consultant, Research Director, UX Researcher, or Research Scientist. Experience in established market research and insights organizations, research-intensive technology or consumer companies, academic survey centers, behavioural science organizations, or polling and social research institutions is especially relevant. Academic survey-methodology credentials are not required.

• Remote, hourly engagement.

• $120 per hour.