Sociology Professor for AI Model Evaluation

Sociology professors apply their teaching, research, and advising expertise to evaluate AI model outputs related to sociology, create realistic prompts that reflect real-world practice, and provide clear, structured feedback that improves model performance. No prior AI experience is required.

• Develop prompts and scenarios that reflect sociology coursework, research, advising, and professional practice.
• Review and evaluate AI-generated content for accuracy, relevance, tone, and alignment with disciplinary standards.
• Provide clear, structured feedback and corrections that help models learn appropriate language, reasoning, and task execution in sociology.
• Assess model responses against real-world expectations, such as lecture content, assignment feedback, research summaries, or student advising guidance.
• Work asynchronously with project teams to complete assigned tasks and deliver evaluations on schedule.

• At least 4 years of professional experience in sociology or a closely related field.
• Relevant experience may include one or more of the following types of responsibilities, which provide the context needed to evaluate and train high-quality models:
• Prepare and deliver lectures on sociology topics, evaluate and grade student work, and facilitate classroom discussions.
• Conduct research and publish findings, while staying current with developments in the field.
• Advise students on academic and career paths, supervise research projects, and participate in departmental or community activities.
• Comfortable performing asynchronous, remote work in collaboration with external AI research teams.
• No prior AI or machine learning experience is required.

• Location: Remote, asynchronous work. Complete tasks independently from your preferred location.
• Employment type: Part time, hourly, temporary engagements.
• Hours and commitment: Flexible with no minimum required, typical assignments average 5 to 20 hours per week.
• Project placement: Assignments are project based, placement depends on project availability. The program runs year-round and new projects open periodically, so applying now may lead to placement on a future project if none are immediately available.

• Up to $90/hr (depending on the project)

• F-1 students may be eligible if they have valid CPT or OPT authorization, subject to your school requirements. Work with your Designated School Official to confirm eligibility.
• If your school requires enrollment in a CPT course or other specific conditions, this program may not satisfy those requirements.
• STEM OPT is not supported.

• Create an account on the program platform and complete a profile.
• Complete identity verification as requested.
• Select and onboard into projects that match your expertise when they are available.
• Begin assigned tasks and receive payment according to the project terms.