Data Scientist for AI Model Evaluation

Apply deep domain knowledge to help train and evaluate next-generation AI systems by reviewing, refining, annotating, and validating AI-generated outputs. This part-time, contract role focuses on ensuring accuracy, clarity, and relevance of model outputs through rubric-based evaluation, prompt refinement, fact checking, and high-quality technical writing.

• Review, edit, and refine AI-generated content and data outputs for accuracy, clarity, and domain relevance according to project rubrics.
• Develop and optimize prompts to guide AI models toward desired outputs, using professional writing and technical documentation skills.
• Conduct rubric-based evaluations of AI model performance, providing structured feedback and actionable suggestions.
• Annotate data, perform fact checking, and participate in quality assurance to maintain analytic standards.
• Perform independent research to validate facts and improve content quality.
• Interpret and summarize complex datasets, findings, or analyses into clear reports and technical summaries.
• Collaborate asynchronously with project leads and other domain experts to share insights and best practices.

• Minimum 3 years of professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, or Data Analytics.
• Proven experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation.
• Strong analytical reasoning, critical thinking, and meticulous attention to detail for written and quantitative deliverables.
• Advanced proficiency in professional writing, report writing, and business or technical communication.
• Required skills include critical thinking, analytical reasoning, attention to detail, quality assurance, written communication, technical documentation, prompt authoring and refinement, AI output evaluation, and fact checking.
• Experience with data annotation, content review, rubric-based evaluation, or professional editing is highly desirable.
• Background in prompt engineering, AI output evaluation, fact checking, or RLHF (Reinforcement Learning from Human Feedback) is advantageous but not required.
• Advanced degrees such as a Master, JD, MBA, or PhD are preferred but not mandatory.

• Engagement type: Independent contractor, part-time.
• Location: Remote, work performed asynchronously with project teams.
• Project-based contributions to a customer project focused on advancing AI technology; specific hours are not prescribed and will depend on assignment and project needs.

• Pay range: $100 to $200 per hour.

• No prior AI employment is required; strong domain expertise and experience producing or reviewing technical or research deliverables is the primary qualification.
• Candidates join after being identified and vetted through the platform''s AI-driven screening process; passing that vetting is required to participate in projects.
• Participation is as an independent contractor; applicants should be able to engage under contractor terms and provide the necessary professional-level deliverables remotely.