Data Science Expert

Role Description

Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback. This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.

• Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
  • Data analyses
  • Predictive and statistical models
  • Dashboards and visualizations
  • Experiment results
  • Executive recommendations and business insights
• Evaluate AI-generated and human-produced work using objective scoring frameworks.
• Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
• Apply sound analytical judgment to produce reproducible and defensible assessments.
• Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
• Collaborate with cross-functional teams to improve AI training quality and evaluation standards.

Qualifications

• 5+ years of professional experience in Data Science within an industry environment.
• Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
• Deep expertise in:
  • Experimental design and A/B testing
  • Statistical analysis
  • SQL and Python
  • Metric development and performance measurement
  • Translating analytical findings into business recommendations
• Excellent written communication skills with the ability to clearly explain technical reasoning.
• Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
• Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.

Preferred Qualifications

• Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
• Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
• Experience reviewing technical work or mentoring analytical teams is a plus.

Application Process

• Submit your resume or relevant technical background to begin the application process.
• Qualified candidates may be invited to complete a short technical assessment or provide additional information relevant to their expertise.

Benefits

• Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
• Apply your professional data science expertise to high-impact AI evaluation projects.
• Work remotely with flexible scheduling.
• Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.
• We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.

Contract Details

• Independent contractor engagement.
• Fully remote with flexible working hours.
• Project duration may be extended or concluded based on project requirements and performance.
• Weekly payments based on approved work completed.
• Please note that H1-B and STEM OPT sponsorship is not available for this engagement.