Data Scientist for AI Evaluation Projects

Join a curated network of experienced data scientists who will be considered for future projects evaluating how well AI systems perform real-world data science tasks. Members of this network may be asked to design evaluation criteria, assess AI or human-produced analyses and models, document decisions in writing, and iterate on evaluations with senior reviewers when projects arise. There is no immediate project opening, but qualified applicants will be contacted as relevant opportunities become available.

• Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
• Evaluate AI-generated or human-created work against the established criteria
• Provide detailed written justifications for evaluations and scores
• Apply consistent, evidence-based judgment so assessments are reproducible and defensible
• Incorporate structured feedback from senior reviewers and iterate on submitted evaluations
• Note: specific responsibilities will vary by project

• At least 1+ years of professional data science experience
• Experience at a leading technology, research, or quantitative firm, such as top FAANG companies, AI labs, top-tier quantitative funds, or equivalent
• Strong command of Python and SQL
• Experience with statistical modeling, machine learning, experimentation, and causal inference
• Proven ability to translate messy real-world data into rigorous analyses
• Exceptional written communication skills, including the ability to convey technical findings clearly
• Detail-oriented, consistent approach to evaluating complex work
• Comfort receiving feedback and calibrating judgment against established standards

• Location: Remote
• Engagement type: hourly
• There is no immediate project opening; placement depends on future project availability
• Specific project duties, hours, and duration will be defined per engagement

• Rate: 100 - 150 hourly

Qualified applicants will be kept in the talent network and may be contacted when opportunities that match their skills arise. There are no guaranteed assignments at the time of application.

Submit your application to join the talent network. Applicants who meet the qualifications will be considered and contacted for relevant future projects as they become available.