Applied Sciences Expert for Visual Document AI Evaluation

This role focuses on evaluating AI models in the domain of visual document understanding and instruction-following within the Applied Sciences, specifically in Physics, Chemistry, and Biology. You will engage in a benchmark dataset project that requires expertise in authoring complex, grounded tasks that include clear ground-truth outputs and objective rubrics. Key Responsibilities

• Author complex tasks that assess AI models on visual document understanding.
• Develop clear ground-truth outputs and objective rubrics for evaluation.
• Collaborate with a team to ensure high-quality benchmarks.

• Expertise in Applied Sciences, particularly in Physics, Chemistry, or Biology.
• Experience in creating evaluation tasks for AI models.
• Strong analytical and writing skills.

• Remote position.
• Approximately 15, 20 hours per week.
• Available to candidates located in the US or Canada.

• Hourly rate of $100.