Biologist for AI Model Evaluation [Remote]

Role Overview:

This position involves working on projects aimed at fine-tuning large language models, such as ChatGPT, utilizing strong analytical and English comprehension skills. The ideal candidate will possess a solid foundation in Biology, particularly at the level expected in engineering entrance exams and graduate or PhD-level programs. You will break down complex biological concepts into simple, clear explanations while working efficiently. This role also provides an opportunity to learn how to leverage AI to enhance your analytical skills, positioning you for success in an AI-driven future.

Key Responsibilities:

• Design and solve challenging Biology problems to explore the limitations of large language models.
• Develop high-quality, step-by-step solutions with clear and rigorous reasoning.
• Collaborate with LLM researchers to align problem types with evaluation goals, focusing on areas where models typically struggle, such as conceptual abstraction, multi-step reasoning, and data interpretation.
• Contribute to defining new evaluation benchmarks based on Biology curricula, covering topics from early undergraduate to PhD-level.

Qualifications:

• A Master’s or Ph.D., or currently pursuing a Ph.D./Postdoctoral degree in Biology, Biotechnology, Biochemistry, or a related field is preferred.
• Strong research and analytical skills.
• Ability to provide constructive feedback and detailed annotations.
• Creative and lateral thinking abilities.
• Excellent structured communication and collaboration skills in a remote setting.
• Self-motivated and capable of working independently.
• Access to a desktop/laptop with a reliable internet connection.
• Ability to analyze and solve complex biological problems with a structured, logical approach.
• Ability to explain biology concepts clearly using simple language, visuals, and simulations when necessary.

Work Terms:

• Commitments Required: at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with PST.
• Engagement type: Contractor.

Evaluation Process:

• Shortlisted candidates will be sent a Job Interest Form.
• After the profile review, an assessment will be shared, which must be completed within 24 hours.
• Based on the assessment outcomes, shortlisted candidates will be contacted to schedule an interview.