STEM Professional for AI Coding Agent Evaluation [Remote]

Contribute domain expertise to improve real-world AI coding agents by documenting how these tools are used in complex software workflows. You will provide detailed, practical input that helps train and evaluate next-generation AI systems, focusing on how AI agents assist with navigating large codebases, debugging, and implementing architectural changes.

• Provide detailed technical accounts and real-world examples of using AI coding agents such as Copilot in sophisticated development workflows.
• Document nuanced use cases where AI agents helped with large codebase navigation, diagnosing and fixing difficult bugs, or executing architectural refactors.
• Produce end-to-end walkthroughs of feature development or ambiguous technical problem solving that involved AI tools, including the decision-making process, tools used, and measurable impacts on productivity or code quality.
• Submit structured assessments and feedback on the practical effectiveness of AI coding agent features and recommend improvements.
• Collaborate asynchronously with project stakeholders, delivering clear, professional written and verbal communication.

• Required skills: experience with AI coding agents (for example Copilot), debugging, technical documentation, written and verbal communication, remote collaboration, large codebase navigation, and problem-solving.
• Preferred: current STEM professional who uses AI coding agents as part of daily technical work.
• Demonstrated ability to apply AI agents to sophisticated programming challenges, including large codebase navigation, debugging complex issues, and architectural refactoring.
• Experience producing detailed technical documentation or feedback for collaborative teams.
• Familiarity with multiple AI coding tools and an understanding of their strengths and limitations.
• Comfort working remotely and asynchronously across distributed teams.
• No prior experience in AI is required; domain expertise and practical experience with coding tools are valued.

• Role type: Independent contractor.
• Location: Remote. Work is performed asynchronously with distributed stakeholders.
• Engagement focuses on contributing expert knowledge to train and evaluate AI coding agents; work will be coordinated through the project team and the organization''s talent vetting process.

• Pay rate: $80.00 to $100.00 per hour.

• Open to independent contractors who can work remotely and communicate clearly in writing and verbally.
• No specific visa or citizenship requirements are stated in the role; candidates must meet any contracting and payment requirements applicable to independent contractors.

If you are interested, prepare to demonstrate your experience by providing examples or descriptions that show how you have applied AI coding agents to complex programming problems. Be ready to share comprehensive walkthroughs that highlight your decision-making, the tools you used, and outcomes when navigating large codebases, debugging, or performing architectural refactors. Applications will be reviewed and vetted as part of the project''s expert selection process.