STEM Professional for AI Coding Agent Evaluation [Remote]

Contribute your STEM expertise to shape and improve next-generation AI coding agents. In this contractor role you will describe and evaluate how you use AI coding tools in real technical work, supply data-driven feedback on agent behavior, and help train models to handle complex engineering tasks. This opportunity is remote and focused on applying real-world domain knowledge rather than prior AI research experience.

• Share detailed accounts of how you use AI coding agents, including the specific tools, workflows, and technical challenges you address.
• Provide comprehensive descriptions and evaluations of AI agents tackling complex, real-world problems, for example navigating large codebases, advanced debugging, and architectural changes.
• Document step-by-step approaches for using agents to build end-to-end features, resolve ambiguous requirements, or collaborate on multi-person projects.
• Critically assess strengths and limitations of AI coding agents across scenarios, and offer data-driven insights and practical suggestions for improvement.
• Deliver written and verbal feedback that informs model and product development.
• Participate in structured interviews, surveys, and knowledge-sharing sessions to capture your experience as a technical practitioner.

• Extensive hands-on experience as a STEM professional, regularly using AI coding agents as a core tool in your technical toolkit.
• Required skills: experience with AI coding agents, workflow documentation, technical problem-solving, advanced debugging, feature development, architectural refactoring, written communication, verbal communication, stakeholder communication, knowledge sharing, and data-driven analysis.
• Ability to clearly articulate complex technical workflows, challenges, and solutions in writing and verbally.
• Demonstrated track record applying AI assistants to sophisticated tasks, such as end-to-end feature development, architectural refactoring, or advanced debugging in real projects.
• Experience communicating technical concepts to both technical and non-technical stakeholders, and familiarity with popular AI coding tools and emerging best practices.

• Engagement type: Independent contractor role, performed remotely.
• Work will involve contributing to a customer project aimed at advancing AI coding agent capabilities.
• Activities include creating documentation, providing written feedback, and participating in interviews, surveys, and knowledge-sharing sessions as requested by the project team.

Hourly rate, $80.00 to $100.00 per hour.

• No prior AI research or model-building experience required, domain expertise in STEM and practical use of AI coding agents are the primary qualifications.
• Open to professionals who currently incorporate AI coding agents into their workflows and can provide concrete examples of that use.