STEM Professional for AI Coding Agent Evaluation [Remote]

Apply your STEM expertise to help train and improve next-generation AI coding agents. In this contractor role you will document real-world workflows, demonstrate how you use AI coding tools on complex technical problems, and provide high-quality written and verbal feedback that shapes model behavior and capabilities. No prior AI experience is required; domain knowledge and hands-on use of coding agents in challenging engineering contexts are what matter.

• Share detailed, concrete accounts of how you use AI coding agents, including specific tools, workflows, and the technical problems you address.
• Provide comprehensive descriptions and evaluations of using AI agents on complex real-world tasks, such as navigating large codebases, advanced debugging, and architectural refactoring.
• Document step-by-step approaches for leveraging AI agents to build end-to-end features, resolve ambiguous requirements, and collaborate on complex projects.
• Critically assess strengths and limitations of AI agents across scenarios, offering data-driven insights and practical suggestions for improvement.
• Contribute clear written feedback and participate in verbal sessions to inform ongoing model and product development.
• Take part in structured interviews, surveys, or knowledge-sharing sessions that capture your experience and perspectives as a technical expert.

• Required skills: experience with AI coding agents, workflow documentation, technical problem-solving, advanced debugging, feature development, architectural refactoring, written communication, verbal communication, stakeholder communication, knowledge sharing, and data-driven analysis.
• Preferred: extensive hands-on experience as a STEM professional who regularly uses AI coding agents as a core part of your technical toolkit.
• Ability to clearly articulate complex technical workflows, challenges, and solutions in writing and verbally.
• Proven examples of applying AI assistants to sophisticated tasks beyond basic code completion, such as end-to-end feature development, refactoring, or tackling ambiguous problems.
• Experience communicating AI-enabled solutions to both technical and non-technical stakeholders, and familiarity with common AI coding tools and emerging best practices.

• Engagement type: Contractor.
• Location: Remote.

• Hourly pay: $80.00 to $100.00 per hour.

• No prior professional AI development experience required; candidates should bring relevant domain expertise from STEM fields.
• Ideal contributors are current STEM professionals who already integrate AI coding agents into their workflows for complex technical tasks that go beyond basic code completion.