Software Engineering Workflow Annotator

Contribute detailed, real-world software engineering workflows that teach and evaluate AI systems how to perform multi-step engineering tasks. In this contractor role you will design, perform, and record end-to-end scenarios that reflect everyday engineering activities using GitHub and related collaboration tools, producing high-quality annotated records that capture steps, rationale, edge cases, and expected outcomes. No prior AI experience is required, domain expertise in software engineering is the primary requirement.

• Design and author realistic, multi-step task scenarios that mirror software engineering work, for example pull request management, issue triage, merge conflict resolution, and CI configuration updates using GitHub.
• Execute each workflow in real time inside the actual tools, documenting every action, decision point, and rationale to create a comprehensive record for annotation.
• Integrate supplemental collaboration tools when appropriate, such as Slack, Microsoft 365 or Google Workspace, and Snowflake, to produce end-to-end engineering scenarios.
• Produce clear, structured documentation for each workflow, including ordered steps, the intent at each stage, expected outcomes, and visual artifacts such as screenshots and logs where helpful.
• Identify and flag ambiguous, unrealistic, or otherwise problematic scenarios to the data program team, then refine workflows based on feedback to improve realism and utility.
• Submit deliverables and collaborate with project leads using the Agora internal annotation platform.

• Minimum 2 years of professional software engineering experience, with daily use of GitHub-centered workflows.
• Required skills: engineering background, GitHub fluency, annotation-oriented documentation ability.
• Strong written English, with emphasis on clarity, consistency, and attention to detail in process documentation.
• Hands-on familiarity with Slack and either Microsoft 365 or Google Workspace as part of regular engineering activities.
• Experience designing or participating in code review, branching, versioning, or release workflows.
• Preferred but not required: exposure to CI/CD pipelines, experience with code review platforms, basic SQL skills ideally with Snowflake, prior work in data annotation, technical writing, or QA documentation.

• Engagement type: Contractor.
• Location: Remote.
• Work will be submitted through the Agora internal annotation platform and coordinated with project leads.
• No prior AI experience required; the role leverages your software engineering domain expertise to create training data and evaluations for AI systems.

• Pay range: $14 - $36 per hour.

• Must have the required software engineering experience and daily GitHub usage described above.
• Ability to document workflows in clear written English and to work remotely as a contractor.
• If interested, submit your profile through the platform where this listing appears, including a brief summary of relevant experience and examples or links to GitHub workflows, documentation samples, or similar work that demonstrate your ability to author and document engineering processes.