Software Engineering Workflow Annotator [Remote]

This role focuses on contributing to a dynamic project that builds a library of realistic, multi-step engineering workflows. As a Workflow Annotator, you will leverage your expertise to help train next-generation AI systems, shaping how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required; your domain knowledge is what matters. Key Responsibilities

• Design and author detailed, multi-step task scenarios reflecting authentic software engineering activities, such as pull request management, issue triage, merge conflict resolution, and CI configuration updates using GitHub.
• Execute and document each workflow in real time within actual tools, capturing every step, rationale, edge case, and decision point to ensure comprehensive and accurate records.
• Integrate supplemental collaboration tools where appropriate (Slack, Microsoft 365/Google Workspace, Snowflake) to create end-to-end scenarios mirroring real engineering processes.
• Produce clear, structured documentation for each workflow, including step sequencing, intent at each stage, expected outcomes, and visual artifacts (screenshots, logs) as needed for effective annotation.
• Flag ambiguous or unrealistic scenarios to the data program team and refine workflows based on feedback to maximize realism and utility for annotation purposes.
• Work within the Agora internal annotation platform to submit deliverables and collaborate with project leads.

• Minimum 2 years of professional experience in software engineering with daily use of GitHub-centered workflows.
• Strong command of written English, with an emphasis on clarity, consistency, and attention to detail in documenting processes for others to follow.
• Hands-on familiarity with Slack and Microsoft 365 or Google Workspace as part of regular engineering activities.
• Experience designing or participating in code review, versioning, branching, or release workflows.
• Exposure to CI/CD pipelines, code review platforms, or systems for process documentation is an advantage.
• Basic skills in SQL (preferably with Snowflake) are a plus, though not required.
• Prior experience with data annotation, technical writing, or QA documentation is a bonus.

Contractor position, fully remote.

$14 - $36 per hour.

Open to candidates with the required skills and experience, regardless of location.