Software Engineering Workflow Annotator [Remote]

Help create a library of realistic, multi-step software engineering workflows that train and evaluate next-generation AI systems. You will design, execute, and document end-to-end engineering scenarios that capture step-by-step actions, rationale, edge cases, and artifacts so models learn to reason about real engineering processes. Domain expertise in practical software engineering and GitHub-centered workflows matters more than prior AI experience.

• Design and author detailed, multi-step task scenarios that reflect authentic software engineering activities, such as pull request management, issue triage, merge conflict resolution, and CI configuration updates using GitHub.
• Execute workflows in real time within actual tools, recording every step, the intent behind actions, decision points, and edge cases to create complete, actionable records.
• Integrate common collaboration and productivity tools where appropriate, for example Slack and Microsoft 365 or Google Workspace, and include data system touchpoints such as Snowflake when relevant to the workflow.
• Produce clear, structured documentation for each workflow: ordered steps, the intent at each stage, expected outcomes, and supporting visual artifacts such as screenshots and logs when needed.
• Identify and flag ambiguous or unrealistic scenarios to the data program team, then refine workflows based on feedback to improve realism and annotation utility.
• Submit deliverables and collaborate with project leads using the project''s internal annotation platform.

• Minimum 2 years of professional software engineering experience with daily use of GitHub-centered workflows.
• Required skills: engineering knowledge, GitHub proficiency, and familiarity with annotation-style documentation.
• Strong written English, with high attention to clarity, consistency, and detail in process documentation.
• Hands-on familiarity with Slack and Microsoft 365 or Google Workspace as part of regular engineering activities.
• Experience designing or participating in code review, branching, versioning, or release workflows.
• Preferred but not required: exposure to CI/CD pipelines, code review platforms, process documentation systems, basic SQL skills especially with Snowflake, and prior experience in data annotation, technical writing, or QA documentation.

• Role type: Contractor.
• Location: Remote.
• Work will involve using the project’s internal annotation platform to submit work and communicate with project leads.

• Pay range: $14.00 to $36.00 per hour.

• No prior AI experience required; domain expertise in software engineering is the primary qualification.