Software Engineer, TypeScript Codebase Q&A

Create challenging codebase-exploration tasks that help train AI agents to investigate and reason about unfamiliar software repositories. Your work will focus on high-level engineering questions in production TypeScript and JavaScript codebases that require evidence from runtime behavior and investigation across multiple files.

Tasks draw from prominent JavaScript and TypeScript projects, including Babel, Jest, Astro, TypeORM, Apollo Server, GraphQL-JS, Socket.IO, TanStack Router, NextAuth, XState, TypeDoc, and typescript-eslint.

• Select assignments from a pre-validated pool of TypeScript repositories pinned to specific Git commits. Each assignment includes an engineering question, positive and negative scoring rubrics, foils, and a reference solution.
• Investigate the relevant subsystem and associated pull request or issue history until you understand its behavior.
• Rewrite questions to be difficult for advanced coding agents while remaining precise and fairly answerable.
• Refine rubrics and foils to reward sound reasoning and reject plausible but incorrect responses.
• Complete the validation workflow, Check, Golden, Run, and Analyze, iterating until every stage passes.
• Document completed work in the task README, submit it for expert review, and address feedback on returned tasks.

• At least 3 years of professional software engineering experience, including substantial production TypeScript work.
• Ability to navigate large, unfamiliar TypeScript monorepos and explain runtime behavior, not only type-level behavior.
• Advanced knowledge of TypeScript''s type system, module resolution, bundlers, transpilers, Node and browser runtimes, and the ability to read compiler and plugin internals.
• Relevant experience with developer tooling, compilers, test frameworks, GraphQL servers, or state machines. The task mix is weighted toward architecture and system design, 48%, and code onboarding, 35%.
• Precise written English, since the questions and rubrics you produce are central deliverables.
• Comfort working with commit-level Git history, containerized environments, and command-line tools.

• Remote, asynchronous, per-task independent-contractor work with team leads across US, India, and Nigeria time zones.
• Work is completed in the designated studio environment. Time is tracked with Insightful, and access is provisioned through Okta.
• Before receiving task access, candidates must complete identity verification, a background check, required work and confidentiality agreements, a tax form, and a short calibration quiz.
• Each task is reviewed by a second engineer and a senior reviewer before approval.

$130 per approved task.

Submit a resume or relevant technical background. Qualified applicants may be asked to complete a brief technical assessment or provide additional information.