Applied Computer Science Benchmark Specialist

Role Overview

Create and evaluate rigorous academic computer science assessments that support AI research benchmarks. This fully remote role focuses on producing gold-standard multiple-choice questions and verifying their technical accuracy, clarity, and level of rigor across advanced computer science disciplines.

Computer Science Domains

Accelerator and GPU kernel engineering, formal methods and automated reasoning, computer architecture and accelerators, distributed systems, DevOps and site reliability, data engineering and databases, cloud and infrastructure, operating systems and kernel systems, machine learning engineering, web and API development, embedded systems engineering, computer graphics and game development, and mobile engineering.

Key Responsibilities

• Author original, challenging multiple-choice questions that assess deep conceptual understanding rather than surface-level recall.
• Ensure every question is self-contained, unambiguous, and precisely defined, with all necessary information included in the prompt.
• Assign a difficulty rating of Medium, introductory undergraduate; Hard, advanced undergraduate; or Expert, postgraduate and above.
• Provide one correct answer and nine plausible, subtly incorrect alternatives designed to challenge expert-level solvers.
• Write clear, concise, step-by-step solutions with intermediate reasoning in Markdown format.
• Include one to five academic references per question from reputable sources, such as peer-reviewed journals or university repositories.
• For verification assignments, review pre-written questions for accuracy, clarity, completeness, precision, and solvability; make needed edits and document the rationale for changes.
• Depending on assignment type, either create and submit new questions for review or verify and improve existing questions in your area of expertise.

Qualifications

• PhD or doctoral candidacy in Computer Science, Electrical Engineering, or a closely related field.
• A master''s degree may be considered for candidates with exceptional depth in a particular subdomain.
• Strong graduate-level knowledge of computer science theory, algorithms, systems design, and/or machine learning.
• Research publications, experience at leading technology companies, or a competitive programming background are strong advantages.
• Excellent written English and the ability to communicate complex ideas clearly and concisely.

Work Terms

• Fully remote, asynchronous hourly engagement.
• Expected commitment of at least 10 hours per week.

Compensation

$66 to $84 per hour.