Product Manager / Product Owner, AI System Evaluation

Apply product management and product ownership expertise to evaluate written outputs that help train and improve advanced AI systems. This remote contract role focuses exclusively on content and specification analysis, not product delivery or team leadership. Key Responsibilities

• Assess and compare AI-generated responses to prompts involving specifications, release notes, user-facing copy, and stakeholder updates.
• Score content for clarity, tone, instruction adherence, and usefulness for its intended audience.
• Write detailed scoring rationales that explain whether content satisfies prompt requirements and audience needs.
• Identify responses that are fluent but fail to answer the question, as well as otherwise complete content that is unsuitable for users.
• Document factual errors, inconsistencies, and content that exceeds or misses prompt constraints.
• Collaborate asynchronously with project managers and reviewers to maintain consistent, high-quality assessments.

• Professional experience as a Product Manager or certified Product Owner, including a strong record of cross-functional product development.
• Deep product management and product ownership expertise in evaluating content and specifications.
• Native-level English fluency, exceptional written communication, attention to detail, and critical-analysis skills.
• Extensive experience writing and evaluating specifications, PRDs, acceptance criteria, release notes, or decision documents.
• Ability to evaluate whether content is suited to executives, technical stakeholders, or end users.
• Proven ability to provide actionable written feedback on technical or user-facing documentation.
• Ability to work independently and meet remote project deadlines using virtual collaboration tools.
• Familiarity with model evaluation, RLHF, or annotation is helpful but not required.

• Remote contract engagement.
• This is an evaluation and analysis role only. It does not include roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or programme governance.
• Applicants whose backgrounds are primarily project management, programme management, delivery, or Scrum leadership are not a fit for this engagement.

$90 to $140 per hour.

Begin the application using an email address or Google sign-in, then review and accept the applicable terms and privacy policies to continue.