Accountant for AI System Evaluation

Role Overview

Help evaluate how effectively AI systems handle real-world accounting work. You will define the standards for excellent accounting deliverables, then assess completed AI-generated and human work samples using clear, rigorous criteria and well-reasoned written evaluations.

Key Responsibilities

• Create precise, task-specific grading criteria for accounting deliverables, including reconciliations, close packages, financial statements and disclosures, workpapers, and technical accounting memos.
• Evaluate work samples against established criteria and provide detailed written justification for every score.
• Apply consistent, evidence-based judgment so evaluations are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and refine work quickly.

Qualifications

• At least 5 years of professional accounting experience.
• Experience in audit, assurance, or advisory at a leading global accounting firm, or senior accounting experience at a large public company.
• CPA or an equivalent professional certification is strongly preferred.
• Deep working knowledge of US GAAP, month-end close, account reconciliations, financial statement preparation and disclosures, and audit-ready workpapers.
• Exceptional written communication skills, including the ability to explain why work does or does not meet professional standards.
• Strong attention to detail, consistency, and comfort having professional judgment reviewed and calibrated with peers.
• Experience with AI training, evaluation, or human-data projects is a strong plus.

Work Terms

• Remote, hourly engagement.

Compensation

• $130 to $160 per hour.

Application Process

• Submit your resume or relevant professional background for consideration.
• Qualified applicants may be asked to complete a brief technical assessment or provide additional information.