Certified Public Accountant for AI Model Evaluation

Join a leading AI research organization as an Accounting Expert, where you will play a crucial role in evaluating the performance of AI systems in real-world accounting tasks. Your primary responsibility will be to define excellence in accounting work by designing task-specific grading criteria and rigorously scoring completed work samples, providing well-reasoned written justifications for your assessments.

• Design precise, task-specific grading criteria for real-world accounting deliverables, including reconciliations, close packages, financial statements and disclosures, workpapers, and technical accounting memos.
• Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
• Apply consistent, evidence-based judgment to ensure that scores are reproducible and defensible.
• Incorporate structured feedback from senior reviewers and iterate quickly on your work.

• 5+ years of professional accounting experience.
• Background in audit, assurance, or advisory at leading global accounting firms, or in senior accounting roles at large public companies.
• CPA or equivalent professional certification strongly preferred.
• Deep fluency in day-to-day accounting practices, including US GAAP application, month-end close, account reconciliations, financial statement preparation and disclosures, and audit-ready workpapers.
• Exceptionally strong written communication skills, with the ability to clearly explain why a piece of work meets or does not meet professional standards.
• Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
• Prior experience with AI training, evaluation, or human-data projects is a strong plus.

This is a remote position with an hourly employment type.

The compensation for this role ranges from $130 to $160 per hour.

Qualified applicants may be asked to complete a brief technical assessment or submit additional information as part of the application process.