Data Analyst

Role Overview

Help evaluate AI assistants in real-world analytical workflows that use cloud data warehouses. You will contribute domain expertise and high-quality feedback that helps improve how AI systems analyze data, reason through problems, and produce reliable results. Prior AI experience is not required.

Key Responsibilities

• Complete structured evaluation tasks that mirror common analytical work, including anomaly investigations, KPI reporting, and data refreshes, using AI-powered tools connected to cloud data warehouses.
• Validate AI-generated figures against source data by writing and running SQL queries.
• Assess the accuracy of data joins, filters, and time windows used in analytical outputs.
• Maintain, reset, and manage seeded Snowflake datasets to preserve data integrity and correct answer states for test scenarios.
• Manage warehouse roles, permissions, and access controls to support secure, repeatable evaluation environments.
• Configure and document connectivity and authentication processes across analytics and SaaS platforms.
• Investigate and document new or undocumented product behavior encountered during workflows.
• Participate in peer calibration sessions to support consistent, rigorous grading and scoring.

Qualifications

• At least 3 years of hands-on experience as a Data Analyst or Analytics Engineer.
• Advanced SQL skills and Snowflake expertise, including warehouses, access controls, and query history.
• Experience auditing and reconciling reported metrics against raw data, with the ability to identify subtle aggregation or logic errors.
• Experience using connectors across Claude and ChatGPT.
• Knowledge of business and finance analytics, including KPI definitions and reporting for leadership or external stakeholders.
• Experience administering database access, including roles, grants, and authentication or security protocols. Familiarity with OAuth or security integrations is beneficial.
• Working knowledge of SaaS tools such as Slack, Google Workspace, or Microsoft 365 for sharing analytical outcomes.
• Experience using AI assistants for analytics and critically evaluating AI-generated SQL and outputs.
• Background in rubric-based evaluation, QA, or data labeling, with strong written and verbal communication and close attention to detail.

Work Terms

• Remote contract engagement.

Compensation

• $50 to $60 per hour.