Data Engineer for AI Model Evaluation

Evaluate and improve frontier AI coding agents by applying professional data engineering judgment to realistic data infrastructure and pipeline scenarios. You will use and assess model-generated implementations for ETL, data warehouses, analytics platforms, and distributed data systems, helping shape model behavior through structured technical assessments.

• Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
• Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems.
• Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
• Compare outputs from multiple frontier models, documenting strengths and weaknesses.
• Apply professional engineering judgment to realistic data engineering scenarios and provide actionable feedback.

• Minimum 2 years of professional data engineering experience.
• Hands-on experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Demonstrated ability to evaluate model-generated data infrastructure and pipeline implementations.
• Experience operating large-scale data platforms is preferred.

• Location: Remote.
• Engagement type: Hourly.
• Sprint-based project model, with sprints that run 12 to 24 hours depending on client requirements.
• Typical individual tasks take approximately 2 to 3 hours after initial ramp-up.
• Spots are limited and are filled on a first come, first serve basis, placement depends on available slots.

• Rate details from source materials: $80 per hour listed, and $400 per accepted task.
• Typical tasks are approximately 2 to 3 hours after ramp-up.
• Payment is tied to accepted work, compensation is awarded for accepted tasks.

• Applicants must meet the qualification requirements listed above, including 2 or more years of professional data engineering experience and regular use of AI coding agents.
• Preference given to candidates with experience operating large-scale data platforms.