Senior Full-Stack Engineers (React): AI Evaluation Environments

Role Description

We are hiring senior full-stack engineers to help build and refine next-generation coding environments that evaluate AI agents. This work directly supports the development of robust grading systems that accurately measure how effectively an AI agent solves complex coding tasks. The goal is to create secure evaluation suites that cannot be bypassed or easily cheated by the models.

Throughout this long-term engagement, you will work remotely with real website clones to identify bugs and write technical specifications. You will build comprehensive automated test suites designed to grade AI-generated code. This involves analyzing how an agent interacts with a given task and ensuring the grading logic is watertight. The process requires deep technical scrutiny and creative problem-solving to account for unpredictable AI behavior.

Qualifications

• Senior-level experience in full-stack software engineering
• Deep professional expertise building web applications with React
• Strong background in automated testing and technical specification writing
• Available for an ongoing, high-commitment technical engagement

Requirements

• Interact with real website clones to identify bugs and workflow gaps
• Write detailed technical specifications for complex AI coding tasks
• Build robust automated test suites to securely grade AI agent performance
• Ensure grading logic is watertight and resistant to AI bypassing or shortcuts

Compensation

• $75 per hour

Company Description

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com or on YouTube at @jointerac .