Engineering and Built Environment Expert for AI Evaluation

This role focuses on creating a benchmark dataset aimed at evaluating AI models for professional document understanding and instruction following specifically within the Engineering & Built Environment domain. You will engage in complex, multi-step tasks that are grounded in real-world workspace files such as technical drawings, project specifications, and engineering reports, as well as web searches and code execution. Each task will be paired with a clearly defined ground truth output and an objective evaluation rubric.

Your primary responsibility will be to author tasks that challenge an AI''s ability to interpret engineering documentation, follow multi-step instructions, and produce precise, well-structured outputs.

• Develop complex, multi-step requests based on real-world engineering documents.
• Ensure each task is aligned with a defined ground truth output and evaluation rubric.
• Test AI capabilities in interpreting engineering documentation and executing instructions.

• A minimum of 3 years of hands-on experience in one or more of the following sub-domains: Mechanical engineering, Civil engineering, Industrial engineering, Architecture.

This is a remote position with a minimum commitment of 15, 20 hours per week.

Hourly compensation ranges from $90 to $110.