Electrical Engineer for Visual Reasoning Benchmark Development [Remote]

Join a pioneering initiative to develop the Industrial Technical Visual Reasoning Benchmark, an evaluation dataset designed to assess AI models'' reasoning capabilities over authentic engineering visuals. This role offers a unique opportunity for Electrical Engineering experts to create benchmark problems that challenge AI systems in a meaningful way.

As an Electrical Engineering expert, you will:

• Source genuine professional artifacts such as circuit schematics, PCB layouts, block diagrams, timing diagrams, and control systems.
• Craft complex problems that cannot be solved through text alone, ensuring they require deep understanding and reasoning.
• Determine concise and unambiguous final answers for each problem.
• Write step-by-step worked solutions at a professional level.
• Tag each problem with relevant information including its domain, artifact type, skill tested, and difficulty level.
• Collaborate with another domain expert for independent review of each problem before finalization.

This is a part-time, remote engagement, ideal for practicing professionals with hands-on experience in reading and interpreting real electrical engineering artifacts. The focus is on genuine structural, spatial, and multi-step reasoning, moving beyond simplified textbook figures and basic lookup questions.