Domain Advisor Consultant (Subject Matter Expert)

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Domain Advisor Consultant (Subject Matter Expert) based in Australia.

This is an opportunity for an established subject matter expert to help define the standards by which next-generation AI systems are evaluated and improved.
You will bring deep professional or academic expertise to complex AI evaluation and training projects.
The role focuses on creating rigorous benchmarks, assessing model reasoning, and identifying gaps in AI-generated outputs.
You will help translate expert knowledge into clear evaluation criteria, reference examples, and actionable guidance.
Engagements are project-based, flexible, and designed for independent professionals who value autonomy.
Your work can directly influence the accuracy, reasoning quality, and safety of AI systems used at significant scale.
This is a highly analytical consulting opportunity for experts who want to shape how AI performs within their field.

Accountabilities

• Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated outputs meet professional standards within your area of expertise.
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as trusted reference data for AI training and evaluation.
• Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies, and provide expert explanations of their causes and potential improvements.
• Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are tested against sufficiently rigorous and realistic professional challenges.
• Clearly document expert reasoning and recommendations so that technical teams can translate domain knowledge into practical AI evaluation and training methodologies.
• Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines while maintaining your independent professional practices.
• Contribute specialized insight that helps improve the capability, reliability, and safety of AI systems within your field.

Requirements

• Demonstrated elite-level expertise in a specialized professional or academic domain, supported by an advanced degree such as a PhD, MD, JD, or equivalent industry-recognized achievement.
• Recognized professional standing, such as senior/principal-level leadership, significant publications, major awards, substantial industry contributions, or comparable evidence of domain mastery.
• Current experience as an independent consultant, freelancer, business owner, academic leader, or other professional operating with a high degree of autonomy.
• Strong ability to distinguish high-quality from flawed reasoning and to explain complex concepts clearly in written form.
• Ability to apply deep subject matter expertise to unfamiliar or ambiguous problems and establish what constitutes an accurate, rigorous, and professionally sound response.
• Excellent written communication skills, with the ability to articulate nuanced technical or professional reasoning in a structured and accessible way.
• Prior experience with AI evaluation, machine learning, or generative AI is beneficial but not required.
• Ability to manage your own workspace, equipment, schedule, and professional workflow as an independent contractor.
• Proper registration and authorization to operate as an independent contractor in your country of residence.

Benefits

• Project-based flexibility: Choose assignments that complement your existing consulting, freelance, or professional work.
• Non-exclusive engagements: Continue working with other clients while participating in projects.
• Flexible delivery: Manage how you complete agreed deliverables in alignment with project requirements and deadlines.
• Defined compensation: Scope, timelines, and compensation are established in advance for each assignment.
• Remote work: Work independently from your own location using your own workspace and equipment.
• Intellectual challenge: Apply and deconstruct your expertise in rare, highly analytical work designed to improve AI reasoning.
• Meaningful impact: Help shape the accuracy, capability, and safety of AI systems through expert-level evaluation and guidance.
• Additional revenue opportunity: Supplement your existing professional or consulting income with specialized project work.
• Global engagement: Collaborate on AI-focused initiatives from anywhere you are legally able to operate as an independent contractor.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.