This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Domain Advisor Consultant (Subject Matter Expert) based in Germany.

This is an opportunity for an established subject matter expert to help define the standards by which next-generation AI systems are evaluated and improved.
You will bring deep professional or academic expertise to complex AI evaluation and training projects.
The role focuses on creating rigorous benchmarks, assessing model reasoning, and identifying gaps in AI-generated outputs.
You will help translate expert knowledge into clear evaluation criteria, reference examples, and actionable guidance.
Engagements are project-based, flexible, and designed for independent professionals who value autonomy.
Your work can directly influence the accuracy, reasoning quality, and safety of AI systems used at significant scale.
This is a highly analytical consulting opportunity for experts who want to shape how AI performs within their field.

• Review and advise on evaluation criteria and scoring rubrics to determine whether AI-generated outputs meet professional standards within your area of expertise.
• Create, edit, and validate high-quality benchmark tasks, prompts, and responses that can serve as trusted reference data for AI training and evaluation.
• Analyze model failures, including hallucinations, flawed reasoning, and logical inconsistencies, and provide expert explanations of their causes and potential improvements.
• Assess the complexity, nuance, and difficulty of evaluation scenarios to ensure AI systems are tested against sufficiently rigorous and realistic professional challenges.
• Clearly document expert reasoning and recommendations so that technical teams can translate domain knowledge into practical AI evaluation and training methodologies.
• Work under project-specific Statements of Work, delivering agreed outcomes within defined timelines while maintaining your independent professional practices.
• Contribute specialized insight that helps improve the capability, reliability, and safety of AI systems within your field.

• Demonstrated elite-level expertise in a specialized professional or academic domain, supported by an advanced degree such as a PhD, MD, JD, or equivalent industry-recognized achievement.
• Recognized professional standing, such as senior/principal-level leadership, significant publications, major awards, substantial industry contributions, or comparable evidence of domain mastery.
• Current experience as an independent consultant, freelancer, business owner, academic leader, or other professional operating with a high degree of autonomy.
• Strong ability to distinguish high-quality from flawed reasoning and to explain complex concepts clearly in written form.
• Ability to apply deep subject matter expertise to unfamiliar or ambiguous problems and establish what constitutes an accurate, rigorous, and professionally sound response.
• Excellent written communication skills, with the ability to articulate nuanced technical or professional reasoning in a structured and accessible way.
• Prior experience with AI evaluation, machine learning, or generative AI is beneficial but not required.
• Ability to manage your own workspace, equipment, schedule, and professional workflow as an independent contractor.
• Proper registration and authorization to operate as an independent contractor in your country of residence.

• Project-based flexibility: Choose assignments that complement your existing consulting, freelance, or professional work.
• Non-exclusive engagements: Continue working with other clients while participating in projects.
• Flexible delivery: Manage how you complete agreed deliverables in alignment with project requirements and deadlines.
• Defined compensation: Scope, timelines, and compensation are established in advance for each assignment.
• Remote work: Work independently from your own location using your own workspace and equipment.
• Intellectual challenge: Apply and deconstruct your expertise in rare, highly analytical work designed to improve AI reasoning.
• Meaningful impact: Help shape the accuracy, capability, and safety of AI systems through expert-level evaluation and guidance.
• Additional revenue opportunity: Supplement your existing professional or consulting income with specialized project work.
• Global engagement: Collaborate on AI-focused initiatives from anywhere you are legally able to operate as an independent contractor.