Legal Domain Expert (SME) – AI Model Evaluation in New York at Jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Legal Domain Expert (SME) – AI Model Evaluation based in the United States.

This is a remote, flexible opportunity for an experienced legal professional to help evaluate the quality and reliability of AI-generated legal content.
You will apply your legal expertise to assess research, statutory interpretation, legal reasoning, citations, drafting, and factual accuracy.
Your evaluations will help identify errors, unsupported conclusions, weak reasoning, and jurisdictional inaccuracies in AI-generated responses.
The role combines deep legal knowledge with structured analysis, fact-checking, and the development of objective evaluation standards.
You may contribute expertise across areas including corporate, securities, employment and labor, intellectual property, and other specialized legal domains.
Assignments are designed for experienced practitioners and researchers who can provide precise, defensible feedback independently.
This engagement offers the flexibility of remote contract work while contributing directly to the development and evaluation of increasingly capable AI systems.

• Evaluate AI-generated legal research, analysis, and responses for accuracy, relevance, completeness, and quality.
• Verify legal citations, authorities, statutes, cases, regulations, and other supporting sources.
• Assess whether legal reasoning is logically sound, appropriately supported, and accurate for the relevant jurisdiction.
• Identify factual inaccuracies, unsupported assertions, misleading conclusions, reasoning gaps, and other substantive issues.
• Evaluate legal drafting for clarity, precision, completeness, and adherence to applicable legal standards.
• Develop and apply objective evaluation criteria, scoring frameworks, and rubrics for assessing AI-generated legal work.
• Provide structured, detailed feedback that clearly explains identified issues and distinguishes substantive errors from acceptable variations in legal interpretation.
• Apply specialized expertise in the relevant jurisdiction and practice area to ensure evaluations reflect current and applicable legal standards.
• Participate in an initial calibration exercise and, where successful, take on recurring evaluation assignments.

• Licensed attorney, legal researcher, senior paralegal, or another legal professional with verifiable qualifications relevant to the applicable jurisdiction.
• 3+ years of relevant legal practice or legal research experience, with substantial expertise in at least one applicable legal specialty.
• Strong knowledge of the relevant jurisdiction and demonstrated ability to conduct sophisticated legal research and analysis.
• Verifiable bar admission, legal license, academic qualification, or other relevant professional credentials.
• Excellent legal writing, analytical reasoning, fact-checking, and attention-to-detail skills.
• Ability to evaluate legal arguments objectively and identify subtle factual, jurisdictional, citation, and reasoning errors.
• Strong understanding of applicable statutes, regulations, case law, legal authorities, and professional standards within your area of specialization.
• Ability to communicate complex legal issues clearly through structured written feedback.
• Independent, detail-oriented working style and the ability to meet assignment requirements consistently in a remote environment.
• Priority expertise includes US Corporate Law, US Securities Law, US Employment & Labor Law, Philippines Corporate Law, and China IP / Patent Law.
• Experience with relevant areas such as entity governance, corporate formation, commercial disputes, fiduciary duties, transactional drafting, FINRA and SEC compliance, FMLA/FLSA, wage and hour law, restrictive covenants, commercial contracts, registry compliance, CNIPA standards, patentability, inventive-step analysis, patent examination, or claims drafting is highly relevant.

• USD $46/hour compensation.
• Fully remote engagement within the United States.
• Flexible contract work structured around evaluation assignments.
• Approximately 10–15 hours per evaluation task.
• Potential for ongoing and recurring assignments following successful initial calibration.
• Opportunity to apply professional legal expertise to the evaluation and improvement of AI-generated legal content.
• Independent work environment suited to experienced legal practitioners and researchers.