Director, Policy and Program Evaluation at Federation of State Medical Boards – Washington, District of Columbia

Reporting to the Chief Policy Officer, the Director of Policy and Program Evaluation delivers strategic evaluation leadership across the Education and Policy functions, developing and implementing frameworks that measure outcomes, informing executive decision-making, and strengthen mission-critical impact.

This role establishes and oversees integrated evaluation systems that assess effectiveness, quality, impact, and overall value in advancing FSMB’s mission across policy & education. The Director serves as a strategic advisor to executive leadership, translating research and performance data into actionable insights that inform strategy, innovation, and organizational priorities.

FSMB is an EEO employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin or status as a protected veteran.

Key Responsibilities

Evaluation Framework and Strategic Assessment

• Lead the development, implementation, and continuous refinement of integrated evaluation and research frameworks for policy and education programs.
• Establish and oversee standardized methodologies, metrics, and governance practices to ensure rigor, consistency, and data integrity in policy and education programs.
• Embed evaluation activities throughout program design, implementation, and continuous improvement cycles to strengthen organizational outcomes.
• Guide the development of evaluation methodologies that capture both quantitative and qualitative dimensions of program effectiveness, including participant learning, knowledge translation, and impact on regulatory practice.

Cross Departmental Collaboration and Program Improvement

• Partner with Education and Policy leadership to evaluate programs, identify trends, and recommend evidence-informed strategic enhancements.
• Collaborate with cross-functional teams—including Communications, Research, and Member Services—to improve internal processes and advance organizational performance.
• Facilitate cross-functional teams to interpret evaluation findings and embed them into program design and quality improvement cycles, prioritizing actions that drive measurable quality improvements in outcomes.

Research Leadership and Knowledge Generation

• Provide strategic leadership for enterprise research initiatives that advance knowledge in medical regulation, continuing professional development, and public protection.
• Align research design and portfolios with organizational priorities, ensuring methodological rigor through standardized frameworks and governance structures.
• Identify opportunities to disseminate findings through peer-reviewed publications, conferences, and policy briefs, enhancing FSMB’s thought leadership.

Reporting, Analysis, and Executive Communication

• Oversee the development of executive dashboards, analytical reports, and performance monitoring tools that provide timely, actionable insights.
• Present findings to executive leadership and governance bodies, synthesizing complex data into strategic recommendations.
• Integrate evaluation insights into enterprise strategic planning and multi-year organizational priorities.
• Identify emerging trends, risks, and innovation opportunities through systematic performance analysis.

External Partnerships and Evaluation Oversight

• Establish and manage relationships with external research and evaluation partners, including RFP development, contract negotiation, and performance oversight.
• Ensure deliverables meet quality standards, timelines, and methodological expectations.
• Monitor evaluation-related budgets to ensure responsible stewardship and alignment with organizational priorities.

Professional Development and Sector Leadership

• Maintain engagement with best practices in program evaluation, outcomes measurement, and organizational learning.
• Participate in professional associations, peer organizations, and academic institutions to advance methodological innovation.
• Mentor staff and strengthen internal evaluation capacity, fostering a culture of evidence-based decision-making.

Strategic Planning and Executive Advisory

• Advise executive leadership and the Board on the strategic implications of evaluation and research findings.
• Lead evidence-informed development of multi-year strategic and policy frameworks by synthesizing program outcomes, environmental scanning, and emerging trends.
• Translate complex evaluation and research data into actionable insights, identifying systemic patterns, forecasting regulatory needs, and guiding forward-looking initiatives that advance FSMB’s mission.

________________________________________

Minimum Qualifications

• Doctoral degree (Ph.D., Ed.D., Dr.P.H., or related discipline) strongly preferred. A master’s degree with 10+ years of progressively responsible enterprise-level evaluation experience may be considered.
• 7–10 years of experience designing, implementing, and leading enterprise-wide evaluation systems in complex organizations.
• Demonstrated expertise in qualitative and mixed-methods research, including survey design, statistical analysis, and interview protocols.
• Proven ability to translate research findings into strategic recommendations for executive decision-making.
• Experience managing multi-project evaluation initiatives and external consultant relationships.
• Experience presenting findings to executive leadership and governance bodies.

________________________________________

Preferred Qualifications

• Deep understanding of medical regulation, professional licensure, continuing professional development, or healthcare quality and safety.
• Knowledge of state medical board governance, regulatory frameworks, and operational dynamics.
• Demonstrated success working with state and local government offices, agencies, and field practitioners to drive meaningful outcomes.
• Professional certification in program evaluation (e.g., Credentialed Evaluator) or recognized research credentials.
• Proven commitment to continuous improvement, ethical evaluation practices, and fostering organizational learning cultures.
• Experience shaping organizational strategy and presenting findings to executive leadership and board-level governance bodies.

________________________________________

Competencies

• Enterprise Strategic Leadership: Align evaluation strategy with organizational priorities and long-term impact.
• Advanced Analytical Acumen: Synthesize complex data to inform strategic and operational decision-making.
• Executive Communication and Influence: Communicate sophisticated insights to leadership, governance bodies, and external stakeholders.
• Organizational Influence and Collaboration: Build trusted partnerships while fostering a culture of evidence-based decision-making.
• Operational and Portfolio Oversight: Manage multiple initiatives simultaneously while maintaining rigor and quality.
• Innovation and Adaptive Leadership: Design evaluation approaches for emerging initiatives and develop metrics for new programs.