|How to develop a strategic evaluation plan: what it is and what it is not
||Stephanie George, Epidemiologist/Program Evaluator - Utah Department of Health
Camille Roundy, Epidemiologist - Utah Department of Health
Meghan Balough, Program Evaluator - Utah Violence & Injury Prevention
|Have you ever been tasked to “create an evaluation plan”? This session aided in the fulfillment of that task by working through how to develop a strategic evaluation plan.
|Learning from others: Clarifying roles and working with other stakeholders
||David Napp, Independent Consultant
M. Elizabeth Snow, Program Evaluation Lead - Centre for Health Evaluation & Outcome Sciences
|First presentation: This presentation described lessons learned for enhancing evaluation practices in a professional setting that were gleaned from a successful collaboration between external and internal evaluators in evaluating Project SHINE, an informatics fellowship program.
Second presentation: This presentation reflected on the lessons learned while creating an evaluation and a performance monitoring function for a complex, multi-site, multi-year project - The Clinical & Systems Transformation project.
|Learning from within: Increasing internal evaluation capacity
||Celie Manuel, Monitoring, Evaluation, Gender and Learning Adviser - IIED
Virginia Lamprecht, Evaluation Methodologist - USAID
Heather K Moore, Senior Evaluation Specialist
|Presentation 1: This study explores the usefulness of social network analysis in understanding relationships between different organizational partners in a consortium working towards generating evidence and improved tools for managing humanitarian disasters in urban settings.
Presentation 2: Discussed key challenges in using internal teams to collect, compile, and assess qualitative data including mobilizing and training mostly non-research staff.
Presentation 3: When a team of internal evaluators at National Marrow Donor Program / Be The Match® was established, evaluators became consistently available to guide an evidence-based approach to improving patient programs.
|Building a unified evaluation framework across heterogeneous program areas
||Ted Chen, Director, Evaluation - Margaret A. Cargill Philanthropies
Pamela Larson Nippolt, Evaluation Officer - Margaret A. Cargill Philanthropies
|This panel shared multiple perspectives related to the work that Wilder Research and the Margaret A. Cargill Philanthropies have done to build a system for conceptualizing, organizing, and implementing an evaluation process across MACP's seven domains of grantmaking, and the work that continues as the evaluation moves forward.
|Kaiser Permanente's Redesigned System for Evaluation to Maximize Evaluation Utility
||David Mosen, Senior Program Evaluation Consultant
Courtnee Hamity, Evaluation and Analytics Consultant
|Kaiser Permanente's redesigned program evaluation model includes collaborative evaluation planning prior to program implementation and requires organizational commitment to use evaluation results to inform decisions and a peer review process to maximize broad confidence in results.
|Navigating the Multiple Roles of Internal Evaluators
||Hannah Deborah Hirschland, Managing Director, Analytics & Evaluation
Jesse Wilkinson, Director, Research and Evaluation - GMHC
|Having an internal evaluation department has many advantages, but also presents a series of challenges. This presentation explored the ups and downs of internal evaluation and presented real examples from practice at a mid-size social services agency.
|How Internal Evaluators Help Programs Make Sense of Data and Drive Decisions
||Garrett Yursza Warfield - Year Up
Jessica Britt - Year Up
David Leopold - College Bound Dorchester
Daniel Tsin - Urban Alliance
Matthew Gajdowski - Year Up
|This panel presented approaches implemented at Year Up, Urban Alliance, and College Bound Dorchester to help teams understand data and use that information to make informed decisions.
|Idea Writing + Rapid Cycle = Two Techniques to Empower Direct Line Staff to Foster Organizational Change
||Stanley Capela, VP for Quality Management & Corporate Compliance Officer - HeartShare Human Services of New York
||This lecture focused on a case study of how an internal evaluator used idea writing and rapid cycle techniques to engage direct line staff to foster organizational change that led to the development of a management training program.
|Internal Evaluation: How to Wear Multiple Hats and Not Lose Your Head
||Kathleen Korte Wang, Expert Consultant - ICF
Christine Leicht, Fellow - ICF
Yvette Lamb, Fellow - ICF
Brooke Shelley, Senior Research Associate - ICF
Hung Pho, Program Evaluator - ICF
|Panelists shared practical tips for navigating the multitude of roles that internal evaluators often adopt, drawing on examples from federal projects including: Child Welfare Information Gateway, the Center for States Child Welfare Capacity Building Collaborative, and the Promising Pathways Initiative.
|Peer-Review Assessment of Project Model Designs
||Giogos Filippou, Evidence-Base Manager
||Project models are World Vision's strategic approach to effective evidence-based programming and the main drivers for delivering on strategy objectives. The PM Review Panel is a voluntary body comprised of staff with diverse expertise in design, monitoring and evaluation across multiple sectors.
|Collaboratively Designing Theories and Measures of Change: Perspectives from a Human Rights Non-profit and Donor
Giovanni Dazzo, Evaluation Specialist, U.S. Department of State
|Panelists demonstrated how they each used collaborative approaches to design theories of change and measures alongside program staff and grantees.
|How internal evaluation fosters learning and use: lessons learned from internal evaluation at a community foundation
||Sonia Worcel, Vice President of Strategy and Research - The Oregon Community Foundation
Kimberly Firth Leonard, Senior Evaluation Officer - The Oregon Community Foundation
|Presenters described how internal evaluations have resulted in learning within and across the initiatives, as well as throughout the organization as a whole.
|Learning with others: Getting a seat at the stakeholder table
||Jessica Britt, Evaluation Specialist - Year Up
Cassandra Tavaras, MGH Center for Community Health Improvement
Rocele Estanislao, Assistant Director, Evaluation and Research - Hathaway-Sycamores Child and Family Services
|Presentations in this session include: 1. Internal evaluation processes - successes and failures -- at Year Up, a national nonprofit that links young adults with career opportunities; 2. Logic model development for a youth STEM program at Massachusetts General Hospital; 3. Building a culture of evaluation and learning at Hathaway-Sycamores Child and Family Services.
|Navigating the Performance Path: Organizational Performance Improvement Meets Program Evaluation at a Federal Public Health Agency
||Clay Cooksey - Centers for Disease Control and Prevention (CDC)
J. Stan Lehman
Elizabeth Hoo - CDC
Thomas J. Chapel - CDC
|In 2010, CDC established agency-wide performance management processes that crossed organizational and program boundaries. This session addressed a range of real-world issues applicable decision-makers and those who influence them.