This year marks the 30th anniversary of the Washington Evaluators (WE), a local affiliate of the American Evaluation Association (AEA). As the founding President of WE has noted, affiliates help to develop an evaluation community in a local area. WE has become an evaluation community of practice
2 attachments
See matching library entry files - Documentation of a sustainable ...
This presentation for Eval 2013 examines the evolving role of an internal evaluator leading a collaborative effort that applied rapid tests of change to improve client outcomes in a public mental health setting. The Recovery Model represents a paradigm shift in community mental health that emphasizes client strengths, independent living, use of peer support, and client engagement in meaningful activities. San Francisco Department of Public Health (SFDPH) and an intensive case management program conducted a year of Plan-Do-Study-Act (PDSA) testing to improve recovery practices. The SFDPH evaluator led the team, ensuring clarity in data indicators, focused PDSAs, effective data collection, attention to PDSA timing, and synthesis of learning that generated the feedback loop into continuous testing. Capacity to identify system barriers to improvement, and recognition of the need for more leadership engagement as well as clinician "buy-in", were also critical to the process and stretched the traditional evaluator role to positive effect
Across the world, VOPEs are addressing their diverse evaluation practice through the development of evaluator competency frameworks
Session1414 Global Evolution of Evaluator Competencies.zip
Founded in 1984 with an initial membership of 12 evaluators, the Washington Evaluators (WE) has since grown to include a professional and student membership base of more than 200 in the nation's capitol. This presentation described WE's experience in developing and maintaining a community of evaluation practitioners that include a diverse mix of government, private, and self-employed evaluators as well as prominent evaluators in academia
WE Presentation 9-24-2016.pptx
In the real world logic of programs under evaluation is not always clear and consistent. According to my experience, three most common flaws in program logic are: (1) use of indicators instead of goals and objectives (the goals are “too SMART”), (2) lack of program/project goals, and (3) lack of logical harmonization between programs and projects. Reconstruction of program logic is development of a comprehensive chain of reasoning that links investments into a program with the program results by piecing together bits of evidence collected in the course of program evaluation. In this presentation I will provide examples of typical flaws in program logic, suggest how to fix them in the course of evaluation, and argue that reconstruction of program logic should be an essential part of most evaluations and one of evaluators’ competencies
Reconstruction of Program Logic Kuzmin for upload.pptx
Abstract: Using Stevahn, King, Ghere, & Minnema’s (2005) Essential Competencies for Program Evaluators, a content analysis of articles/chapters for three theoretical evaluation approaches was conducted. The goal of the study is to examine the key competencies required to design and implement different evaluation approaches. The data collected will be analyzed by evaluation approach to find how they compare and differ on their emphasized use of specific evaluator competencies. The results of this study have numerous implications that can strengthen the quality of future evaluations through avenues such as evaluator training and additional research on evaluation specific to evaluation approaches
In Search of Evaluator Competencies.pptx
The 2-page document explains why the presenter chose to examine this topic, contextual distinctions that may influence evaluation approaches, questions upon which to reflect, an abbreviated listing of the AEA Guiding Principles, and references
Straddling Int&Ext Eval Role.pdf
The Latin American Youth Center (LAYC), a multi-service nonprofit in Washington, D.C., is an example of a nonprofit that has been working to achieve this culture change. One of the organization's internal evaluators shared: 1) How our roles have changed to respond to the organization’s evolving needs, 2) Our strategies for producing relevant information for all stakeholders, from funders to the Board of Directors to the program recipients themselves, and 3) Our methods of building evaluation capacity so that we’re partnering with program staff through the evaluation lifecycle rather than making decisions on their behalf
#EvaluationUse #ResearchonEvaluation #Communications #ProgramTheoryandTheoryDrivenEvaluation #HowTo #GovernmentEvaluation #TeachingofEvaluation #EvaluationManagersandSupervisors #Advocacy #DataVisualizationandReporting #GraduateStudentandNewEvaluators #TheoriesofEvaluation ...
Mike-Hendricks-Evaluator-Advocacy-AEA-2013.ppt
This presentation from the 2011 AEA conference presents the results of a survey administered to AEA's Graduate Student and New Evaluators Topical Interest Group. Respondents were asked about their training experiences, their confidence in certain skills and knowledge, and the components of their training in evaluation that had the greatest impact on the development of a certain set of competencies. A paired comparison analysis was conducted to assess the differences between the contributions of elements of a training program to the development of each competency. Analysis shows cultivating a well-trained evaluator requires a variety of training program components
Dillman, AEA, Evaluator Skill Acquisition.pdf