Search

1 to 10 of 12
Sort by



Library Entry
Eval10 Session 312: The Cycle of Evidence-Based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building

The panel addresses the major components in the cycle of developing evidence-based policy and practice. The synthesis method, the core methodology to aggregate findings for evidence-based practice reviews, is defined and various types of syntheses will be compared. Using results from synthesis...

3 attachments

Focus Search - Interactive Systems Framework for Dissemination & Implementation Aims to bridge research-practice gap Integrates research to practice models with community centered models Acknowledges bi-directional gap between research and practice Shaped by practitioners, researchers, and funders Uses 3 interactive systems 3 Interactive Systems Prevention Synthesis & Translation Systems (PSTS) Distills info about innovations and translates it into user-friendly formats Prevention Support System (PSS) Provides training, TA, or other support to users in the field who will put the innovation into practice Prevention Delivery System (PDS) Implements innovations in the world of practice Prevention Synthesis & Translation Seen as vital to bridging science and practice Importance: Can help support system: engage their own needs/perspectives better understand needs of other stakeholders and systems provide structure for summarizing existing research illuminate priority areas for new research Yet how to develop it and train support system partners to use it is under-researched Aims We attempted to bridge this gap via case example by: Highlighting importance of synthesis Describing an effective process for developing a synthesis/translation product called: Promoting Science-based Approaches to Teen Pregnancy Prevention using Getting To Outcomes Aims Share our approach to defining evidence-based programs and strategies in the area of teen pregnancy prevention; Share short-term results of our efforts to support the synthesis/translation product Share Implications for research and practice will also be discussed. A PSTS Case Example On CDC multi-site capacity building effort to promote the use of science-based approaches to teen pregnancy prevention we shaped process for developing and evaluating PSTS Desired system to be: comprehensive but practical user-friendly easily understood by stakeholders in the field Participatory able to integrate/disseminate existing resources developed by grantees able to integrate tools amenable to lay-person consumption Examined Other Capacity Building Models/Processes The Community Toolbox (Workgroup for Community Health & Development) offered laudable resources to community-driven action/ mobilization but weren’t in direction of our effort Partnerships for Success (Julian, Ross, Partridge, 2008) offered laudable resources to community-driven action/ mobilization, but weren’t in direction of our effort Precede-proceed Model of Health Promotion Program Planning and Evaluation (Green & Kreuter, 2005) unclear if model had basic practical local-level organizational tools that could be readily adapted for PSBA project SAMHSA Prevention Platform (SAMHSA, 2004) uses sophisticated program but for us would require effort for adaptation and considerable cost to start w/ electronic system Selected Capacity Building Model/Process Getting to Outcomes (GTO) (Chinman, Imm & Wandersman, 2004) Well established 10-step program planning, implementation, and evaluation framework and process Can be entered at any step Provides step-by-step guidelines, worksheets, examples, tools Culturally relevant Customized for several public health/education fields Resulted in production of several customized GTO manuals and supporting documentation that integrates results based GTO process and guidance w/ content specific elements from field PSBA-GTO as a Painter’s Palette #1 Needs/ Resources #2 Goals #3 Best Practices #4 Fit #5 Capacities #6 Plan #7 Implementation Process Evaluation #8 Outcome Evaluation #9 Improve / CQI #10 Sustain * Other Key Phases in Developing PSTS Staffing Established Consulting Relationship w/ GTO Developer Identified Internal Leads Identified Writer/Editor Created Customization Teams Established Internal Team Established External Advisory Group Determined Roles/Responsibilities/Operating Procedures Other Key Phases in Developing PSTS (cont) Getting Started w/ Customization Process Got Agreement on Internal Customization Team Vision and Processes Identified Primary Audience for PSBA-GTO Manual Developing Chapter Outlines Internal Customization Team Developed Initial Chapter Outlines External Customization Advisory Group Reviewed and Critiqued Outlines Finalizing Chapter Narrative (Final Product) Draft Narratives Sent by Writer/Editor to Internal Customization Team Internal Customization Team Finalized Narratives Overview of Final PSBA-GTO Manual Gives background on SBA to TPP, GTO, PSBA-GTO Organized into 4 parts Part I: Goal Setting (Chpt 1-2) Part II: Program Planning (Chpt 3-4) Part III: Program Evaluation (Chpt 7-8) Part IV: Improving & Sustaining Your Program (Chpt 9-10) Includes Appendices, Tools and Tip sheets at every step/chpt Methods Employed to Assess Usefulness of PSTS (PSBA-GTO) Trained stakeholders to use PSTS (PSBA-GTO) and assessed its usefulness by: Conducting Pre-Post Training Assessment on PSBA-GTO skill/competencies and workshop objectives Gave stakeholders time to begin field use of PSTS (PSBA-GTO) and assessed its usefulness by: Conducting Stakeholder Interviews/field feedback on PSBA-GTO Product and Process (2008-2010) * Evaluation Findings Training Outcomes (for each phase) Mean level of self-reported knowledge about PSBA-GTO steps increased significantly from pre-test to post-test Mean levels for self-reported confidence also increased significantly from pre-test to post-test For training objectives, mean levels for self-reported knowledge and confidence about activities increased significantly from the pre-test to the post-test Evaluation Findings (cont) Key Stakeholder Interview/field feedback 2008 Round 1 Interviews Most felt confident they were delivering TA on 10 steps of PSBA-GTO Local partners were at various steps in 10-step framework and grantees needed to adjust/customize their training/TA plans accordingly Assessing local partners’ needs and capacity to use PSBA-GTO is a challenge (e.g. case plan, process database, narrative log, etc) 2009 Round 2 Interviews Nearly all grantees’ reported increased comfort and confidence to provide T&TA on PSBA-GTO with their local partners


Library Entry
Eval13 Session 325: Every Voice Counts: Including All Stakeholders in Internal Evaluation

Panel presented at the 2013 AEA Conference Chair and Discussant: Suzanne Markoe Hayes Presenters: Frances Reyes, Krystal Gibson, and Bree Hemingway #InternalEvaluation #database #realtiimemonitoring #MixedMethodsEvaluation #InternationalandCross-CulturalEval #Non...

4 attachments

Focus Search - Teen Pregnancy Prevention Study  Evaluating the effectives of pregnancy prevention curriculum  Randomized Control and Treatment study  Middle and High School girls surveyed at four time points within a 12-month period ServicePoint Database Real-Time Monitoring: Evaluation Team Values  Evaluation Team Members  External Evaluation  Internal Evaluation  Senior Management  Program Management  Values  Performance  Evaluation Real-Time Monitoring: Evaluation Team Values (cont.)  Monitoring Reports  Recruitment Numbers  Attendance Rates  Number of girls with more than one absence  Survey Completion at different time points Survey Completion at Different Time Points Report Example School Girls Inc


Library Entry
Introduction to Evaluation and Public Policy

This session will explain how the public policy process works. It will guide evaluators through the maze of policy processes, such as legislation, regulations, administrative procedures, budgets, re-organizations, and goal setting. It will provide practical advice on how evaluators can become...

How to Influence Policy 10-10-13.pptx


Library Entry
Eval10 Session 684: Fostering & measuring nonprofit networks to inform grantmakers

When the David and Lucile Packard Foundation awarded a grant to implement and strengthen nonprofit networks, it was part of a larger philanthropic inquiry: Could knowing how networks connect, share, and mobilization teach foundations how to be more effective sponsors of community change? How...

AEA 2010 Evaluating Networks.ppt


Library Entry
Eval13: Poster 134 - All Together Now: How Challenges Became Opportunities While Implementing and Evaluating an Accountability System in an Education Nonprofit Network

During the previous 6 years, Communities In Schools (CIS), an education nonprofit with nearly 200 affiliates across the United States, created a Total Quality System (TQS) of standards to achieve uniform quality in business practice and program implementation across the CIS network. To ensure...

AEA Conference 2013 Poster.pdf



Library Entry
Session 561 - The Adolescent Family Life Care Demonstration Project: How Context Matters When Evaluating Programs for Adolescent Parents and their Children

#2009Conference #SpecialNeedsPopulations #adolescent-parenting-programs #evaluation-settings #HumanServicesEvaluation #Evaluation2009 #context

6 attachments

Focus Search - Office of Adolescent Pregnancy Programs Alicia Richmond-Scott Acting Director 10 Regional Program Offices * Office of Family Planning (OFP) Supports grants to public / private not-for-profits for family planning services - services program is Regionally administered (RHA/RPC) Office of Adolescent Pregnancy Programs (OAPP) Supports adolescent pregnancy prevention and care demonstration grants – administered Centrally Office of Research and Evaluation (ORE) Supports a focused approach to OPA sponsored research and special projects