The panel addresses the major components in the cycle of developing evidence-based policy and practice. The synthesis method, the core methodology to aggregate findings for evidence-based practice reviews, is defined and various types of syntheses will be compared. Using results from synthesis...
- Interactive Systems Framework for Dissemination & Implementation Aims to bridge research-practice gap Integrates research to practice models with community centered models Acknowledges bi-directional gap between research and practice Shaped by practitioners, researchers, and funders Uses 3 interactive systems 3 Interactive Systems Prevention Synthesis & Translation Systems (PSTS) Distills info about innovations and translates it into user-friendly formats Prevention Support System (PSS) Provides training, TA, or other support to users in the field who will put the innovation into practice Prevention Delivery System (PDS) Implements innovations in the world of practice Prevention Synthesis & Translation Seen as vital to bridging science and practice Importance: Can help support system: engage their own needs/perspectives better understand needs of other stakeholders and systems provide structure for summarizing existing research illuminate priority areas for new research Yet how to develop it and train support system partners to use it is under-researched Aims We attempted to bridge this gap via case example by: Highlighting importance of synthesis Describing an effective process for developing a synthesis/translation product called: Promoting Science-based Approaches to Teen Pregnancy Prevention using Getting To Outcomes Aims Share our approach to defining evidence-based programs and strategies in the area of teen pregnancy prevention; Share short-term results of our efforts to support the synthesis/translation product Share Implications for research and practice will also be discussed. A PSTS Case Example On CDC multi-site capacity building effort to promote the use of science-based approaches to teen pregnancy prevention we shaped process for developing and evaluating PSTS Desired system to be: comprehensive but practical user-friendly easily understood by stakeholders in the field Participatory able to integrate/disseminate existing resources developed by grantees able to integrate tools amenable to lay-person consumption Examined Other Capacity Building Models/Processes The Community Toolbox (Workgroup for Community Health & Development) offered laudable resources to community-driven action/ mobilization but weren’t in direction of our effort Partnerships for Success (Julian, Ross, Partridge, 2008) offered laudable resources to community-driven action/ mobilization, but weren’t in direction of our effort Precede-proceed Model of Health Promotion Program Planning and Evaluation (Green & Kreuter, 2005) unclear if model had basic practical local-level organizational tools that could be readily adapted for PSBA project SAMHSA Prevention Platform (SAMHSA, 2004) uses sophisticated program but for us would require effort for adaptation and considerable cost to start w/ electronic system Selected Capacity Building Model/Process Getting to Outcomes (GTO) (Chinman, Imm & Wandersman, 2004) Well established 10-step program planning, implementation, and evaluation framework and process Can be entered at any step Provides step-by-step guidelines, worksheets, examples, tools Culturally relevant Customized for several public health/education fields Resulted in production of several customized GTO manuals and supporting documentation that integrates results based GTO process and guidance w/ content specific elements from field PSBA-GTO as a Painter’s Palette #1 Needs/ Resources #2 Goals #3 Best Practices #4 Fit #5 Capacities #6 Plan #7 Implementation Process Evaluation #8 Outcome Evaluation #9 Improve / CQI #10 Sustain * Other Key Phases in Developing PSTS Staffing Established Consulting Relationship w/ GTO Developer Identified Internal Leads Identified Writer/Editor Created Customization Teams Established Internal Team Established External Advisory Group Determined Roles/Responsibilities/Operating Procedures Other Key Phases in Developing PSTS (cont) Getting Started w/ Customization Process Got Agreement on Internal Customization Team Vision and Processes Identified Primary Audience for PSBA-GTO Manual Developing Chapter Outlines Internal Customization Team Developed Initial Chapter Outlines External Customization Advisory Group Reviewed and Critiqued Outlines Finalizing Chapter Narrative (Final Product) Draft Narratives Sent by Writer/Editor to Internal Customization Team Internal Customization Team Finalized Narratives Overview of Final PSBA-GTO Manual Gives background on SBA to TPP, GTO, PSBA-GTO Organized into 4 parts Part I: Goal Setting (Chpt 1-2) Part II: Program Planning (Chpt 3-4) Part III: Program Evaluation (Chpt 7-8) Part IV: Improving & Sustaining Your Program (Chpt 9-10) Includes Appendices, Tools and Tip sheets at every step/chpt Methods Employed to Assess Usefulness of PSTS (PSBA-GTO) Trained stakeholders to use PSTS (PSBA-GTO) and assessed its usefulness by: Conducting Pre-Post Training Assessment on PSBA-GTO skill/competencies and workshop objectives Gave stakeholders time to begin field use of PSTS (PSBA-GTO) and assessed its usefulness by: Conducting Stakeholder Interviews/field feedback on PSBA-GTO Product and Process (2008-2010) * Evaluation Findings Training Outcomes (for each phase) Mean level of self-reported knowledge about PSBA-GTO steps increased significantly from pre-test to post-test Mean levels for self-reported confidence also increased significantly from pre-test to post-test For training objectives, mean levels for self-reported knowledge and confidence about activities increased significantly from the pre-test to the post-test Evaluation Findings (cont) Key Stakeholder Interview/field feedback 2008 Round 1 Interviews Most felt confident they were delivering TA on 10 steps of PSBA-GTO Local partners were at various steps in 10-step framework and grantees needed to adjust/customize their training/TA plans accordingly Assessing local partners’ needs and capacity to use PSBA-GTO is a challenge (e.g. case plan, process database, narrative log, etc) 2009 Round 2 Interviews Nearly all grantees’ reported increased comfort and confidence to provide T&TA on PSBA-GTO with their local partners