Presentation slides and handouts for conference session with the following abstract: In response to the federal push for results-based performance indicators, the U.S. Department of Education undertook the development of a national outcomes measurement system for early childhood programs...
5 attachments
Focus Search - Outcomes for Children Served through IDEA’s Early Childhood Programs Part C—Early Intervention, 2009–10 Knowledge and Skills Action to meet needs Showed greater than 71% 74% 76% Exited the program within age expectations 62% 54% 60% Part B Preschool—Early Childhood Special Education, 2009–10 Showed greater than expected growth 83% 82% 82% Exited the program within age expectations 59% 52% 67% expected growth Note: Data for Part C are based on 29 states weighted to represent the nation
Slides for "Communicating Success Case Studies in Complex Organizations" (includes presentation notes) Abstract: Success case studies can be an effective way to identify underlying patterns, relationships, and dynamics that lead to program success or failure. Identifying successful cases is...
AEA Communicating Success Case Studies public elibrary henderson.pptx
#eval14
Valuing Voice in Evaluation Presentation.pdf
This session demonstrates one method for measuring inter-organizational networks using a modified version of the Levels of Collaboration Scale as part of a Funded Provider survey. Based on our experiences evaluating First 5 programs in several California counties, we will demonstrate how survey...
Resnick Demonstration Network Mapping FINAL.pptx
Session by G. Resnick and O. Arnold. Improvement in the system of care in Fresno County is expected to occur as a result of the funding provided by First 5 Fresno under CA Proposition 10 for services for families and their children from birth through five years of age. To assess systems...
Resnick and Arnold Weaving Networks V4.pptx
The Michigan Evaluation of School-based Health (MESH) Project studied the impact of school-based health centers (SBHCs) on the health and health behaviors of middle and high school students. Using a prospective cohort design, study outcomes relating to health and health behaviors were measured...
AEA 2009 Lichty, McNall & Mavis, Final.pdf
AEA 2011 conference presentation by Andrei Streke and Tsze Chan. The What Works Clearinghouse (WWC) offers reviews of evidence on broad topics in education, identifies interventions shown by rigorous research to be effective, and develops targeted reviews of interventions. This paper...
2 attachments
Focus Search - ™1 Voyager Universal Literacy System®2 Waterford Early Reading Program1 Other BR Programs Cooperative Integrated Reading and Composition©2 Corrective Reading1 Classwide Peer Tutoring©1 Early Intervention in Reading (EIR)®1 Fluency Formula™1 Kaplan Spell, Read, PAT2 Ladders to Literacy3 Little Books3 Peer-Assisted Learning Strategies (PALS)©5 Reading Recovery®5 Sound Partners7 Success for All12 Start Making a Reader Today® (SMART®)1 Stepping Stones to Literacy2 Wilson Reading1 Total2680 Type of Program nMStandard Error95% Lower95% UpperZ-valueP-value Computer-assisted programs330.260.040.180.346.500.000 Othe BR programs470.340.020.290.3914.350.000 Beginning Reading Total800.320.020.280.3615.650.000 Beginning Reading Type of ProgramnMQ within Q critical a Homogeneity Beginning Reading, Total800.31166.23101.90rejected BR Computer Programs330.2661.0746.19rejected Other BR Programs470.34101.9363.20rejected a p=0.05 significance level Beginning Reading Topic Area Type of Program nMSE95% L95% UZ-valueP-value Computer-assisted programs330.280.060.160.404.710.000 Othe BR programs470.390.040.320.479.840.000 Beginning Reading Total800.350.030.290.4210.650.000 -0.6-0.4-0.200.20.40.60.811.21.41.6 -0.6-0.4-0.200.20.40.60.811.21.41.6 Study CharacteristicsOverallComputer-assistedOther nMSEnMSEnMSE Type of Population a Universal300.300.0580.220.12220.320.05 At Risk (struggling readers)540.390.04250.300.07290.470.05 Evaluation Design Random460.350.05240.340.07220.360.06 Non-Random340.360.0590.150.11250.420.05 Sample Size Small460.480.05240.390.07220.560.06 Large340.270.0490.130.09250.310.04 a Sum of programs is greater than 80 because some programs collected data for multiple subgroups Study CharacteristicsOverallComputer-assistedOther nMSEnMSEnMSE Type of Control Group Business as usual680.390.04250.310.07430.420.04 Other program/intervention120.170.0880.190.1240.140.12 Domain b Alphabetics 570.440.04250.380.07320.480.05 Fluency 250.360.0760.160.15190.420.08 Comprehension 410.160.05130.020.09280.220.05 General Reading220.410.0620.300.19200.420.06 b Sum is greater than 80 because programs collected data for multiple domains Variables RandomNon-random Design 10 Buisness-as-usualOther program Control group 10 Computer-assisted Other BR programs Computer-Assisted Programs 10 iii CES 10 VariableCoefficientStandard Error- 95% CI+95% CIZ-statisticP-value Constant0.400.040.320.489.610.000 Computer-assisted programs-0.120.07-0.260.20-1.720.084 Note: Q (model)=2.97, df=1, p=0.084 Test for homogeneity: Q(error)=90.60, df=78, p=0.156 v=0.037 iiiiii CGDLnWCES 43210 VariableCoefficientStandard Error- 95% CI+95% CIZ-statisticP-value Constant0.700.170.381.034.260.000 Computer-Assisted Programs-0.140.07-0.28-0.001-1.970.049 Program Size (Ln Weight)-0.130.04-0.20-0.06-3.590.000 Design-0.060.07-0.190.08-0.860.393 Control group0.200.090.030.382.240.025 Note: Q (model)=20.86, df=4, p=0.000 Test for homogeneity: Q(error)=79.64, df=75, p=0.335 ***** Inverse Variance Weighted Regression ***** ***** Random Intercept, Fixed Slopes Model ***** -- Descriptives -- Mean ES R-Square k .3510 .2076 80.0000 -- Homogeneity Analysis -- Q df p Model 20.8631 4.0000 .0003 Residual 79.6431 75.0000 .3351 Total 100.5062 79.0000 .0517 -- Regression Coefficients -- B SE -95% CI +95% CI Z P Beta Constant .7038 .1651 .3802 1.0273 4.2630 .0000 .0000 Program size -.1324 .0368 -.2046 -.0601 -3.5920 .0003 -.3852 Computer -.1418 .0720 -.2829 -.0006 -1.9686 .0490 -.2119 Design -.0585 .0685 -.1927 .0758 -.8537 .3933 -.0920 Cntrl group .2036 .0909 .0253 .3818 2.2386 .0252 .2284 -- Method of Moments Random Effects Variance Component -- v = .03056Session 244, Advanced Analytic Techniques in Educational Evaluation American Evaluation Association Conference, November 3, 2011 Reviewing Systematic Reviews: Meta-Analysis of What Works Clearinghouse Computer-Assisted Interventions Andrei Streke Tsze Chan astreke@mathematica-mpr.com tchan@air.org This presentation outlines our findings from applying the meta-analysis technique to intervention evaluation studies that have been reviewed by the What Works Clearinghouse (WWC) in the content area of Reading
Session 302: Sailing the Seven C's of Social Change: A Framework for Evaluating Social Change and Systems Change Initiatives--presentation document and PowerPoint #SystemsinEvaluation #Evaluation2009
Focus Search - The i2i Institute has utilized the 7 Cs framework in a number of large-scale change initiatives, including a women’s economic empowerment initiative in Africa, a juvenile drug court initiative in northern New Mexico, and an early intervention initiative in the Russian Far East
Presentation Abstract: This presentation will provide a brief introduction to SAMHSA’s SBIRT (Screening, Brief Intervention and Referral to Treatment) programs and outline the evaluation process of Georgia BASICS. It will cover the program’s service delivery, characteristics of the target...
AEA Final Draft Oct 23 2012.pptx
“Collaboration” is a ubiquitous, yet misunderstood, under-empiricized and un-operationalized construct. Program and organizational stakeholders looking to do and be collaborative struggle to identify, practice and evaluate collaboration with efficacy. This workshop will demonstrate how the...
4 attachments
Focus Search - Journal of Early Intervention, (15) 1, 89-105.Pinchot, G. & Pinchot, E. (1993)