Search

1 to 10 of 15
Sort by

Library Entry
Eval11 Session 449: Performance Management in Action: A National Measurement System for Early Childhood Outcomes

Presentation slides and handouts for conference session with the following abstract: In response to the federal push for results-based performance indicators, the U.S. Department of Education undertook the development of a national outcomes measurement system for early childhood programs...

5 attachments

Focus Search - Outcomes for Children Served through IDEA’s Early Childhood Programs Part C—Early Intervention, 2009–10 Knowledge and Skills Action to meet needs Showed greater than 71% 74% 76% Exited the program within age expectations 62% 54% 60% Part B Preschool—Early Childhood Special Education, 2009–10 Showed greater than expected growth 83% 82% 82% Exited the program within age expectations 59% 52% 67% expected growth Note: Data for Part C are based on 29 states weighted to represent the nation


Library Entry
Eval12 Session 925: Communicating Success Case Studies in Complex Organizations

Slides for "Communicating Success Case Studies in Complex Organizations" (includes presentation notes) Abstract: Success case studies can be an effective way to identify underlying patterns, relationships, and dynamics that lead to program success or failure. Identifying successful cases is...

AEA Communicating Success Case Studies public elibrary henderson.pptx



Library Entry
Eval11 Session 736: From Survey Data to Network Mapping and Beyond:Describing Inter-Organizational Coordination and Collaboration Networks

This session demonstrates one method for measuring inter-organizational networks using a modified version of the Levels of Collaboration Scale as part of a Funded Provider survey. Based on our experiences evaluating First 5 programs in several California counties, we will demonstrate how survey...

Resnick Demonstration Network Mapping FINAL.pptx


Library Entry
Eval11 Session 887: Measuring Inter-Agency Collaboration and Coordination in First 5 Fresno County: Experiences of Evaluators and Stakeholders in Understanding Systems Change Over Time

Session by G. Resnick and O. Arnold. Improvement in the system of care in Fresno County is expected to occur as a result of the funding provided by First 5 Fresno under CA Proposition 10 for services for families and their children from birth through five years of age. To assess systems...

Resnick and Arnold Weaving Networks V4.pptx


Library Entry
Session 376 - An Evaluation of the Impact of School-based Health Centers on Children's Health Outcomes

The Michigan Evaluation of School-based Health (MESH) Project studied the impact of school-based health centers (SBHCs) on the health and health behaviors of middle and high school students. Using a prospective cohort design, study outcomes relating to health and health behaviors were measured...

AEA 2009 Lichty, McNall & Mavis, Final.pdf


Library Entry
Eval11 Session 244: Reviewing Systematic Reviews: Meta-Analysis of What Works Clearinghouse Computer-Assisted Interventions.

AEA 2011 conference presentation by Andrei Streke and Tsze Chan. The What Works Clearinghouse (WWC) offers reviews of evidence on broad topics in education, identifies interventions shown by rigorous research to be effective, and develops targeted reviews of interventions. This paper...

2 attachments

Focus Search - ™1 Voyager Universal Literacy System®2 Waterford Early Reading Program1 Other BR Programs Cooperative Integrated Reading and Composition©2 Corrective Reading1 Classwide Peer Tutoring©1 Early Intervention in Reading (EIR)®1 Fluency Formula™1 Kaplan Spell, Read, PAT2 Ladders to Literacy3 Little Books3 Peer-Assisted Learning Strategies (PALS)©5 Reading Recovery®5 Sound Partners7 Success for All12 Start Making a Reader Today® (SMART®)1 Stepping Stones to Literacy2 Wilson Reading1 Total2680 Type of Program nMStandard Error95% Lower95% UpperZ-valueP-value Computer-assisted programs330.260.040.180.346.500.000 Othe BR programs470.340.020.290.3914.350.000 Beginning Reading Total800.320.020.280.3615.650.000 Beginning Reading Type of ProgramnMQ within Q critical a Homogeneity Beginning Reading, Total800.31166.23101.90rejected BR Computer Programs330.2661.0746.19rejected Other BR Programs470.34101.9363.20rejected a p=0.05 significance level Beginning Reading Topic Area Type of Program nMSE95% L95% UZ-valueP-value Computer-assisted programs330.280.060.160.404.710.000 Othe BR programs470.390.040.320.479.840.000 Beginning Reading Total800.350.030.290.4210.650.000 -0.6-0.4-0.200.20.40.60.811.21.41.6 -0.6-0.4-0.200.20.40.60.811.21.41.6 Study CharacteristicsOverallComputer-assistedOther nMSEnMSEnMSE Type of Population a Universal300.300.0580.220.12220.320.05 At Risk (struggling readers)540.390.04250.300.07290.470.05 Evaluation Design Random460.350.05240.340.07220.360.06 Non-Random340.360.0590.150.11250.420.05 Sample Size Small460.480.05240.390.07220.560.06 Large340.270.0490.130.09250.310.04 a Sum of programs is greater than 80 because some programs collected data for multiple subgroups Study CharacteristicsOverallComputer-assistedOther nMSEnMSEnMSE Type of Control Group Business as usual680.390.04250.310.07430.420.04 Other program/intervention120.170.0880.190.1240.140.12 Domain b Alphabetics 570.440.04250.380.07320.480.05 Fluency 250.360.0760.160.15190.420.08 Comprehension 410.160.05130.020.09280.220.05 General Reading220.410.0620.300.19200.420.06 b Sum is greater than 80 because programs collected data for multiple domains Variables RandomNon-random Design 10 Buisness-as-usualOther program Control group 10 Computer-assisted Other BR programs Computer-Assisted Programs 10 iii CES   10 VariableCoefficientStandard Error- 95% CI+95% CIZ-statisticP-value Constant0.400.040.320.489.610.000 Computer-assisted programs-0.120.07-0.260.20-1.720.084 Note: Q (model)=2.97, df=1, p=0.084 Test for homogeneity: Q(error)=90.60, df=78, p=0.156 v=0.037 iiiiii CGDLnWCES   43210 VariableCoefficientStandard Error- 95% CI+95% CIZ-statisticP-value Constant0.700.170.381.034.260.000 Computer-Assisted Programs-0.140.07-0.28-0.001-1.970.049 Program Size (Ln Weight)-0.130.04-0.20-0.06-3.590.000 Design-0.060.07-0.190.08-0.860.393 Control group0.200.090.030.382.240.025 Note: Q (model)=20.86, df=4, p=0.000 Test for homogeneity: Q(error)=79.64, df=75, p=0.335 ***** Inverse Variance Weighted Regression ***** ***** Random Intercept, Fixed Slopes Model ***** -- Descriptives -- Mean ES R-Square k .3510 .2076 80.0000 -- Homogeneity Analysis -- Q df p Model 20.8631 4.0000 .0003 Residual 79.6431 75.0000 .3351 Total 100.5062 79.0000 .0517 -- Regression Coefficients -- B SE -95% CI +95% CI Z P Beta Constant .7038 .1651 .3802 1.0273 4.2630 .0000 .0000 Program size -.1324 .0368 -.2046 -.0601 -3.5920 .0003 -.3852 Computer -.1418 .0720 -.2829 -.0006 -1.9686 .0490 -.2119 Design -.0585 .0685 -.1927 .0758 -.8537 .3933 -.0920 Cntrl group .2036 .0909 .0253 .3818 2.2386 .0252 .2284 -- Method of Moments Random Effects Variance Component -- v = .03056Session 244, Advanced Analytic Techniques in Educational Evaluation American Evaluation Association Conference, November 3, 2011 Reviewing Systematic Reviews: Meta-Analysis of What Works Clearinghouse Computer-Assisted Interventions Andrei Streke Tsze Chan astreke@mathematica-mpr.com tchan@air.org This presentation outlines our findings from applying the meta-analysis technique to intervention evaluation studies that have been reviewed by the What Works Clearinghouse (WWC) in the content area of Reading


Library Entry
Sailing the Seven C's of Social Change

Session 302: Sailing the Seven C's of Social Change: A Framework for Evaluating Social Change and Systems Change Initiatives--presentation document and PowerPoint #SystemsinEvaluation #Evaluation2009

2 attachments

Focus Search - The i2i Institute has utilized the 7 Cs framework in a number of large-scale change initiatives, including a women’s economic empowerment initiative in Africa, a juvenile drug court initiative in northern New Mexico, and an early intervention initiative in the Russian Far East


Library Entry
Eval12 Session 157: Conducting Evaluations in a Challenging Context - Strategies for Increasing Participant Retention and Addressing Threats to Validity

Presentation Abstract: This presentation will provide a brief introduction to SAMHSA’s SBIRT (Screening, Brief Intervention and Referral to Treatment) programs and outline the evaluation process of Georgia BASICS. It will cover the program’s service delivery, characteristics of the target...

AEA Final Draft Oct 23 2012.pptx


Library Entry
Conference PDW #24: Evaluating Organizational Collaboration

“Collaboration” is a ubiquitous, yet misunderstood, under-empiricized and un-operationalized construct. Program and organizational stakeholders looking to do and be collaborative struggle to identify, practice and evaluate collaboration with efficacy. This workshop will demonstrate how the...

4 attachments

Focus Search - Journal of Early Intervention, (15) 1, 89-105.Pinchot, G. & Pinchot, E. (1993)