Session Description: Develop higher-quality surveys! This workshop is designed to teach participants how to improve survey quality, thus increasing their utility of and confidence in the data they collect. We will look at surveys to elicit factual information as well as ones that ask about subjective and abstract concepts. Through the use of hands-on activities, mini-lectures, and demonstrations participants will understand what is meant by reliability and validity with respect to surveys and will learn ways to improve each during the survey design phase for both types of surveys. Next, using a case example and SPSS we will explore ways to use pilot test responses to assess the reliability of subjective / abstract survey constructs by conducting confirmatory factor analysis and calculating Cronbach’s alpha. We will work together to understand what our findings tell us as well as what they don’t tell us, and consider other ways to assess survey quality. Last we will explore the types of validity associated with surveys and ways to assess the various forms of validity again using our case example. You will receive a workbook and SPSS screenshots to help you remember how to perform many of the computations we will perform. Participants will be surprised by how easy it is to improve survey quality through a few easy to implement steps!
Amy A. Germuth earned her PhD in Evaluation, Measurement and Psychology from UNC Chapel Hill and a certificate in survey methodology via a joint program through UNC-CH, UMD, Westat and RTI. She is a founding partner of Compass Consulting Group, LLC, a private evaluation consulting firm that conducts evaluations at the local, state, and national levels. As part of Compass she has evaluated numerous initiatives, including health prevention and outreach programs, Math Science Partnerships, K-12 science outreach programs, and workforce development initiatives, and has worked with a variety of organizations including the US Education Department, Department of Health and Human Services, Westat, Georgia Tech., Virginia Tech., University of North Carolina, the New York State Education Department, multiple NC Childhood Education Partnerships, and Hawaii’s Kamehameha Schools. As part of her evaluation work, she has developed and guided large-scale survey initiatives. Dr. Germuth teaches evaluation and instrument development as part of Duke University’s Certificate Program in Non-Profit Management.