For a number of years, the United Way of Greater Houston (UWGH) has facilitated affinity groups of agencies in the same services field to evaluate common outcomes. Among these affinity groups have been those providing services to victims of domestic and sexual violence (six agencies with about 250 clients) as well as substance abuse services (four agencies with about 300 clients). Recently, these latter two affinity groups have abandoned paper and pencil methods of collecting outcomes data on clients in favor of on-line ones. Purpose: In this paper the results of assessing this change on survey response rates, missing client information, client refusals to participate, frequency of agency data gathering, and the meeting of agency data needs will be presented. Methods: A naturally-occurring interrupted time series design permitted assessing the results pre- and post-change over. Discussion: The findings and implications of results are discussed. #datacollection #surveyresearch