Powerpoint slides & abstract from Evaluation 2009 presentation as part of a panel on "Tools and Processes for Evaluating Systems Change." Abstract: Since 2006, the Massachusetts Department of Developmental Services has been working to make its system of day services and supports more focused on competitive employment outcomes. This effort, undertaken with assistance from the Massachusetts Medicaid Infrastructure and Comprehensive Employment Opportunities (MI-CEO) grant has involved intervention at multiple levels including: 1) changes to agency-wide and regional policies and practices, 2) technical assistance to local service providers, and 3) direct support staff training. Using the systems initiative evaluation framework developed by the Build Initiative, MI-CEO researchers developed a theory of change model incorporating the major strategies of the systems change effort. The model provided an organizing framework for a multi-method and multi-level evaluation that includes both system-wide evaluation strategies and evaluation of individual project components. For example, bellwether interviews assess high-level policy changes, case studies highlight successes and challenges at the local and individual levels, and participant surveys evaluate training outcomes. #DiversityandInclusion #2009Conference #SystemsinEvaluation