We present the evaluation design of a large-scale program evaluation of the National Science Foundation undergraduate research program, the Computer and Information Sciences and Engineering (CISE) Research Experiences for Undergraduates (REU) program. We designed an evaluation to gain perspectives and review key components of the program. Two papers inform our presentation of the evaluation frameworks that were critical to our design. These frameworks include participatory evaluation (Fetterman), the CIPP model (Stufflebeam) and two organizational frameworks, Open Systems model and the Seven S Model. Our evaluation design is part of a scaffolded evaluation approach to produce a comprehensive program evaluation that moves beyond outcomes measurement of participants toward an organizational evaluation model that identifies indicators of effectiveness for the overall program.