In this presentation, we share learning from the evaluation of the causal link between the determinants and performance of the value chain information system (VCIS) of Diversification and Coffee Rehabilitation project in El Salvador implemented by NCBA-CLUSA. The project is funded by the United States Department of Agriculture (USDA) to improve agricultural productivity and expand trade of coffee. For the effective monitoring and evaluation of the outcomes and impact, Coffee Rehabilitation project implemented an information system which is now fully operational. Performance of the VCIS will be measured in terms of 1) quality of data and 2) use of information across the project’s theory of change blocks. Determinants will be measured in terms of technology, techniques, qualifications of staff, and organizational culture and leadership. We assume that addressing gaps in these determining factors can lead to improved performance of the VCIS.
This proposal provides a framework for evaluating performance and determinants of value-chain information systems. The relevance of this proposal in the field of evaluation can be outlined in terms of 1) strengthening of collection, aggregation, and reporting of data on outputs, outcomes and impact; 2) institutionalization of routing assessment and improvement of information system to generate good quality data and promote information use for decision making, and 3) conceptualizing a methodology for evaluating population level impact of the value-chain projects as guided by the theory of change. Coffee Rehabilitation project’s theory of change for example centers around two goals 1) increase coffee productivity, and 2) expand trade of coffee. It is assumed that increased coffee productivity is associated with increased adoption of improved farming techniques and technologies; enhanced capacity of the government institutions, producer organizations, cooperatives and individual farmers; and increased access to financing and improved inputs. Likewise, expanded trade of coffee is assumed to be associated with the use of improved post-harvest techniques and technologies; increased market linkages; and access to the market.
The objective of this evaluation is to understand the performance of the information system in relation to determining factors. One of the key challenges faced by many value-chain projects in developing countries is the lack of well-performing information systems required for continuous monitoring and evaluation of outputs, outcomes and impact. We assume the implications of this study will be 1) adoption of the evaluation framework as proposed in this study by similar value-chain projects, 2) policy direction to emphasize on the importance of strengthening information systems in value-chain monitoring and evaluation, and 3) establishing information use culture.