While data on race is frequently collected as part of evaluation, what is it that we are really trying to measure? It appears as if many evaluations use data on race as an unspoken indicator for racism, although failing to specify this and utilizing race as the only indicator of racism has value implications which can promote racial stereotypes and lower the quality of the evaluative findings. We will discuss value implications associated with different ideas of racism and practical strategies, indicators, and tools to measure it. We will also present the value implications behind using race versus the social construct of race when trying to assess the impact of racism and practical solutions for measuring the latter.