Bowman Performance Consulting Culturally Responsive, Indigenous, and Equitable Evaluation Resource List. August 2021.The list below is a series of resources for Indigenous evaluation and conducting evaluation with Indigenous peoples and communities, that IPE TIG has highlighted in previous publications, presentations, and talks as well as those resources collected and shared by Indigenous evaluators. If you have resources that you would like added, please contact the Communications Chair and Co-Chair; the resources on this page will be updated periodically.
------------------------------------
Rights of Indigenous Peoples
United Nations Declaration on the Rights of Indigenous Peoples: https://www.un.org/development/desa/indigenouspeoples/declaration-on-the-rights-of-indigenous-peoples.html
The American Declaration on the Rights of Indigenous Peoples: http://indianlaw.org/adrip/home
-----------------------------
Resource List
Bowman Performance Consulting Culturally Responsive, Indigenous, and Equitable Evaluation Resource List. August 2021.
Indigenous Evaluation Booklets
AIHEC Indigenous Evaluation Framework
AIHEC developed a series of four 2.5-day intensive and hands-on workshops on the Indigenous Framework for Evaluation and invited people to join our effort to take ownership of evaluation in Indian Country to help build an evaluation framework relevant to community and responsive to traditional values and culture. A training workbook was developed to facilitate the training. Although there are no training workshops scheduled at this time, the chapters from the workbook are now available in PDF format. AIHEC Indigenous Evaluation Online Booklet
Keeping Track: A Toolkit for Indigenous Youth Program Evaluation
The Notah Begay III (NB3) Foundation is excited to announce the release of Keeping Track toolkit. The youth program focused toolkit is aimed at providing resources and information that will assist anyone involved in a youth project, program or serving at a youth-centered organization create an evaluation approach that reflects and supports their community’s needs and strengths. From an Indigenous perspective, using this toolkit is a continuation of the knowledge handed down through generations of learning.
Resources by Topic
Indigenous Land Acknowledgements
Land Acknowledgement Considerations
Land Acknowledgements are the responsibility of the occupier of the land to put together and write. The responsibility should not be that Native peoples of the land you occupy to educate and provide the answer. Land Acknowledgements are an exercise in reflection on how land was accumulated and taken and was unceded in many instances from Indigenous people around the globe. Further expectation to have Indigenous people lead a personal reflection further adds to the work Indigenous people have to do. Part of developing the land acknowledgement is to participate in a reflective process that recognizes and reflects on the privilege and space and territory that we all occupy and how acknowledgements can create a space that recognizes other lived experiences beyond those typically told.
Resources and Protocols for Land Acknowledgements
For more information on how you can develop a land acknowledge statement, visit Native Governance Center's resources page for more helpful land acknowledgment tools! And read the Native Governance Center’s own land acknowledgment statement: The Land We’re On. From: Native Governance Center | @nativegov | nativegov.org
Additional Resources:
Missing and Murdered Indigenous Women and Relatives (MMIWR):
The “Knowledge Gatherers and Caretakers: A Research Guidance Document for MMIW/R in Wisconsin” is now a live link on the WI DOJ website. See here for more information to this free resource: https://www.doj.state.wi.us/sites/default/files/ocvs/1_5_23%20Edited_Final_WI_MMIWR_DataSubCmte_Research%20GuidanceDoc_FromBPC.pdf. Drs. Bowman, Braithwaite, and Warner were the supportive team and contributing authors to this document along with the MMIW/R Data Subcommittee and MMIW/R Leadership which has representation from our 11 Tribal Nations. The WI DOJ document description: The Wisconsin MMIW/R “Knowledge Gathers and Caretakers” research guidance document is to provide a culturally responsive, Indigenous rooted, and contextually appropriate response to the WI MMIW/R activities being implemented by Tribal Nations in Wisconsin. This document was a work product from the MMIW/R Wisconsin Task Force (Data Subcommittee) in 2022 to help provide guidance for building research and evaluation capacity and conducting Indigenous-led research and collaborative educational activities that Tribal Nations and their partners can consider for more strongly supporting their MMIW/R initiatives. Built from a Seven Directions Medicine Wheel Framework, the document was co-created with the Tribal Nations and MMIW/R leaders on the Data Subcommittee and WI Task Force as an intentional and supported discussion that was facilitated by the scientific and Indigenous team members at Bowman Performance Consulting.
Citation Guides for Elders and Knowledge Keepers:
MacLeod, Lorisia. 2021. “More Than Personal Communication: Templates For Citing Indigenous Elders and Knowledge Keepers”. KULA: Knowledge Creation, Dissemination, and Preservation Studies 5 (1). https://doi.org/10.18357/kula.135.
University of Alberta Library Indigenous Citation Styles Guide: https://guides.library.ualberta.ca/c.php?g=715568&p=5112574
For decades, Indigenous scholars have called for better ways of acknowledging Indigenous voices in academia. Many of our structures within the academic world today are rooted in Eurocentric systems that have always placed a higher value on Western knowledge rather than Indigenous oral traditions and ways of knowing. Citation is undoubtedly one of these structures.
Citation styles and formats allow us the chance to formally acknowledge the information that we have learned from others; however, these styles disproportionately prioritize information that’s been written down. Because so much Indigenous knowledge is held within oral traditions and ways of knowing, citation acts as a barrier to the respectful inclusion of Indigenous voices in academia.
Data Sovereignty
- The latest 2020 volume of this Aotearoa New Zealand Evaluation Association (ANZEA) journal is now online, and contains a commentary from John Njovu on Covid-19 and Indigenous evaluation in Zambia.
- Fiona Cram has just had a description of Maori work during the Covid-19 lockdown in Aotearoa New Zealand published in Kōtuitui: New Zealand Journal of Social Sciences Online.
- Culturally Responsive, Indigenous, and Equity Focused Evaluation Bibliography (Updated March 2021) from Bowman Performance Consulting (see attached document) or this link (bottom of BPC page): https://www.bpcwi.com/scholarship.
- Walter, et al. (2020) “Indigenous Data Sovereignty in the Era of Big data and Open Data”. https://doi.org/10.1002/ajs4.141
- Hiraldo, Danielle, Stephanie Russo Carroll, Dominique M. David-Chavez, Mary Beth Jäger, and Miriam Jorgensen. 2020. "Native Nation Rebuilding for Tribal Research and Data Governance." NNI Policy Brief Series. Tucson: Native Nations Institute, University of Arizona. Australian Journal of Social Issues.
- The Gov Lab (2020). Selected Readings on Indigenous Data Sovereignty. Blog article here: https://blog.thegovlab.org/post/selected-readings-on-indigenous-data-sovereignty
- Lovett, Ray, Vanessa Lee, Tahu Kukutai, Stephanie Carroll Rainie, Jennifer Walker. 2019. Good Data Practices for Indigenous Data Sovereignty, in Angela Daly, Kate Devitt, & Monique Mann (Eds.), Good Data, Amsterdam: Institute of Network Cultures Inc. ISBN 978-94-92302-27-4. http://networkcultures.org/wp-content/uploads/2019/01/Good_Data.pdf
- Rainie, S., Kukutai, T., Walter, M., Figueroa-Rodriguez, O., Walker, J., & Axelsson, P. (2019) Issues in Open Data - Indigenous Data Sovereignty. In T. Davies, S. Walker, M. Rubinstein, & F. Perini (Eds.), The State of Open Data: Histories and Horizons. Cape Town and Ottawa: African Minds and International Development Research Centre.
- Walter, M., Kukutai, T., Carroll, S. R., & Rodriguez-Lonebear, D. (2021). Indigenous data sovereignty and policy (p. 244). Taylor & Francis. https://doi.org/10.4324/9780429273957
- Lovett, R., Lee, V., Kukutai, T., Cormack, D., Rainie, S. C., & Walker, J. (2019). Good data practices for Indigenous data sovereignty and governance. Good data, 26-36. https://researchcommons.waikato.ac.nz/bitstream/handle/10289/12919/data%20practices.pdf?sequence=5&isAllowed=y
- Data Sovereignty: A Review (Hummel, et al., 2021): https://journals.sagepub.com/doi/full/10.1177/2053951720982012.
- Kukutai, T., & Taylor, J. (2016). Indigenous data sovereignty: Toward an agenda. ANU press. http://doi.org/10.22459/CAEPR38.11.2016
- Data Sovereignty: A Review (Hummel, et al., 2021): https://journals.sagepub.com/doi/full/10.1177/2053951720982012.
- Native Nations Institute’s The 12 Rights of Indigenous Peoples in Data: https://nni.arizona.edu/news/12-rights-of-indigenous-peoples-in-data
Indigenous Data Sovereignty Recorded Lectures
----------------------------------------------------------------------
Additional Resources (Recommended, Past Highlights, Newsletter/Publications, etc.)
Books/Journals
- The inaugural publication of Roots & Relations was released inside the Canadian Journal of Program Evaluation (Vol. 38 No. 1). Congrats to the authors, thanks to the reviewers, and much appreciation to the Elder editor too (Larry Bremner) and CJPE staff for the support always!! Access here! The next issue will be out late 2023 or early 2024. There are several articles that are free access
- Adedoyin, A. C., Amutah-Onukagha, N. N., & Jones, C. D. (2023). Culturally responsive & equitable evaluation: Visions and voices of emerging scholars. Cognella. LINK
- The new Culturally Responsive and Equitable Evaluation Book is out and includes a chapter, regarding the Seven Directions and Indigenous Evaluation! If you lack financial access, e-mail Nicole Bowman directly at info@bpcwi.com, or the other authors in this book for assistance.
- Chouinard, J. A., & Cram, F. (2019). Culturally responsive approaches to evaluation: Empirical implications for theory and practice. SAGE Publications.
Articles/Documents
- Dodge Francis, C., Bowman, N., & King, S. (2023). Kinship pathways: Nurturing and sustaining resilient, responsible, and respected indigenous evaluators. New Directions for Evaluation, 2023, 145– 152. https://doi.org/10.1002/ev.20537
- Pohatu, T. W. (2013). Āta: Growing respectful relationships. Ata: Journal of Psychotherapy Aotearoa New Zealand, 17(1), 13-26. https://doi.org/10.9791/ajpanz.2013.02
- Were, L. M. (2021). Conscious Disruption: Actioning the Capacity of Aroha for Positive Change Through Evaluative Leadership (Doctoral dissertation, Auckland University of Technology). Access here: http://orapp.aut.ac.nz/handle/10292/14285
- EvalIndigenous’ 10 Questions Indigenous Communities Should Ask Evaluators: https://evalpartners.org/sites/default/files/10Qs4evaluatorsUSletter.pdf
- EvalIndigenous’ Indigenous African Ethical Protocol for Evaluations: https://evalpartners.org/sites/default/files/EvalIndigenous_Indigenous%20African%20Ethical%20Protocol%20for%20Evaluations_2020.pdf
- Bowman, N. (2020). Nation‐to‐nation in evaluation: Utilizing an Indigenous evaluation model to frame systems and government evaluations. New Directions for Evaluation, 2020(166), 101-118.
- Hall, J. N. (2020). The Other Side of Inequality: Using Standpoint Theories to Examine the Privilege of the Evaluation Profession and Individual Evaluators. American Journal of Evaluation, 41(1), 20-33.
- Acree, J., & Chouinard, J. A. (2020). Exploring Use and Influence in Culturally Responsive Approaches to Evaluation: A Review of the Empirical Literature. American Journal of Evaluation, 41(2), 201-215.
- Carey, T. A., Fauth, J. M., & Tremblay, G. C. (2020). Rethinking evaluation for improved health outcomes: implications for remote Australia. American Journal of Evaluation, 41(2), 234-254.
- Clark, N. (2019). Building a Culturally Responsive Independent Consulting Practice, New Directions for Evaluation, 81-88.
- Wolfe, S.M. & Webb Price, A. (2019). Partnering for Social Change: Collaborating with Clients and Communities, New Directions for Evaluation, 134, 89-100.
- Richardson, E.Z.L., Phillips, M., Colom, A., & Nichols, J. (2019). Honoring Lived Experience: Life Histories as a Realist Evaluation Method, American Journal of Evaluation, 40(4), 509-532.
- THE AMERICAN DECLARATION ON THE RIGHTS OF INDIGENOUS PEOPLES - https://indianlaw.org/adrip/home
- On June 15, 2016, after nearly 30 years of advocacy and negotiation, the Organization of American States (OAS) adopted THE AMERICAN DECLARATION ON THE RIGHTS OF INDIGENOUS PEOPLES. The OAS is a regional intergovernmental organization of 35 member countries of the Americas, including the United States
- Truth and Reconciliation Commision of Canada Final report - https://web.archive.org/web/20200505161532/http://trc.ca/about-us/trc-findings.html
- In December 2015, the Truth and Reconciliation Commission of Canada released its full report. It paints a frank and bleak picture of the historical relationship between European settlers and Aboriginal peoples. It identifies a series of policies that were aimed at assimilating Indigenous people. It describes the results of over 200 years of oppression and violence. And it focuses on 94 recommendations for action towards reconciliation. The Diversity Working Group of the CES Board of Directors has put forward several resolutions that have been debated and adopted by the board at its May 4, 2016, meeting. The CES is committed to incorporating reconciliation in its values, principles, and practices.
- Evaluation in Canada in 2025: what could be, what should be, and what to do now - https://www.cdu.edu.au/sites/default/files/evaluative-voices-2016-02.pdf
- "Evaluation in Canada in 2025: what could be, what should be, and what to do now” written by Benoît Gauthier, CE, Past-President/Canadian Evaluation Society, Treasurer/IOCE. Where is evaluation likely to be in 2025? The Australasian Evaluation Society issued a ‘predict the future’ challenge to a number of international evaluators, including the author, in September 2015. This paper, focusing primarily on Canada but with international implications, is the result.
- Centers for Disease Control and Prevention’s (CDC) Good Health and Wellness in Indian Country (GHWIC) - https://www.cdc.gov/pcd/collections/Good_Health_And_Wellness_2019.htm
- Preventing Chronic Disease (PCD) recently released a new collection of articles on Indian wellness. The PCD collection includes 7 articles from the Centers for Disease Control and Prevention’s (CDC) Good Health and Wellness in Indian Country (GHWIC). CDC describes the collection as, “Together, the articles on GHWIC describe a model for public health practice across the country and around the world, one that seeks to be relevant to the people being served, to uplift culture and respect local knowledge, and to institutionalize sustainable health improvements.”
- 2019 Indicator Gathering Meeting Summary & Nature-Culture Indicators and Knowledge Systems Resource Directory - https://www.amnh.org/research/center-for-biodiversity-conservation/convening-and-connecting/biocultural/2019-indicator-gathering & https://www.amnh.org/research/center-for-biodiversity-conservation/resources-and-publications/nature-culture-indicators-resources
- A new resource from an April 2019 meeting of Indigenous and community-led earth warriors who convened to discuss the development of indicators related to connections between and across people and place in Indigenous Peoples and local communities (IPLCs). The Center for Biodiversity and Conservation (CBC) at the American Museum of Natural History (New York, NY, USA) hosted 20 IPLC members and practitioners from Russia, Central Asia, North America, Central America, and the Pacific Islands during the meeting early this year. Participants exchanged perspectives and lessons learned using linked biological and cultural indicators in monitoring and reporting for Indigenous and/or community-led biodiversity conservation efforts. A full copy of the “2019 Indicator Gathering Meeting Summary” can be obtained here.
Websites
Listservs Available to Join
--------------------------------------
Past IPE TIG AEA365 Blog Posts
IPE TIG Blog Posts (specifically tagged “Indigenous Peoples in Evaluation”):
- Rodney Hopson on Culturally Responsive Evaluation: LINK
- Gerri Spilka on the Robert Wood Johnson Foundation Evaluation Fellowship Program: LINK
- Susan Geier on Using a Participatory Evaluation Approach: LINK
- Katherine Tibbetts and Wendy Kekahio on Collaborative Inquiry: LINK
- Andrea Johnston on the Waawiyeyaa Evaluation Tool: LINK
- Kate McKegg on Developing Evaluator Competencies: LINK
- Scribing: Vidhya Shanker on Discussions Regarding the AEA Cultural Competence Statement: LINK
- Susan Kistler on the AEA Graduate Education Diversity Internship: LINK
- Dianne Hofner Saphiere on Interculturally Competent Evaluation: LINK
- Bloggers Series: Jane Davidson and Patricia Rogers on Genuine Evaluation: LINK
- Dominica McBride on Sociocultural Theory and its Applicability to Evaluation: LINK
- Corrie Whitmore on Framing an Evaluation Conversation for Programs with Fuzzy Goals: LINK
- CC Week: Cindy Crusto on Introduction to AEA Public Statement on Cultural Competence in Evaluation Week: LINK
- CC Week: Osman Özturgut and Tamera Bertrand Jones on Integrating Cultural Competence into Your AEA Presentation: LINK
- CC Week: Tamera Bertrand Jones, Osman Özturgut, and Leah Nuebauar on Teaching Culturally Competent Evaluation: LINK
- CC Week: Karen Anderson on Integrating Cultural Competency into Organizations: LINK
- CC Week: Jori Hall on Integrating Cultural Competence into Everyday Practice, Part 1: LINK
- CC Week: Dominica McBride on Integrating Cultural Competence into Everyday Practice, Part 2: Cultural Competence through Self-awareness and Reflection: LINK
- Humberto Reynoso-Vallejo on Multicultural Processes in Evaluation: LINK
- Karen Vocke on Migrant Evaluation: LINK
- Video in #Eval Week: Kas Aruskevich on Telling the Story Through Video: LINK
- AKEN Week: Amelia Ruerup on Understanding Indigenous Evaluation in an Alaskan Context: LINK
- AKEN Week: Vanessa Hiratsuka on Continuous Quality Improvement, Quality Assurance, Evaluation, and Research: Where does my project fit?: LINK
- Roxann Lamar on Culturally Responsive Terminology: LINK
- Trial and error in the process of creating culturally-responsive evaluation with Morgan J Curtis, Patrick Lemmon, and Strong Oak Lefebvre: LINK
- THE WISCONSIN IDEA IN ACTION by Nicole Bowman: LINK
- IPE TIG Week: Introduction to the Indigenous Peoples in Evaluation TIG by Erica Roberts and Nicole Bowman: LINK
- IPE TIG Week: Indigenous Evaluators without Borders: IPE TIG Participation Nationally and Globally by Nicky Bowman: LINK
- IPE TIG Week: Engaging with research by Fiona Cram and Aneta Cram: LINK
- IPE TIG Week: On the Slipperiness of Culture by Vidhya Shanker: LINK
- IPE TIG Week: Thoughts on Indigenous Sovereignty and Thanksgiving by Mark Parman: LINK
- IPE TIG Week: Transformative Framework as a Paradigm for Indigenous Community Evaluation by Jeremy Braithwaite: LINK
- LAWG Week: WOPASI: Indigenous Youth Research & Development Center by Wakinyan LaPointe: LINK
- The Invisible Labor of Women of Color and Indigenous Women in Evaluation by Vidhya Shanker: LINK
- The invisible labor of women of color and indigenous women in evaluation, Part 2 by Vidhya Shanker: LINK
- APC TIG Week: APC Evaluators can stand in Greater Solidarity with Indigenous People by Sarah Stachowiak: LINK
- CREA-HI week: Data Sovereignty by Katherine Tibbetts: LINK
- LGBT TIG Week: Good Relations, Chosen Family: Solidarity Building for Indigenous & 2SLGBTQ+ Research and Evaluation by Dylan Felt & Waapalaneexkweew AKA Nicky Bowman: LINK
- IPE TIG Week: Being a Good Guest in Different Cultural Spaces by Aneta Katarina Raiha Cram: LINK
- IPE TIG Week: Journeying from Settler Colonialism Towards Indigenous Liberation Through Culturally Specific Assessment by David Sul: LINK
- IPE TIG Week: Intentionally Reframing Logic to Hope by Dyani Bingham, Desiree Restad, Kelley Milligan, and Allyson Kelley: LINK
- IPE TIG Week: Indigenous Evaluation and Learning Centers on the How by Dr. Gladys Rowe: LINK
- IPE TIG Week: Empowering Data Collection by Dyani Bingham, Desiree Restad, Kelley Milligan, and Allyson Kelley: LINK
- IPE TIG Week: Indigenous Data Sovereignty and IP Rights: On Being Good Relatives by Nicole Bowman/Waapalaneexkwee, Michael Petillo and Andrealisa Belzer: LINK
- IPE TIG Week: Lessons Learned from the Colonizer by Linda Sue Warner: LINK