Home

Welcome to the Research on Evaluation (RoE)      Topical Interest Group (TIG)!

Mission

The Research on Evaluation (RoE) Topical Interest Group (TIG) seeks to advance the practice and standing of Research on Evaluation among members of the American Evaluation Association.   

The RoE TIG works to provide a venue for discussing, learning about, and promoting the use of Research on Evaluation amongst evaluation practitioners and academics, with the goal of supporting evaluators to explore and adopt high-quality evaluation practice.

About the RoE TIG

The Research on Evaluation Topical interest group launched in 2011 and now has approximately 550 members.

Key areas of interest include:

  • Defining research on evaluation
  • Research on evaluation practice
  • Research on evaluation methodology
  • Research on evaluation theory

What exactly is Research on Evaluation?

The term “research on evaluation” (also called RoE) has been used to encompass a broad range of inquiry methods, both systematic and unsystematic, that examine evaluation theories, methods, and practices (Coryn et al., 2016). With the goal of providing greater clarity and specificity, RoE scholars have begun considering operational definitions of “research on evaluation”.

Chris Coryn and colleagues (2016) for example, define research on evaluation as:

“Any purposeful, systematic, empirical inquiry intended to test existing knowledge, contribute to existing knowledge, or generate new knowledge related to some aspect of evaluation processes or products, or evaluation theories, methods or practices”  (Coryn et al., 2016, p.3).

Fierro (working definition) contributes another useful definition that adds the importance of RoE for informing the practice of evaluation: 

"A research investigation that generates findings with the intended purpose of creating a stronger evidence base and infrastructure for the applied practice of evaluation" (Fierro, working definition). 

While Coryn et al. carefully explore what research on evaluation is about, Fierro expands to include the intentionality and purpose of research on evaluation.

In 2019, the Research on Evaluation TIG held a number of discussions about what RoE means to the group. These two definitions and understandings rose to the top. Our understanding of what research on evaluation is (and isn't) is constantly evolving and we need your voice to help us!

Stay Current

Eval22 Conference 
Thank you to all who submitted proposals for Eval22! We have a great lineup for RoE sessions and hope to see you in New Orleans on November 7-12. Register here: https://www.evaluationconference.org/.

Peer Learning Circles Return!
For 2022-2023, we are hosting Peer Learning Circles on a quarterly basis. The first session was July 25 and the next will be October 17, 12-1pm ET. You can complete early registration here.

Webinar Series  (Generously Sponsored by the Faster Forward Fund)
Our webinar series will return in 2022. We are currently seeking presenters to share their experiences and expertise on research on evaluation. If you are interested in presenting, please contact Esther Nolton.

2022-2025 RoE TIG Leadership
TIG Chair: Esther Nolton
Program Co-Chairs: Rachael Kenney & Rebecca Teasdale
Website Coordinator: Amanda Sutter
Advisor: Dana Wanzer

2021 Annual Meeting

The last annual meeting was held on November 4, 2021 via Zoom. In addition to TIG-related business, we hosted Mariana Branco & Stephen Porter for their presentation, Understanding and addressing potential for harm in evaluation practice. You can view the business meeting here and the presentation and discussion at this link

Past Webinars & Resources

The RoE TIG offers online sessions related to RoE throughout the year to supplement our offerings at the American Evaluation Association's Annual Meeting. Please contact Rachael Kenney & Rebecca Teasdale if you are interested in presenting on RoE.

April 15, 2022
Getting Started with Research on Evaluation Webinar
Audio presentation   Slide deck and Handout
Webinar presenter:
Dana Wanzer, PhD (University of Wisconsin- Stout)

November 4, 2021
Research on Evaluation Topical Interest Group Annual Meeting
Video presentation   Slide deck

Understanding and Addressing Potential Harm in Evaluation Practice
Video presentation   Slide deck   Breakout Room Questions
Webinar presenters:
Mariana Branco (World Bank Independent Evaluation Group [IEG])
Stephen Porter (World Bank Independent Evaluation Group [IEG])

January 28, 2021
The Faster Forward Fund (3F): Funding Opportunities for Those Committed to Accelerating the Theory & Practice of Evaluation
Video presentation   Slide deck
   Expression of Interest in becoming a 3F Reviewer
Webinar presenter:
Sarah Mason, PhD (Center for Evaluation Research at Ole Miss)

August 25, 2020
Inclusive Methods in the Evaluation of Outreach Education Programs: Reflective Journaling and Participant Observations
Video presentation   Slide deck

Webinar presenter:
Sondra LoRe (National Institute for STEM Evaluation and Research [NISER] Evaluation Manager at University of Tennessee, Knoxville)

January 22, 2020
International Collaboration for RoE: The ISEE Experience
Video presentation   Slide deck

Webinar presenters:
Amy Gullickson, PhD (Centre for Program Evaluation at University of Melbourne)
Leanne Kallemeyn, PhD (School of Education, Loyola University Chicago)

April 23, 2020
Getting RoE Published
Video presentation   Slide deck

Webinar presenter: 
J. Bradley Cousins, PhD (Faculty of Education, University of Ottawa)

We ask for your patience as we get our past webinars linked here.

New Events & Resources

Back by popular demand: Research on Evaluation (RoE) Peer Learning Circles!

Last year, the RoE TIG held our first peer learning event to discuss topics related to RoE. We are excited to launch a new series of Peer Learning Circles in response to member requests and feedback. These events will be quarterly: July, October, January, & May.

Please join us for the second on October 17, 2022, 12-1pm ET. Everyone with RoE interest or experience is welcome: evaluation practitioners, students, academics, and more! Our first peer learning circles event will have three breakout rooms for discussion in small groups:

  1. Funding & support systems for RoE
  2. Generating ideas & designing RoE
  3. Doing RoE (e.g., the nuts and bolts of planning, implementing, writing, disseminating)

Please note that due to being discussion-based, we will not be recording these events. Zoom registration registration here.

RoE 101 Zotero Library

As a follow-up from the webinar "Getting Started with Research on Evaluation" led by Dr. Dana Wanzer in April (available on the TIG resources tab), we have compiled all citations that came up during the session and are sharing for anyone who wants to dive into all essential RoE reading which can be viewed here: https://www.zotero.org/groups/4698645/intro_to_research_on_evaluation/library. Note that the Zotero library only provides links to resources and not the PDFs of resources themselves because that would infringe on copyright. However, Google Scholar, university libraries, and other resources can help you find the PDFs of articles if a general internet search does not bring them up.

If you would like to help manage the collection, click this link to join: https://www.zotero.org/groups/4698645/intro_to_research_on_evaluation. We'll be limiting membership to those who want to help maintain the database, but all others can access the public library at the first link.