Government Evaluation TIG
Welcome to the AEA Government Evaluation Topical Interest Group website.
November 27 - December 3, 2022
Government Evaluation TIG week on AEA 365 Tip-A-Day: https://aea365.org/blog/welcome-to-government-eval-tig-week-by-steven-lize-and-chris-voegeli/
Greetings Government TIG Members,
Now well into 2022, the Government Evaluation TIG leadership team wants to share some reflections on our TIG’s activities during 2021. We are glad to have had strong representation at our AEA conference in November, virtually again. Special thanks to everyone who contributed:
Emily Brennan, Janet Fish, Sherese Garrett, Steve Lize, Mary Roach, Krystal Tomlin, Chris Voegeli, and Josephine Watera
- Journey Mapping: The Participant Experience, Mary Ann Aabye & Marie-Ellen Ehounou
- Federal Perspectives: Lessons in Establishing A Culture of Evidence, Brittany Borg, Rebecca Kruse, Clemencia Cosentino, & Kimberley Raue
- Integrating equity in Federal program evaluation: How four agencies are “Meeting the Moment,” Susan Jenkins, Danielle Berman, Katherine Dawes, & Rebecca Kruse
- Next Level Evaluation: Using past studies to estimate programs’ return on investment (ROI), Lily Zandniapour & Benjamin Miller
- Program Evaluation during Program Adaption: A National Training Program’s Experience during the COVID-19 Pandemic, Sherese Garrett
We also thank the panelists who gave a special webinar in October on Federal Learning Agendas: From Learning to Action, featuring:
Shilpa Clift, Laura House, Dan Kidder, Emily Schmitt, Chris Voegeli, and Marina Volkov
You can watch the video recording on YouTube here: https://youtu.be/d_iEvDDS2Yk
Before and after the learning agenda panel, several Government Evaluation TIG members reached out to ask about how they, the Government Evaluation TIG, and AEA can support the implementation of the federal Foundations for Evidence-based Policymaking Act at the local and state government level. The Government Evaluation TIG is forming a working group this year to start these discussions. If you are interested, please email Chris Voegeli at firstname.lastname@example.org.
At our Annual Meeting in November, we elected a new Co-Chair Elect, Steve Lize. But the leadership team has had some turnover. We say farewell to Lisa Bowers as our TIG’s Webmaster. Thank you for serving! Our TIG’s leadership team continuing from 2021 includes Chris Voegeli, Co-Chair; Krystal Tomlin, Past Co-chair; Mary Roach, Program Co-Chair; and Laura House, Engagement Chair.
We need an additional Program Co-Chair! The leadership team has two Program Co-Chairs and we have a vacancy. Please reach out to the leadership team if you are interested in serving as Program Co-Chair to help coordinate the annual conference review of submissions. The Program Co-Chair serves a three-year term and is responsible for:
- Coordinating the planning, development, and implementing the TIG’s program at the annual conference.
- Receiving the materials from the AEA office for redistribution to reviewers as needed.
Coffee and Collaborate! New virtual meetings:
In 2022 our TIG will launch a new informal meeting opportunity for members. We aim to connect with other TIGs to find common ground in different experiences with government evaluation and explore ways to collaborate. We hope to have four sessions during the year. Watch for the announcements.
AEA365 blog contributions needed:
The Government Evaluation TIG has the week of 11/27 for AEA365. We need to submit 7 posts to them by 10/20. We are looking for five volunteers to contribute articles. Please consider it and let us know if you have an idea. Learn more about AEA365 contributions here.
Our TIG’s Mission/Vision Statements:
The Government Evaluation Topical Interest Group (TIG) exists to provide a forum for communication of best practices, sharing evaluation findings, mutual support, and professional development for those interested in evaluations completed for the purposes of improving government programs, services, and/or conducting evaluations following governmental policies. The Government Evaluation TIG was launched in 1990 under the leadership of Dr. David Bernstein and is considered one of the oldest standing TIGs in AEA history. Our membership includes those individuals who serve in various capacities of government, whether employees or contractors.
The TIG hopes to improve the state of evaluation done by and for governments by being a resource for all government evaluators while also providing venues to share experiences and learn from each other.
Greetings Government Evaluation TIG members & colleagues!
I hope this message finds you well. You are invited to attend our Annual meeting, Tuesday, Nov. 16th, 5-6 pm, ET. We will reflect on our experiences from the past year and look forward to the next year by electing new leadership members and planning events and outreach to connect with other TIGs. All Government Evaluation TIG members (and prospective members) are welcome. You do not have to register for the Evaluation21 conference to attend. Here is the link to join the meeting:
Meeting ID: 863 3736 4793 | Passcode: 080427
The New Mexico Legislative Finance Committee (LFC) is seeking a talented and motivated Program Evaluator and Fiscal Analyst to join our award-winning team. Position details and application instructions are on the LFC website. The jobs are located in beautiful Santa Fe.
About the LFC: The New Mexico Legislative Finance Committee makes budgetary recommendations to the whole Legislature for the funding of state government, higher education, and public schools in addition to its accountability and oversight role. The Committee employs professional program evaluators to determine the results of taxpayer expenditures and recommend improvements in state government. The LFC also maintains a permanent staff of fiscal analysts and economists who examine budgets, participate in the state's revenue estimating process and collaborate with the evaluation staff.
We invite you to share these openings with any potential applicants you think might be a good fit.
You're invited to a conversation next Wednesday, July 7, at 2:00 p.m. EDT, learn about the new Evidence Act guidance
from the White House Office of Management and Budget. During the 1-hour webinar participants will hear reactions from evaluation experts and about identify opportunities to support implementation of the Evidence Act’s evaluation and evidence planning processes. CLICK HERE TO RSVP
- Lisa Aponte-Soto, Ph.D, Board Member, American Evaluation Association
- Ruth Neild, Ph.D., Executive Director, Mathematica
- Jen Hamilton, Ph.D, Vice President, Education and Child Development, NORC at the University of Chicago
- Nick Hart, Ph.D., President, Data Foundation
When: Wednesday, July 7, at 2:00 p.m. - 3:00 p.m. EDT
You’ve probably already seen the American Evaluation Association’s call for proposals for the 2021 Evaluation conference, Eval21 Reimagined: A Virtual Experience. The theme, AEA at 35: Meeting the Moment calls for celebration and reflection on our practice of evaluation. It is a time for us to share our stories about what we have learned over the past 35 years. The theme asks us to consider how our practice of evaluation has been shaped by the past and how we are adapting to meet today’s challenges. Relative to our Government Evaluation TIG, we hope to have proposals that consider:
- Where does evaluation in government stand today?
- What have we learned from our experience conducting evaluation in, and for, government that could help us to address such challenges as social justice, equity, and sustainability?
- What are our responsibilities as individual professionals to reflect on how our profession and our practice may perpetuate injustice through the government agencies we’re part of or the government operations that we assess?
- How can government research partnerships with higher education institutions, non-profits, and philanthropies be generated to strengthen government evaluation capacity?
- How can evaluations in government be improved through today's innovative technologies?
Submission and Selection Process
The AEA will follow the same submission and selection process as last year, except for the online submission format. Like last year, reviewers will be more selective than in past years to ensure high-quality, relevant, and engaging sessions for the virtual experience. The proposal submission requirements reflect those priorities.
When submitting your proposal:
- Choose a session type and select the TIG(s) to which your proposal relates. (This has always been the case, but still an important step worth mentioning!)
- Indicate whether the content fits a beginner, intermediate, or advanced evaluator audience.
- Select competencies or guiding principles (or a combination of the two) to which your proposal’s content relates.
- Consider volunteering to be a peer reviewer to rate the submitted proposals!
Behind the scenes, the AEA staff and executive leadership are working on ways to systematize the review process and make the reviews by all the various TIGs more consistent.
One More Thing!
We would like to have more representation of the government-related work coming out of the Indigenous Peoples in Evaluation community. Sessions with cross-listed Government and Indigenous Peoples in Evaluation themes might include: case studies or findings from evaluations with tribal programs and evaluations commissioned by tribal/local/state governments; information on US federal, state, local, and/or tribal government agencies evaluating programs delivered within First Nation communities; innovative, culturally appropriate methods to evaluate programs with indigenous populations (urban/rural/tribal); indigenous approaches to monitoring and learning in all communities. Once sessions are selected, our TIG will reach out to the Indigenous Peoples in Evaluation TIG to ask for opportunities to cross-list.
If you are interested in proposing a panel or are looking for presenters to collaborate with, the Government Evaluation TIG team can help put you in touch. Please contact us to start the conversation.
The Government Evaluation TIG leaders.
Greetings Government TIG Members,
Thank you for all the support during the 2020 AEA conference! We had a virtual blast! Special thanks to everyone who contributed to our 26 submissions, the 24 reviewers, and all of our presenters.
Thank you to our speaker TIG Business Meeting and Anniversary speaker and long-time TIG member, Rakesh Mohan, Director, Office of Performance Evaluations, Idaho Legislature, who spoke on “Maintaining Evaluator Credibility Amidst Political Divisiveness”
Be sure to check out the AEA365 blog the week of February 14th, 2021, as we will be sponsoring that week!
We need the following positions filled: Co-Chair, Chair Elect, and Engagement Chair*.
- Identifying and coordinating Cross TIG collaboration opportunities, including virtual engagement events and/or sessions Establishing and maintaining
- Coordinating virtual engagement events for TIG members, by identifying and supporting individuals who would like to host TIG engagement sessions
- Supporting the building of a resource repository for TIG website by working with members to share and submit resources such as tools, processes, and research
- Assisting Chair(s) in organizing TIG focused week for AEA 365
- Serving a three-year term
Don’t forget you can still watch our sessions online:
Roundtable: Shining light on
models for evaluation technical
assistance: Efforts to strengthen evaluation capacity
Session Number: 1198
MultiPaper: International and
National Perspectives on
Our new Mission/Vision Statements:
The Government Evaluation Topical Interest Group (TIG) exists to provide a forum for communication of best practices, sharing evaluation findings, mutual support, and professional development for those interested in evaluations completed for the purposes of improving government programs, services, and/or conducting evaluations following governmental policies. The Government Evaluation TIG was launched in 1990 under the leadership of Dr. David Bernstein and considered one of the oldest standing TIGs in AEA history. Our membership includes those individuals who serve in various capacities of government, whether employees or contractors.
The TIG hopes to improve the state of evaluation done by and for governments by being a resource for all government evaluators while also providing venues to share experiences and learn from each other.
Acting on the recommendation from AEA’s Evaluation Policy Task Force, the AEA presidential rotation endorsed this recommendation and added AEA as a signatory Attached is the School Pulse Survey Letter
*** Participant Recruitment: Dissertation Study on Story-Based Methodologies ***
My name is Megan Kauffmann, and I am a student from the Research Methods and Statistics Program at the University of Denver. I’m reaching out because I am recruiting participants to participate in a research study for my dissertation. My dissertation is focused on understanding the credibility of using narrative inquiry to examine causal arguments within evaluation. I am seeking participants who have conducted a success case method or most significant change study. Below is the official recruitment email for this study. If you would be willing to forward this email on to individuals in your network who may meet this condition, I would be most grateful! Alternatively, if you prefer to provide me with their contact information, I can follow up directly.
Dear [insert name],
My name is Megan Kauffmann, and I am a student from the Research Methods and Statistics Program at the University of Denver. I’m reaching out to talk to you about participating in my research study. This is a study about understanding the credibility of using narrative inquiry to examine causal arguments within evaluation. You’re eligible to be in this study because you have conducted a [success case method or most significant change] study. I obtained your contact from [the identification source will be listed here].
If you decide to participate in this study, you will participate in two interviews over Zoom videoconference technology or phone. You will also be asked to provide some documentation or artifacts as possible, and perhaps be part of a research observation if possible. Please note that all study activities involving participants will be held remotely and not in person. I would like to audio/video record the interviews so that I may accurately capture your words. The information I collect will be used to help clarify the arguments that evaluators make to justify the use of narrative inquiry in examining causality.
Remember, this is completely voluntary. You can choose to be in the study or not.
If you’d like to participate, or if you have any questions about the study, please e-mail or contact me at email@example.com or 919-274-0863. I would be happy to discuss the details of the study further with you.
Thank you very much.
Faculty Sponsor: Dr. Bruce Uhrmacher, firstname.lastname@example.org, 303-871-2483
Megan Kauffmann, MPP
University of Denver, Research Methods and Statistics, PhD Student, ABD
*** NIH Faculty Institutional Recruitment for Sustainable Transformation (FIRST) Program: FIRST Coordination and Evaluation Center ***
The US National Institutes of Health (NIH) Common Fund’s Faculty Institutional Recruitment for Sustainable Transformation (FIRST) program aims to enhance and maintain cultures of inclusive excellence in the biomedical research community. “Inclusive excellence” refers to cultures that establish and sustain scientific environments that cultivate and benefit from a full range of talent. NIH aims to facilitate institutions in their building a self-reinforcing community of scientists, through recruitment of a critical mass of early-career faculty who have a demonstrated commitment to inclusive excellence. The program also seeks to have a positive impact on faculty development, retention, progression, and eventual promotion, as well as develop inclusive environments that are sustainable.
The NIH Common Fund has issued a funding opportunity announcement (FOA) (https://grants.nih.gov/grants/guide/rfa-files/RFA-RM-20-023.html) that seeks to establish a Coordination and Evaluation Center (CEC) that will be responsible for coordinating and facilitating the development of strategies with FIRST Cohort awardees to conduct a comprehensive evaluation of the FIRST program.
Applications are due on March 1, 2021. (Letters of Intent were due on January 29, 2021, but not required.) Please see the FOA for more information, including eligibility information, application requirements, and NIH points-of-contact for inquiries.
Please feel free to share this with organizations, including companies with evaluation expertise, that might be interested in this work.
*** Society for Benefit-Cost Analysis 2021 Conference ***
The SBCA conference will be held online March 17-19 and March 22-24, 2021. Sessions will be spread throughout the day to facilitate participation across time zones. The program features an exciting mix of research presentations, roundtable discussions, and innovative sessions as well as opportunities for networking. Registration is open.
We are pleased to announce a series of plenaries with leading experts on diverse topics. Examples include the following.
Sustainable Recovery from Covid-19
Phoebe Koundouri, Athens University of Economics and Business
Moderator: Dale Whittington, University of North Carolina
Discussant: Laura Taylor, Georgia Institute of Technology
Policy Choice under Uncertainty, with Application to Vaccination and Climate Policy
Charles Manski, Northwestern University.
Moderator: John Pepper, University of Virginia
Discussants: Emma McIntosh, University of Glascow; Robert Pindyck, Massachusetts Institute of Technology
Systems Analysis, Cost-Effectiveness Analysis, Benefit-Cost Analysis, and Government Decisions
Alain Enthoven, Stanford University
Moderator: Deborah Freund, Claremont Graduate University
Benefit-Cost Analysis and U.S. Policy: The View from the White House
A conversation with Council of Economic Advisers members from the Obama and Bush administrations
Chair: Ann Wolverton, U.S. Environmental Protection Agency
Panelists: Katharine G. Abraham, University of Maryland; Katherine Baicker, University of Chicago; Donald Marron, Urban Institute
The Role of Cost-Benefit Analysis in World Bank and Inter-American Development Bank-funded Projects
Moderator: Richard Damania, The World Bank
Panelists: Tijen Arin, The World Bank; Stephen Hutton, The World Bank; Onil Banerjee, The Inter-American Development Bank; Adrien Vogt-Schilb, The Inter-American Development Bank
To register, please click here.
TIG website: https://comm.eval.org/governmentevaluationtig/home
The Society for Benefit-Cost Analysis will host a webinar on Dec. 15 featuring presentations by state government budget and performance evaluation staff. Here are the details:
Benefit-Cost Analysis in State Government Budget Planning
Date: Tuesday, December 15, 12:00-1:30 ET (Webinar)
This panel will bring speakers from government budget and policy advisory offices from three states routinely using BCA in partnership with the Pew Results First initiative: Illinois, New Mexico, and North Carolina. The panelists, who are senior staff from state government agencies, will share their experiences with conducting and reporting BCA in their jurisdictions. These practitioner-experts will present on themes including: unit cost methodology, communicating findings, and stakeholder relationships. The overarching theme is that BCA reporting is a process not an event. Analysts continuously engage with policy leaders and agency stakeholders to help them understand the method, the goals, and the emerging findings to ensure decision-makers‘ understanding, maintain their interest, address complexity and controversy, and ultimately supply leaders with actionable evidence for policy decisions. States‘ application of BCA supplements efforts to systematically use rigorous research evidence in planning to move away from traditional approaches that had been uninformed.
- Legislatively-Driven Efforts to Advance the Use of Data and Evidence in Budgeting; Jon Courtney and Micaela Fischer, New Mexico Legislative Finance Committee
- Dynamic Marginal Cost and Bridging the Gap Between CBA Theory and Actual Budgeting Practices; Nathaniel Inglis Steinfeld, Illinois Sentencing Policy Advisory Council; Adam Groner, Illinois Governor‘s Office of Management and Budget
- Integrating Benefit Cost-Analysis and Evidence Teams in the Executive Budget Office; Carrie Hollis, North Carolina Office of State Budget and Management
Chair and Discussant: Steven Lize, The Pew Charitable Trusts
The webinar is hosted by the Society for Benefit-Cost Analysis. The Society for Benefit-Cost webinar series features new material and a few presentations originally scheduled for our March 2020 Annual Meeting. These presentations are free to Society members and (with limited exceptions) available to nonmembers for a fee. If you are in a state government agency and would like to attend, please contact Steve Lize at email@example.com about your interest.
Hello Government TIG Members,
AEA is here! Don’t forget to join us for the Business Meeting on Monday, October 26th from 5:30 to 6:30PM (ET).
You can register here: Government Evaluation
Also please join us for our sessions next week as follows.
Oct 28, 2020 (03:00 PM - 03:45 PM)
Roundtable: Shining light on models for evaluation technical assistance: Efforts to strengthen evaluation capacity Session Number: 1198
Oct 29, 2020 (01:00 PM - 01:45 PM)
MultiPaper: International and National Perspectives on Government Evaluation Session Number: 2898
Join us on October 26, 2020 (5:30-6:30 PM Eastern)
Virtual Annual Business Meeting
Government Evaluation TIG
The Virtual AEA Annual Conference is coming up fast!
ACE Evaluation Network
Spring 2020 Call for Qualifications
The Advancing Culturally-responsive and Equitable (ACE) Evaluation Network invites experienced evaluators to join our community of diverse professionals whose mission is to both drive and support the practice of excellent, culturally responsive and equitable evaluation (CREE).
Apply here: https://expandingthebench.org/members/basic-account-form/
Call to Arms Webinar: A Critique of Capitalism, the Elite Class, and Corporate-run Governments for Program Evaluators
|Right now, and in the very near future, program evaluators and evaluation researchers will be asked to explore many questions related to the current coronavirus pandemic. RFPs are already being prepared to study its effects on specific populations and issue areas. We will be responsible for setting the evaluation agenda for years to come. If we harness the full potential of our influence and power, we can help secure a fundamentally different society, one that is firmly rooted in social justice and celebrates the full scope of our humanity and the sacredness of this planet.
While COVID-19 exacerbates the cruelties of our economic and political systems on a global scale, it also creates an environment ripe to continuously critique capitalist values and frameworks in both the programs we aim to understand and our evaluation practice. We ask: How can we work toward the liberation of ourselves and others if we are capitalist evaluators (un)intentionally serving a profit-over-people agenda? What would it look like to investigate unregulated capitalism in your next evaluation or explore data metrics related to the impact of privatization on the people you serve?
More information: https://evaluation.wildapricot.org/event-3808032
This call to arms offers a praxis to discredit failed economic and political ideologies
Call for AEA Board Nominees and AEA Town Hall Meeting
The AEA Nominations and Election’s Working Group is currently seeking nominees for the Board positions of Member-at-Large and President-elect. Procedures for the nominations process are on the AEA webpage.
Prior service to AEA is a qualification for Board nominees, thus we seek your assistance in identifying AEA members who have been active and engaged contributors to your TIG. Beyond the TIG, you may well know other AEA members who have been active in the association and who may be interested in serving on the Board. As you think of potential nominees, please contact them yourself to assess their interest in being nominated or send the names to Anne Vo and the Nominations & Elections Working Group will make the contact.
If you have been contemplating running for the Board, we strongly encourage you to nominate yourself. Most Board nominations are self-nominations.
Current and past board members have found being a Board member a highly rewarding professional experience. As a former Board member commented:
"The most rewarding activity for me is meeting and working with highly dedicated and talented people/leaders who have a common goal of building the capacity of evaluators around the world to better society though meaningful and useful evaluation."
The deadline for all nominations is Friday, May 1, 2020 at 11:59 PM ET.
AEA Town Hall
AEA Leadership: Time for Nominations
Thursday, April 23, 2020 2:00 PM ET
In an effort to encourage broad engagement in AEA leadership, your AEA staff and current leadership team are holding a Town Hall. We will be spotlighting the Nominations process and have representation from the Nominations Working Group to support the conversation. We are excited to launch into our 2020 nominations and elections processes and invite anyone who is interested to join us! This is the space to learn and ask questions. No previous leadership experience in AEA is necessary. Register here.
Thank you for your consideration.
Anne Vo, Chair
On behalf of the 2020 Nominations & Elections Working Group
Watch Free Evaluation 2019 Presidential Sessions
AEA made several of the videos from Eval 2019 free to members:
Message from AEA: Now more than ever, it is important to share lessons and guidance with one another as we navigate the current times together.
We are offering AEA members free access to the Presidential Strand sessions and Plenary sessions from Evaluation 2019. Share the recordings with your teams, students, or colleagues while many of us adjust to our new working environment.
You can view all Presidential Strand sessions and Plenary presentations from Evaluation 2019 – focused on the role of evaluators in shaping the future of the evaluation profession.
Evaluation 2019 Presidential Strand Sessions | AEA
The 2019 Presidential Strand presentations will feature in-depth education sessions that focus on this year’s theme: Paths to the Future...
NEWS - last updated February, 2020
Session Proposals for Evaluation 2020 in Portland, OR are now open!
Submit your proposal here: https://www.eval.org/p/cm/ld/fid=771
The deadline for session proposals is 11:59 PM ET March 18, 2020.
Evaluation 2020 will be held from October 26 - October 31. The theme for this year's conference is How Will You Shine Your Light? In your proposal, consider how your session will illuminate new perspectives, practices, and methodological approaches for attendees.
PROFESSIONAL DEVELOPMENT OPPORTUNITY - last updated February 15, 2020
Extend your learning in benefit-cost analysis, regulatory impact analysis, and communicating research evidence at workshops scheduled with the Society for Benefit-Cost Analysis, 12th Annual Conference & Meeting March 18 in Washington, DC. Details here: https://benefitcostanalysis.org/2020-post-conference-professional-development-workshops
- Deregulatory Benefit-Cost Analysis Organized By Jennifer Baxter, Industrial Economics with Bethany Davis Knoll, New York University School of Law; Libby Ashley, U.S. Office of Management and Budget; Jerry Ellig, The George Washington University Regulatory Studies Center; Amber Jessup, U.S. Department of Health and Human Services
- Benefit-Cost Analysis for Beginners Organized by Glenn Blomquist, University of Kentucky with David Weimer, University of Wisconsin-Madison
- Introduction to Benefit-Cost Analysis for Regulatory Impact Analysis Organized by Charles Griffiths, U.S EPA, with Chris Dockins, U.S. Environmental Protection Agency; Aliya Sassi, U.S. Food and Drug Administration
- Addressing Uncertainty and Non-Quantified Effects in Benefit-Cost Analysis Organized By Jennifer Baxter, Industrial Economics, with Victoria Greenfield, RAND Corporation; Aylin Sertkaya, Eastern Research Group; David Weimer, University of Wisconsin-Madison
- A Voice Crying in the Wilderness? Techniques for Promoting the Use of Evidence and BCA Results to Policymakers Organized by Steve Lize, The Pew Charitable Trusts, with Gary VanLandingham, Florida State University, and John Kamensky, IBM Center for Business of Government
- Valuing Changes in Health and Longevity Organized by Lisa Robinson, Harvard T.H. Chan School of Public Health