full bios for TIG leaders

The Research, Technology and Development (RTD) Evaluation Topical Interest Group (TIG) within the American Evaluation Association has as its mission to advance the field of performance measurement and in-depth assessment of programs, particularly publicly funded RTD programs. 

We provide a forum for the exchange of ideas, good practice, and emerging tools by:

• organizing the RTD portion of the AEA conference each year
• collecting and disseminating information related to good practice, as well as events of interest, and gray literature

Announcements

April and May webinars!

Analysis of the National Cancer Institute’s Pathway to Independence (K99/R00) Award

April 24^th from 12:00 pm to 1 pm US Eastern

The National Cancer Institute (NCI) K99/R00 award is intended to help postdoctoral scholars transition in a timely manner to research independence and to foster their development of an impactful cancer research program that is competitive for subsequent independent funding.  We analyzed factors that impact peer review outcomes and evaluated whether NCI K99/R00 awardees have achieved the goals of the K99/R00 funding mechanism. Our analysis shows the NCI K99/R00 award facilitated the successful transition of postdoctoral scholars to research independence and enhanced the likelihood of K99/R00 awardees to secure subsequent R01-equivalent NIH grant support although not in an accelerated fashion as originally intended. An NCI K99/R00 award was not determined to be a prerequisite to obtain a faculty position, but for some awardees it was an asset in that transition.  Our results suggest that the NCI K99/R00 award is an important component for training and retention of the next generation of independent cancer researchers and to increasing the percentage of women and promoting the diversity of the cancer research workforce. There are additional lessons learned from this type of analysis. The work was performed in collaboration with The Center for Research Strategy, and Digital Science, Inc. A large portion of its importance is due to this collaboration which promotes fair and unbiased collection and analysis of the data. This type of analysis also shows us that our data can be used to provide answers to a large breadth of research questions, not just those which were the original focus of our study. The same data can be used for different interpretations based on the questions asked and the needs of the researchers and audience.

Corinne Boulanger-Espeut PhD, MBA, is a Health Science Administrator/Program Director in the Cancer Training Branch (CTB) in the NCI’s Center for Cancer Training (CCT).  Dr. Boulanger-Espeut is responsible for managing a grants portfolio of training and career development awards.  She has a strong affinity for training, mentoring and teaching, and is excited to work with the next generation of cancer researchers. Before joining CBT, Dr. Boulanger-Espeut had a long career in intramural science at the NIH.  During her time in the laboratory, Dr. Boulanger-Espeut co-authored numerous papers, spoke at many national meetings, and trained many students and post-doctoral fellows. She has also taught graduate courses for many years in biosecurity and biotechnology. 

Evaluating Benefits from Publicly Funded Research using Patent-Data: Applications, Benefits, & Misuse

May 15^th from 12:00 pm to 1 pm US Eastern

How does the public benefit from public investment in research and development?  While there is broad agreement that new technologies have significant social and economic impact, tracing technologies back to federally funded research is challenging. To measure benefits, funding agencies, the national labs, and others often look to patent data. Recently, economists and legal scholars have raised questions about conventional measures (including simple patent counts and patent citations) linking public R&D to patents, and linking patents to social outcomes. Bhaven Sampat will review these concerns, and also describe and assess several new advances in patent bibliometrics that aim to overcome them.

Bhaven N. Sampat is an economist by training, and a Professor in Arizona State University’s (ASU’s) School for the Future of Innovation in Society and School of Public Affairs, and Research Associate at the National Bureau of Economic Research (NBER).  He is a founding member of NBER’s Innovation Information Initiative (I3), a data collaborative for open innovation data and related analytics, tools, & metrics (https://iii.pubpub.org/).

Submit to the 2024 AEA Annual Conference!

We invite you to submit an abstract for RTD TIG program at the 2024 AEA Annual Conference. The conference will be held in Portland, OR, October 21-26. Submissions are due at 11:59 pm eastern time on March 22, 2024: https://www.eval.org/Events/Evaluation-Conference/Conference-Theme. 
 
*Please note there is a new process for submitting abstracts this year.* To have your abstract reviewed by the RTD TIG follow these steps:

1. First, select the *Stream*: 'Government and Public Policy'
2. Only after that will the *Topical Interest Groups *appear. Select *'*Research, Technology, and Development Evaluation' TIG. 

Eval2024 Pre-Conference Planning

For Eval2024 (Oct 21-26, 2024) in Portland, Oregon, the RTD TIG wants to re-establish a half-day pre-conference to allow more time to learn from one another. If you are based in the Portland area and/or are interested in serving as a TIG ambassador, or more generally in helping to program this pre-conference, please let the TIG leaders know. Watch this space for more information as the program develops.

RTD TIG Webinar Series

May Webinar

Evaluating Benefits from Publicly Funded Research using Patent-Data: Applications, Benefits, & Misuse

How does the public benefit from public investment in research and development?  While there is broad agreement that new technologies have significant social and economic impact, tracing technologies back to federally funded research is challenging. To measure benefits, funding agencies, the national labs, and others often look to patent data. Recently, economists and legal scholars have raised questions about conventional measures (including simple patent counts and patent citations) linking public R&D to patents, and linking patents to social outcomes. Bhaven Sampat will review these concerns, and also describe and assess several new advances in patent bibliometrics that aim to overcome them.

 Bhaven N. Sampat is an economist by training, and a Professor in Arizona State University’s (ASU’s) School for the Future of Innovation in Society and School of Public Affairs, and Research Associate at the National Bureau of Economic Research (NBER).  He is a founding member of NBER’s Innovation Information Initiative (I3), a data collaborative for open innovation data and related analytics, tools, & metrics (https://iii.pubpub.org/).

March Webinar

“Lessons Learned from RTI’s Evaluation Support for NIH’s Translational & Commercialization Programs.”

Wednesday, March 13^th at 12pm US Eastern

The webinar will feature Dr. Kathleen Rousche and Dr. Julia Berzhanskaya from the US NIH’s National Heart, Lung and Blood Institute (NHLBI) Innovation and Commercialization Office (I&C) and Dr. Lena Leonchuk of RTI International, a long-standing NIH/NHLBI evaluator. The speakers will share information on how NIH and NHLBI have incorporated evaluation methods into their program planning, measurement development, and decision-making, and discuss an example of the Update Tracker commercialization outcomes monitoring system for the NIH Research Evaluation and Commercialization Hubs (REACH) and its predecessor, the NIH Centers for Accelerated Innovation (NCAI), supported by the NIH Small business Education and Entrepreneurial Development (SEED). 

Please join us at this link: https://rtiorg.zoom.us/j/93787277690?pwd=MDduc3FFRHAzTy94RmlmNDlSOFE5QT09&from=addon

The presentation will be recorded and posted on our Youtube channel here.

February Webinar

The RTD TIG hosted on Monday, February 12, a webinar that consisted of a series of lightning talks.

• The Promise and Perils of Data Linkage by Andrew Miklos (NIGMS/NIH)

• AI and Evaluation by Madeleine F. Wallace (Windrose Vision)

• Predictive Data in Evaluations by B. Ian Hutchins (University of Wisconsin)

• Simulation in Evaluations by Anand Desai (Clarivate), Cynthia Phillips (Decision Catalyst, LLC), and Lisa Gajary (Caspian Strategy and Analytics, LLC)

• Evaluations of Research Infrastructure/Instrumentation by Jeff Alexander (RTI) and Josh Schnell (RTI) 

You can view the recording of this and previous webinars at the following link: 
https://www.youtube.com/channel/UCNZXXFRu6KHyIs_r2HWBZtQ. Additional information on future webinars will be forthcoming at our TIG business meeting and in future announcements.

------

The RTD TIG membership held its 2023 business meeting earlier last week, with a recap of TIG activities from this year, including Eval 2023 in Indianapolis, and re-electing the current officers for 2023/2024. Thanks to all Eval 2023 presenters and participants and to our proposal reviewers for making Eval 2023 another great conference. Congratulations to our 2023/2024 officers:

• TIG Co-Chairs: Robin Wagner and Josh Schnell
• TIG Program Co-chairs: Didi Cross and Gavin Reddick
• TIG Leadership Member-at-Large representative: Paula Fearon

Program Input Sought

As we are committed to providing the RTD TIG community with engaging and educational programming, we are seeking your input via a very short survey here. Please fill this out right away to have your input included in our planning for the year.

RTD TIG Webinar Continues

To expand our engagement beyond the annual conference, the TIG hosts webinars on relevant RTD topics and posts them on a Youtube channel here. Our next session will be on November 13th, 12pm US Eastern. Josh Schnell will host a discussion of recent developments, such as new conceptual models (e.g. convergence research) and evaluation of ARPA funding models. Another goal of this session is to hear from RTD TIG community members about issues/topics they are interested in that can be incorporated into a) the 2024 annual meeting call for proposals, b) the program of the proposed 2024 pre-conference meeting, and c) the monthly webinar series.

https://rtiorg.zoom.us/j/99736280248?pwd=dkZNdFl6cXJSY1pLNjBsenIyMUgyUT09

Meeting ID: 997 3628 0248
Password: 339771
Find your local number: https://rtiorg.zoom.us/u/aJmfYHu9R

Other TIG Resources

RTD Topical Interest Group (TIG) Paper, February 2015

Evaluating Outcomes of Publicly Funded Research, Technology and Development Programs: Recommendations for Improving Current Practice (FINAL)

White paper SUMMARY slides

Generic Logic Models, collection over time

Join the RTD TIG - All AEA members can join the RTD TIG as one of the five TIGs available to them (and non-AEA members can join AEA to become part of this engaged community of practice).

Serve as our Communications Chair - We are looking for someone to help to engage our members via sporadic emails and by maintaining our website. 

Contribute to the e-Resources - You may upload documents to the RTD TIG e-library, or request the webmaster upload documents by using the "Contact Us" button below. 


Visit with members of the RTD TIG during the annual meeting by attending conference sessions and TIG social events.