~AEA Public Library

Back to Library

AEA 2016 RTD Session 1770: Using the Law of Unintended Consequences to Promote Desired Behavior: How Can Evaluation Metrics Influence Research Data Sharing? 

11-16-2016 12:52

As evaluators, we often fear changing the behavior of the participants of the program we are evaluating by putting metrics around their activities. An example is the use of publications in measuring the "success" of an investigator and influencing tenure decisions and the skyrocketing number of articles published each year. But what if instead we actually wanted to change the behavior of a participant? Can developing and implementing meaningful metrics be used to influence behavior? What are the risks in intentionally trying to influence participant behavior? Are there ways to do this thoughtfully in order to achieve our desired outcome? This session will explore these questions in the realm of research data sharing, from the perspective of programs with a primary goal of data sharing; evaluation professionals who must determine how to best assess data sharing; and program managers who would like to encourage data sharing.

#Eval2016 #2016Conference

Statistics
0 Favorited
7 Views
5 Files
0 Shares
91 Downloads

Related Entries and Links

No Related Resource entered.

Tags and Keywords

​
Attachment(s)
Download All
pptx file
#IAmAResearchParasite   417 KB   1 version
Uploaded - 11-16-2016
The concept of research data sharing is not a new issue, yet it has come under increasing scrutiny with the President's Precision Medicine Initiative and the Vice President's Cancer Initiative, which specifically calls out the need to "break down silos." In the research world, a controversy exploded in a prestigious scientific journal when the editors referenced "research parasites" in the context of sharing research data. It is clear that the drivers are in the direction of research data sharing, but there is a cultural shift that must occur. This presentation will explore how we as evaluators might influence data sharing and engage the audience in dialogue around questions such as: • Can developing and implementing meaningful metrics be used to influence behavior around research data sharing? • What are the risks in intentionally trying to influence participant behavior? • Are there ways to do this thoughtfully in order to achieve our desired outcome?
 
Download
pptx file
Preliminary Overview of Data Sharing Practices Across NCI...   444 KB   1 version
Uploaded - 11-16-2016
The National Cancer Institute (NCI)’s Division of Cancer Control and Population Science asked the Science and Technology Policy Institute (STPI) to design and implement an evaluation of the epidemiology data sharing practices developed by Principal Investigators in the NCI Epidemiology and Genomics Research Program (EGRP). STPI defined data sharing as the dissemination of raw data, analysis code, and collected specimens through publications, databases, repositories, and personal communication and established study questions, developed criteria for cohort selection, and interviewed key staff for selected EGRP cohorts. STPI performed a detailed analysis of the scope, breadth, availability, and, to the extent possible, costs associated with epidemiology data sharing, and the ease with which these data can be collected. The findings demonstrate similarities in data sharing application processes; variability in the type, complexity, quality, and quantity of data; as well as the publication, tracking, and cost recovery processes.
 
Download
pptx file
Understanding the Value of Data Sharing Within Epidemiolo...   879 KB   1 version
Uploaded - 11-16-2016
The National Institutes of Health (NIH) established a policy in 2003 requiring sharing of data from larger grants and recognizing that data sharing is “essential for expedited translation of research results into knowledge, products and procedures to improve human health.” Although sharing of genomic data has been well established with standard resources and policies, the sharing of epidemiologic data and biospecimens is less standardized. These two data collections are key components of funded grants within the National Cancer Institute’s Epidemiology and Genomics Research Program. Through several case studies, we will discuss models of data sharing within cancer epidemiology cohorts, the challenges of and perceived barriers to data sharing, and demonstrate the potential value of data sharing to the research community.
 
Download
pptx file
When Data Sharing is a Primary Goal – the Case of UNAVCO...   699 KB   1 version
Uploaded - 11-16-2016
UNAVCO is a non-profit university-governed consortium, supported by the National Science Foundation and the National Aeronautics and Space Administration. The mission of UNAVCO is to facilitate geoscience research and education using geodesy – the science of accurately measuring and understanding changes in the Earth’s geometric shape, orientation in space, and gravity field. While UNAVCO provides many services, including education, engineering, grant support, and equipment loans, a primary role is to provide primary geodetic data and other data collected by members of the UNAVCO community. The data and data services provided by UNVACO are relied upon by a broad range of industry groups and private groups and individuals above and beyond the geodetic science research community. This presentation will provide an overview of the breadth and depth of the UNAVCO data user community and explore some of the challenges faced by UNAVCO in sharing data and the community that accesses shared data.
 
Download
pptx file
session 1770 introduction   463 KB   1 version
Uploaded - 11-16-2016
session 1770 introduction
 
Download