Home

Welcome to the Design & Analysis of Experiments TIG

The purpose of the Design & Analysis of Experiments TIG is to provide an active forum for AEA members who specialize in or have special interest in experimental evaluation research to connect and advance the methods and practice of this segment of the evaluation field.  Evaluations that use an experimental design (with randomization of treatment and control units) are distinctive and involve their own methods, practices and analyses, as well as many that connect to other TIGs’ foci.  We hope to engage members from other relevant TIGs in order to have cross-fertilizing discussions. 

 

Specific areas of scholarly discussion for this TIG include:

·      integrating randomization into program operations

·      how to analyze experimental data (ITT, ATE, TOT, LATE, CACE, moderator effects)

·      design strategies for getting inside the black box

·      analytic strategies for getting inside the black box

·      opportunities to explore mediation with experimental data

·      power analyses/considerations (e.g., re: differential effects, in clustered-designs)

·      opportunities/challenges from multi-site experiments (when pooling is/is not justified; ICCs and power implications; extending multi-level modeling to experimental data)

·      within study comparisons (under what conditions do varied quasi-experiments reproduce experiments’ results)

·      handling missing data and attrition (when differential T-C attrition is a fierce enemy)

·      the external validity of experimentally-designed evaluations

·      low cost experiments

 

Consider becoming active in the TIG in order to shape its future and contribute to our field.

 

What We're Talking About

The DAE TIG hosted two week’s-worth of postings to the AEA 365 blog (http://aea365.org/blog/): one week focused on hot topics in experimental evaluation research (see here: http://aea365.org/blog/experiments-tig-week-allan-porowski-on-how-to-make-your-chances-of-conducting-a-successful-rct-seem-a-little-lessrandom/); and the other focused on common objections to experiments and why we should not be so concerned (see here: http://aea365.org/blog/experiments-tig-week-the-ethics-of-using-experimental-evaluations-in-the-field-by-laura-peck-and-steve-bell/). If you're interested in curating a week, please contact the TIG's leadership. 

 ​​

About the Leadership

Chair (2021), Stephen Bell, Westat
Outgoing Chair, Ben Kelcey, University of Cincinnati 
Incoming Chair, M.H. Clark, University of Central Florida
Program Chair (2021), Dustin Anderson, Western Michigan University