I'll be teaching a two-hour session tomorrow July 11th for the MethodsFest in Exeter. The title and description of my session are updated as below:
Research Data as Feedback to Improve Research Design and Data Analysis
Dr ZhiMin Xiao, Exeter University
Using research data from some of the most rigorous Randomised Controlled Trials in social science and medicine, this two-hour session first looks at some common practices in trial data analysis. It then examines some unintended consequences those practices have had on what we call evidence. Finally, we, as a group, reflect on our own research practices and ask if and how established approaches in our own specific disciplines might “blind” us under certain circumstances and what we should do in order to mitigate any negative impact of what Andrew Gelman called “the Science of Default”. Throughout the session, we will use real-world research datasets that are publicly available to demonstrate if and how research findings can be sensitive to analytical choices and show that embracing some principles of statistical learning can help us avoid the vicious feedback loop we sometimes see in research practices.