Tag Archives: reproducibility

Why most published findings are false: the effect of p-hacking

In our previous post, we revisited the Ioannidis argument on Why most published research findings are false. Other factors such as p-hacking can also increase the chance of reporting a false-positive result. Such results are associated with a p-value deemed to be statistically significant, but the underlying hypothesis is in fact false. Researcher degrees of freedom As scientists, we have

Read more

Why most published findings are false: revisiting the Ioannidis argument

It has been more than a decade that Ioannidis published his paper entiled Why most published research findings are false. Forstmeier et al. (2016) recently revisited the Ioannidis argument, and I thought it worthwhile to prepare a blog post on the topic to cement my understanding. Looking for a novel effect Let’s consider 1000 hypotheses we might want to test.

Read more

The Conversation: Seven deadly sins of statistical misintepretation, and how to avoid them

The Conversation recently published a nice piece by Louis and Chapman on common statistical misinterpretations and how they can be avoided. Here is summary of the main points: Problem Reason Solution 1. Assuming small differences are meaningful Most small differences are due to chance, not meaningful differences Ask for the margin of error (ie. half of the 95% CI): if

Read more

Sharing computer code and programs in neuroscience

Many areas of neuroscience require computational techniques to process or analyse data. Some journals including the Nature family of journals and BioMed Central are encouraging investigators to share computer code and programs to improve scientific reproducibility, but these practices are not always adopted. For complex projects with multiple collaborators, it may be unclear what or how much can be shared.

Read more

Scientific computing is important but mastering the skills takes time

Scientifically Sound was born out of the need to provide an online resource to conduct science that is reproducible and valid. This resource is in recognition of the fact that learning the digital skills to manage and analyse data reliably takes time and can be daunting. These concerns were echoed in the recent Nature article Scientific computing: Code alert. It

Read more
« Older Entries