Category: Open Science

Replication is the new black, and not only in Psychology: Economics too

There are good folks in many disciplines who are working to encourage Open Science practices. Here’s an example from economics: A website that promotes replication. The Network is run by Bob Reed, at the University of Canterbury in New Zealand

Posted in Open Science, Replication

A conference about–wait for it–the p value! But other things too.

In March 2016 the American Statistical Association (ASA) posted online a policy statement about the p value. You can see it here. This was remarkable–for one thing because it was the first time the ASA had made a public pronouncement

Posted in NHST, Open Science, The New Statistics

COPE – The committee on publication ethics

Here’s a vital organization I learned about through the Sacker colloquium I attended in D.C. in March:  COPE. COPE stands for the Committee on Publication Ethics–it’s mission is to help peer-reviewed journal do right in serving their mission–how to handle

Posted in Open Science, Uncategorized

The Unspin Cycle for Science News

When science is digested into news it often ends up distorted–causal claims can be made about correlational data, hype can prevail over caution, etc.  Research shows that a lot of the fault lies with the researchers–when they summarize their research

Posted in Open Science

Another disappointing replication result, but with as happy an ending as can be…

A few years back, a paper in Science caught the eye of one of my students, Clinton Sanchez.  Clinton brought me the paper in a state of excitement–it showed 4 different experiments in which very subtle nudges meant to foster

Posted in Open Science, Replication, Uncategorized

Sackler Colloquim on Reproducibility – Field Report 1

This week I (Bob) am attending the Sackler Colloquium on Reproducibility in Research.  It’s an event put on by the National Academy of Sciences. For the blog this week I’ll be posting some of my thoughts on the discussion.  Here’s

Posted in Open Science, Replication, Uncategorized

p Hacking: More than you ever wish to know

I recently received an email telling me that an article I had reviewed for a journal had achieved 10,000 views. The astonishing thing was that the email arrived less than 3 weeks after the article had been published online! Believe

Posted in NHST, Open Science

NIH asks journals to make sure we get the whole story

The Open Science credo is “Get the whole story”–we can only evaluate the claims made from scientific data when we know the whole context of how that data was generated.  For example, finding a large effect of a new drug

Posted in Applied research, Open Science

Sample Size Planning – Even when required, not usually done well

In many research fields, sample sizes are too small for the research questions being asked.  In neuroscience, the field I work in, this problem is now very well documented (see Button et al., 2013; Szucs & Ionnidis, 2016). In response

Posted in Open Science

Open Science: Who is paying?

It’s the Open Science fairy story: Brian Nosek was one of a number of young researchers worried that all didn’t seem right in the research world. To what extent was research really producing trustworthy findings? To what extent was it

Posted in Open Science