Category: Replication

The persistence of NHST: “Wilfully stupid”?

I recently gave a research talk to Psychology at La Trobe, my old University–although I now live an hour out of the city and rarely visit the campus. I decided to turn things around from my previous few talks: Instead

Posted in NHST, Replication, The New Statistics

Castles made of sand in the land of cancer research

Not all problems with scientific practice are statistical.  Sometimes, methods and protocols are introduced and accepted without sufficient vetting and quality control.  Hopefully this is rare, but in the biological sciences there is an ongoing worry that too many ‘accepted’

Posted in Replication

p intervals: Replicate and p is likely to be *very* different!

The Significance Roulette videos (here and here) are based on the probability distribution of the p value, in various situations. There’s more to the second video than I mentioned in my recent post about it. The video pictures the distribution of replication

Posted in NHST, Replication

Significance Roulette 2

In my post of a couple of days ago I gave the link to Significance Roulette 1, a video that explains how to generate the roulette wheel for a ‘typical experiment’, by which I meant an independent groups experiment, N = 32

Posted in ITNS, NHST, Replication, The New Statistics

Significance Roulette 1

If you run an experiment, obtain p = .05, then repeat the experiment–exactly the same but with a new sample–what p value are you likely to get? The answer, surprisingly, is just about any value! In other words, the sampling

Posted in ITNS, NHST, Replication, The New Statistics

Replication is the new black, and not only in Psychology: Economics too

There are good folks in many disciplines who are working to encourage Open Science practices. Here’s an example from economics: A website that promotes replication. The Network is run by Bob Reed, at the University of Canterbury in New Zealand

Posted in Open Science, Replication

Another disappointing replication result, but with as happy an ending as can be…

A few years back, a paper in Science caught the eye of one of my students, Clinton Sanchez.  Clinton brought me the paper in a state of excitement–it showed 4 different experiments in which very subtle nudges meant to foster

Posted in Open Science, Replication, Uncategorized

Sackler Colloquim on Reproducibility – Field Report 1

This week I (Bob) am attending the Sackler Colloquium on Reproducibility in Research.  It’s an event put on by the National Academy of Sciences. For the blog this week I’ll be posting some of my thoughts on the discussion.  Here’s

Posted in Open Science, Replication, Uncategorized

RP:P in top ten, twice!

It’s old news but, one year on, it’s still remarkable. Nature and Science are the world’s top two journals. Each year Nature announces it’s list of its top “Ten people who mattered this year” in research. Science lists its top

Posted in Open Science, Replication

Clinical Psychological Science goes Open

Adopting Open Science poses challenges, which vary across fields of research. For example, it may be especially difficult to carry out replications in clinical psychology if participants with the needed clinical diagnosis are hard to find. But Scott Lilienfeld, the

Posted in Open Science, Replication