Category: The New Statistics

Replication: ‘Psychological Science’ does the right thing

I have been enjoying Bob’s series of posts about replication. (Go to our home page and scroll down to see links and a few lines of text about each of the 5 posts, with title starting ‘Adventures in Replication’.) Actually,

Posted in Open Science, Replication, The New Statistics

Adventures in Replication – Reviewers don’t want to believe disappointing replication results

Trying to publish replication results is difficult.  Even when the original evidence is very weak or uncertain, reviewers tend to look for reasons to explain away a smaller effect in the replication.  If nothing comes to mind, reviewers may even

Posted in NHST, Replication, The New Statistics

Beyond p values – Dispatches from the ASA symposium on statistical inference

The next couple of posts will be about my experience at the ASA conference on statistical inference: A World Beyond p < .05. The first session featured Steve Goodman and John Ioannidis (who Skyped in from Australia).  One highlight was

Posted in NHST, Teaching, The New Statistics

Adventures in Replication: p values and Illusions of Incompatibility

Here’s an idea I run into a lot in peer reviews of replication studies: If the original study found p < .05 but the replication found p > .05, then the results are incompatible and additional research is needed to

Posted in ITNS, NHST, Replication, Statistical graphics, The New Statistics

Adventures in Replication: Your replication appears to be somewhat underpowered

Many journals now proclaim their openness to replication research.  Behind the scenes, though, replication manuscripts are often met with impossible demands and/or insane double-standards. Here’s an example from an editor at a prominent social psychology journal: the studies appear to

Posted in Replication, The New Statistics

To what extent do new statistical guidelines change statistical practice?

In 2012 the Psychonomic Society (PS) adopted a set of forward-thinking guidelines for the use of statistics in its journals . The guidelines stressed the use of a priori sample-size planning, the reporting of effect sizes, and the use of confidence intervals

Posted in Open Science, Stats tools, The New Statistics

From NHST to the New Statistics — How do we get there?

APS just wrapped up.  Geoff and I were privileges to help host a symposium on making progress moving the field away from p values towards the New Statistics.  Our co-conspirators were fellow text-book author Susan Nolan, Psychological Science editor Stephen

Posted in NHST, Open Science, Teaching, The New Statistics

from the APS Convention in Boston

Bob and I are in Boston this weekend for the annual APS Convention. It’s great to catch up, and discuss a million things about ITNS and this blog, and our future plans. Our publisher told us yesterday that early signs

Posted in ITNS, Open Science, Teaching, The New Statistics

The persistence of NHST: “Wilfully stupid”?

I recently gave a research talk to Psychology at La Trobe, my old University–although I now live an hour out of the city and rarely visit the campus. I decided to turn things around from my previous few talks: Instead

Posted in NHST, Replication, The New Statistics

Significance Roulette 2

In my post of a couple of days ago I gave the link to Significance Roulette 1, a video that explains how to generate the roulette wheel for a ‘typical experiment’, by which I meant an independent groups experiment, N = 32

Posted in ITNS, NHST, Replication, The New Statistics