Category: ITNS

Adventures in Replication: p values and Illusions of Incompatibility

Here’s an idea I run into a lot in peer reviews of replication studies: If the original study found p < .05 but the replication found p > .05, then the results are incompatible and additional research is needed to

Posted in ITNS, NHST, Replication, Statistical graphics, The New Statistics

The joy of many disciplines

One of the great things about working in psychology, or statistics, or–just imagine!– both, is that you can get to play in the backyards of many other folks. As science becomes more and more fragmented, and many researchers feel that

Posted in ITNS, Teaching

Pictures of uncertainty: Dancing with Pierre in Paris

A while back I wrote a post about Pierre Dragicevic, an HCI researcher in Paris who for years has been working to persuade researchers in his field to adopt better statistical methods. I wrote about his wonderful talk that presents

Posted in ITNS, Open Science, Replication, Statistical graphics, Teaching

Danny Kahneman: From p values to Nobel Prize

You meet a red-headed person who is a bit short-tempered then, later, another who is similarly touchy. You start to believe that red hair signals ‘watch out’. Really? You are leaping to a conclusion from an extremely small sample! But

Posted in ITNS, NHST, Replication

from the APS Convention in Boston

Bob and I are in Boston this weekend for the annual APS Convention. It’s great to catch up, and discuss a million things about ITNS and this blog, and our future plans. Our publisher told us yesterday that early signs

Posted in ITNS, Open Science, Teaching, The New Statistics

Significance Roulette 2

In my post of a couple of days ago I gave the link to Significance Roulette 1, a video that explains how to generate the roulette wheel for a ‘typical experiment’, by which I meant an independent groups experiment, N = 32

Posted in ITNS, NHST, Replication, The New Statistics

Significance Roulette 1

If you run an experiment, obtain p = .05, then repeat the experiment–exactly the same but with a new sample–what p value are you likely to get? The answer, surprisingly, is just about any value! In other words, the sampling

Posted in ITNS, NHST, Replication, The New Statistics

Today’s mystery word: Apophenia

I (Geoff) learned a new word today: Apophenia  It was in an article about investing and the stock-market. Apparently, there’s a whole industry devoted to identifying patterns in the price movements of stocks, then using these to guide when to

Posted in ITNS, Statistical graphics

The New Statistics seems OK to use with the Psychology Major Field Test

“If my department switches to the new statistics, will this tank our majors’ scores on the Major Field Test, which our administration uses as an important assessment tool?” This was one of the first questions asked during a workshop Craig

Posted in ITNS, NHST

The first review

The first review of ITNS on Amazon: If you are reading ITNS, you too may care to post a review? Geoff    

Posted in ITNS, Open Science, The New Statistics