Category: Open Science

Red, Romance, and Replication

I have a new replication paper out today, a collaboration with DU student Elle Lehmann (Lehmann & Calin-Jageman, 2017) .  The OSF page for the paper with all the materials and data is here: https://osf.io/j3fyq/ (Calin-Jageman & Lehmann, 2015) The

Posted in Open Science, Replication

“The best conference…”: More about SIPS

Here’s more about the recent SIPS Conference, from my colleague Fiona Fidler who was clever enough to be there. (Some background: Fiona, of The University of Melbourne, is among other things a psychologist, ecologist, and historian of science. Her PhD

Posted in Open Science

Today’s news from SIPS: Getting better…

A while ago I wrote about SIPS. Today came an email following the second SIPS meeting, a couple of weeks ago at COS in Charlottesville, VA. Below is some of the email: “We had an invigorating conference, and are humbled

Posted in Open Science

Open Science is not all the same: What archaeology can teach us

There’s no simple dot point way to adopt Open Science and improve the trustworthiness of science. A fascinating story from archaeology illustrates that reality nicely. First, the story. Archaeologists have long studied when the out-of-Africa spreading of modern humans first

Posted in Applied research, Open Science

Pictures of uncertainty: Dancing with Pierre in Paris

A while back I wrote a post about Pierre Dragicevic, an HCI researcher in Paris who for years has been working to persuade researchers in his field to adopt better statistical methods. I wrote about his wonderful talk that presents

Posted in ITNS, Open Science, Replication, Statistical graphics, Teaching

To what extent do new statistical guidelines change statistical practice?

In 2012 the Psychonomic Society (PS) adopted a set of forward-thinking guidelines for the use of statistics in its journals . The guidelines stressed the use of a priori sample-size planning, the reporting of effect sizes, and the use of confidence intervals

Posted in Open Science, Stats tools, The New Statistics

From NHST to the New Statistics — How do we get there?

APS just wrapped up.  Geoff and I were privileges to help host a symposium on making progress moving the field away from p values towards the New Statistics.  Our co-conspirators were fellow text-book author Susan Nolan, Psychological Science editor Stephen

Posted in NHST, Open Science, Teaching, The New Statistics

Getting the whole story: journals could be more encouraging

Even though replication is a cornerstone of the scientific method, psychology journals rarely publish direct replications (though that situation may be changing).  Why not?  Is it self-censorship, with authors not bothering to conduct or submit such studies?  Or is it

Posted in Open Science, Replication

from the APS Convention in Boston

Bob and I are in Boston this weekend for the annual APS Convention. It’s great to catch up, and discuss a million things about ITNS and this blog, and our future plans. Our publisher told us yesterday that early signs

Posted in ITNS, Open Science, Teaching, The New Statistics

Confirmatory Research – A special issue of JESP

Catching up a bit, but in November of 2016 the Journal of Experimental Social Psychology published a special issue dedicated just to confirmatory research.  http://www.sciencedirect.com.proxy.cc.uic.edu/science/journal/00221031/67/supp/C The whole issue is well-worth reading: There is  an excellent guide to pre-registration (ostensibly for

Posted in Open Science, Replication