Category: Replication

Red, Romance, and Replication

I have a new replication paper out today, a collaboration with DU student Elle Lehmann (Lehmann & Calin-Jageman, 2017) .  The OSF page for the paper with all the materials and data is here: https://osf.io/j3fyq/ (Calin-Jageman & Lehmann, 2015) The

Posted in Open Science, Replication

Pictures of uncertainty: Dancing with Pierre in Paris

A while back I wrote a post about Pierre Dragicevic, an HCI researcher in Paris who for years has been working to persuade researchers in his field to adopt better statistical methods. I wrote about his wonderful talk that presents

Posted in ITNS, Open Science, Replication, Statistical graphics, Teaching

Danny Kahneman: From p values to Nobel Prize

You meet a red-headed person who is a bit short-tempered then, later, another who is similarly touchy. You start to believe that red hair signals ‘watch out’. Really? You are leaping to a conclusion from an extremely small sample! But

Posted in ITNS, NHST, Replication

Getting the whole story: journals could be more encouraging

Even though replication is a cornerstone of the scientific method, psychology journals rarely publish direct replications (though that situation may be changing).  Why not?  Is it self-censorship, with authors not bothering to conduct or submit such studies?  Or is it

Posted in Open Science, Replication

Confirmatory Research – A special issue of JESP

Catching up a bit, but in November of 2016 the Journal of Experimental Social Psychology published a special issue dedicated just to confirmatory research.  http://www.sciencedirect.com.proxy.cc.uic.edu/science/journal/00221031/67/supp/C The whole issue is well-worth reading: There is  an excellent guide to pre-registration (ostensibly for

Posted in Open Science, Replication

A cool new journal is Open

APS (The Association for Psychological Science) recently launched its sixth journal: Advances in Methods and Practices in Psychological Science. A dreadful mouthful of a title–why not drop ‘Advances in’ for a start–but it looks highly promising. Maybe it will become

Posted in Open Science, Replication

Methodological awakening: backlash against the backlash

Science has had some rough times lately, no doubt.  No need to rehearse the many findings indicating that we have some problems that need a fixing.  As Will Gervais put it, we’re in the midst of a “methodological awakening”.  The

Posted in Open Science, Replication

Replication problems are not competence problems

Why do some replication studies fail to produce the expected results?  There are lots of possible reasons: the expectation might have been poorly founded, the replication study could have been under-powered, there could be some unknown moderator, etc.  Sure, but

Posted in Replication

The persistence of NHST: “Wilfully stupid”?

I recently gave a research talk to Psychology at La Trobe, my old University–although I now live an hour out of the city and rarely visit the campus. I decided to turn things around from my previous few talks: Instead

Posted in NHST, Replication, The New Statistics

Castles made of sand in the land of cancer research

Not all problems with scientific practice are statistical.  Sometimes, methods and protocols are introduced and accepted without sufficient vetting and quality control.  Hopefully this is rare, but in the biological sciences there is an ongoing worry that too many ‘accepted’

Posted in Replication