Category: Replication

Sizing up behavioral neuroscience – a meta-analysis of the fear-conditioning literature

Inadequate sample sizes are kryptonite to good science–they produce waste, spurious results, and inflated effect sizes.  Doing science with an inadequate sample is worse than doing nothing.  In the neurosciences, large-scale surveys of the literature show that inadequate sample sizes

Internal Meta-Analysis: The Latest

I recently wrote in favour of internal meta-analysis, which refers to m-a that integrates evidence from two or more studies on more-or-less the same question, all coming from the same lab and perhaps reported in a single article. The post

Abandon Statistical Significance!

That’s the title of a paper accepted for publication in The American Statistician. (I confess that I added the “!”) The paper is here. Scroll down below to see the abstract. The paper boasts an interdisciplinary team of authors, including

Open Science DownUnder: Simine Comes to Town

A week or two ago Simine Vazire was in town. Fiona Fidler organised a great Open Science jamboree to celebrate. The program is here and a few of the sets of slides are here. Simine on the credibility revolution First

Cabbage? Open Science and cardiothoracic surgery

“The best thing about being a statistician is that you get to play in everyone’s backyard.” –a well-known quote from John Tukey. Cabbage? That’s CABG–see below. A week or so ago Lindy and I spent a very enjoyable 5 days

Internal Meta-Analysis: Useful or Disastrous?

A recent powerful blog post (see below) against internal meta-analysis prompts me to ask the question above. (Actually, Steve Lindsay prompted me to write this post; thanks Steve.) In ITNS we say, on p. 243: “To carry out a meta-analysis

Eating Disorders Research: Open Science and The New Statistics

I’m in Sydney, the great Manly surf beach just over the road. It’s an easy ferry ride to the Opera House and city centre. Lindy and I started this trip up from Melbourne with a few days with a cousin,

Cochrane: Matthew Page Wins the Prize!

Years ago, Matthew Page was a student in the School of Psychological Science at La Trobe University (in Melbourne), working with Fiona Fidler and me. He somehow (!) became interested in research methods and practices, especially as related to meta-analysis.

The Perils of MTurk, Part 1: Fuel to the Publication Bias Fire?

It’s not going to be a popular opinion, but I think MTurk has become a danger to sound psychological science.  This breaks my heart.  MTurk has helped transform my career for the better.  Moreover, MTurk participants are amazing: they are

We’ve Been Here Before: The Replication Crisis over the Pygmalion Effect

[UPDATE: Thanks to twitter I came across this marvelous book(Jussim, 2012) that does a great job explaining the Pygmalion effect, the controversy around it, and the overall state of research on expectancy effects.  I’ve amended parts of this post based on