Category: Replication

The TAS Articles: Geoff’s Take

Judging Replicability: Fiona’s repliCATS Project

Judging Replicability Whenever we read a research article we almost certainly form a judgment of its believability. To what extent is it plausible? To what extent could it be replicated? What are the chances that the findings are true? What

Moving to a World Beyond “p < 0.05”

The 43 articles in The American Statistician discussing what researchers should do in a “post p<.05” world are now online. See here for a list of them all, with links to each article. The collection starts with an editorial: Go

Joining the fractious debate over how to do science best

At the end of the month (March 2019) the American Statistical Association will publish a special issue on statistical inference “after p values”. The goal of the issue is to focus on the statistical “dos” rather than statistical “don’ts”. Across

Sizing up behavioral neuroscience – a meta-analysis of the fear-conditioning literature

Inadequate sample sizes are kryptonite to good science–they produce waste, spurious results, and inflated effect sizes.  Doing science with an inadequate sample is worse than doing nothing.  In the neurosciences, large-scale surveys of the literature show that inadequate sample sizes

Internal Meta-Analysis: The Latest

I recently wrote in favour of internal meta-analysis, which refers to m-a that integrates evidence from two or more studies on more-or-less the same question, all coming from the same lab and perhaps reported in a single article. The post

Abandon Statistical Significance!

That’s the title of a paper accepted for publication in The American Statistician. (I confess that I added the “!”) The paper is here. Scroll down below to see the abstract. The paper boasts an interdisciplinary team of authors, including

Open Science DownUnder: Simine Comes to Town

A week or two ago Simine Vazire was in town. Fiona Fidler organised a great Open Science jamboree to celebrate. The program is here and a few of the sets of slides are here. Simine on the credibility revolution First

Cabbage? Open Science and cardiothoracic surgery

“The best thing about being a statistician is that you get to play in everyone’s backyard.” –a well-known quote from John Tukey. Cabbage? That’s CABG–see below. A week or so ago Lindy and I spent a very enjoyable 5 days

Internal Meta-Analysis: Useful or Disastrous?

A recent powerful blog post (see below) against internal meta-analysis prompts me to ask the question above. (Actually, Steve Lindsay prompted me to write this post; thanks Steve.) In ITNS we say, on p. 243: “To carry out a meta-analysis