Inadequate sample sizes are kryptonite to good science–they produce waste, spurious results, and inflated effect sizes. Doing science with an inadequate sample is worse than doing nothing. In the neurosciences, large-scale surveys of the literature show that inadequate sample sizes…
Introduction to the New Statistics
The online community and blog for ITNS
Category: Replication
Internal Meta-Analysis: The Latest
I recently wrote in favour of internal meta-analysis, which refers to m-a that integrates evidence from two or more studies on more-or-less the same question, all coming from the same lab and perhaps reported in a single article. The post…
Abandon Statistical Significance!
That’s the title of a paper accepted for publication in The American Statistician. (I confess that I added the “!”) The paper is here. Scroll down below to see the abstract. The paper boasts an interdisciplinary team of authors, including…
Open Science DownUnder: Simine Comes to Town
A week or two ago Simine Vazire was in town. Fiona Fidler organised a great Open Science jamboree to celebrate. The program is here and a few of the sets of slides are here. Simine on the credibility revolution First…
Cabbage? Open Science and cardiothoracic surgery
“The best thing about being a statistician is that you get to play in everyone’s backyard.” –a well-known quote from John Tukey. Cabbage? That’s CABG–see below. A week or so ago Lindy and I spent a very enjoyable 5 days…
Internal Meta-Analysis: Useful or Disastrous?
A recent powerful blog post (see below) against internal meta-analysis prompts me to ask the question above. (Actually, Steve Lindsay prompted me to write this post; thanks Steve.) In ITNS we say, on p. 243: “To carry out a meta-analysis…
Eating Disorders Research: Open Science and The New Statistics
I’m in Sydney, the great Manly surf beach just over the road. It’s an easy ferry ride to the Opera House and city centre. Lindy and I started this trip up from Melbourne with a few days with a cousin,…
Cochrane: Matthew Page Wins the Prize!
Years ago, Matthew Page was a student in the School of Psychological Science at La Trobe University (in Melbourne), working with Fiona Fidler and me. He somehow (!) became interested in research methods and practices, especially as related to meta-analysis.…
The Perils of MTurk, Part 1: Fuel to the Publication Bias Fire?
It’s not going to be a popular opinion, but I think MTurk has become a danger to sound psychological science. This breaks my heart. MTurk has helped transform my career for the better. Moreover, MTurk participants are amazing: they are…
We’ve Been Here Before: The Replication Crisis over the Pygmalion Effect
[UPDATE: Thanks to twitter I came across this marvelous book(Jussim, 2012) that does a great job explaining the Pygmalion effect, the controversy around it, and the overall state of research on expectancy effects. I’ve amended parts of this post based on…
Studying statistical cognition is essential for improving rigor and reproducibility. You can participate! Here's a link to a short study of statistical cognition: https://t.co/EKAAdbkQUN
This study is being conducted by @lonnibesancon and @jouni_helske .
New Stats blog: Statistical Cognition: An Invitation https://t.co/N3BfOaDR8I
New Stats blog: A Second Edition of ITNS? Here’s the Latest https://t.co/yU0KH4J7F4
Finally had time to check out @russpoldrack on reproducibility in neuroscience:
“First, we must acknowledge that we have a problem, and that all of our careers have benefitted from the research practices that we now realize to be questionable.”
Amen.
https://t.co/psSJUeYYIJ
Thanks, Nick! It was great to visit with the MCB grad students and postdocs. Lots of energy for planning strong research.
Went to a phenomenal seminar about sample-size planning by Bob Calin-Jageman @TheNewStats. I have a LOT of work to do in how to plan experiments and determine relevance (not P values!) of results. He would make a great speaker at any department! Check out https://t.co/U5Ztw630a0
New preprint.
Adversarial team collaborated to specify when facial feedback effects should most reliably emerge. 2 pilots revealed evidence for the facial feedback hypothesis. Next, 18 labs (17 countries) will test whether these findings are replicable.
https://t.co/1XbHDMDkhv
Oh sh-t. Why can't we have nice things?
The study showing handwritten notes are superior to typed notes fails to replicate https://t.co/2RdBOwVh9O
In my first pre-print, working with @lakens we present 2 methods from clinical/health research & show how they can be used in basic psych research to determine the smallest noticeable change/difference & thus the SESOI for research questions interested in noticeable change. 1/2 https://t.co/udPb9UomF1
Top
Recent Comments