It’s not going to be a popular opinion, but I think MTurk has become a danger to sound psychological science. This breaks my heart. MTurk has helped transform my career for the better. Moreover, MTurk participants are amazing: they are…
Introduction to the New Statistics
The online community and blog for ITNS
Category: Replication
We’ve Been Here Before: The Replication Crisis over the Pygmalion Effect
[UPDATE: Thanks to twitter I came across this marvelous book(Jussim, 2012) that does a great job explaining the Pygmalion effect, the controversy around it, and the overall state of research on expectancy effects. I’ve amended parts of this post based on…
Measuring Heterogeneity in Meta-Analysis: The Diamond Ratio (DR)
This is a post about the Diamond Ratio (DR), a simple measure of the extent of heterogeneity in a meta-analysis. We introduced the DR in ITNS. But first, some background. Fixed Effect (FE) model for meta-analysis The diamond at the…
Sample-size planning – a short video
Here’s a short talk I gave at the 2017 Society for Neuroscience meeting on sample size planning. The talk discusses: Why you should plan your sample sizes in advance What not to do (how some common approaches can lead you…
Open Science: This Time in Orthodontics
Last month it was the Antarctic Scientists, this month the Orthodontists, and once again I had a most enjoyable time. Lindsay my wife and I are just back from 5 days in Sydney. I was speaking at the 26th Australian…
The complexity of measuring a ‘simple’ behavior (novelty preference tests seem terrible)
The replication crisis isn’t just about sample size and statistical inference. Another key issue is measurement: the process of turning observations into quantitative statements about our sample. It’s tricky. In many cases we’ve run before we learned to walk, adopting methods…
Pre-Print – The New Statistics for Better Science
We have a new preprint on how the New Statistics can save the world (sort of): https://psyarxiv.com/3mztg It’s for a special issue of the American Statistician on the them of “Beyond p values”. We welcome your feedback on via email, twitter (@TheNewStats),…
Not replicable, but citable
What happens to the reputation of a paper when the results reported cannot be replicated? Here’s a graph of citations/year from two studies–an original and a replication study that found little to no effect. It’s just one example, but it…
It’s not all bad news
Here’s a cool pre-print examining the quality of evidence in studies of the genetics of short-term memory in fruit flies (Tumkaya, Ott, & Claridge-Chang, 2018). The paper conducts a meta-analysis of different genes that have been linked to altered olfactory…
Pre-registration challenge met!
I (Bob) have met the pre-registration challenge! I pre-registered a set of replication studies (Calin-Jageman, 2018), and now that they are published, I’ve received confirmation from the Center for Open Science that I have met the challenge–a check for $1,000…
#SIPS2018 is so soon. Shame there is no neuroscience equivalent.. SINS would be great name and neuro really needs it.
Gigerenzer with a great overview of widespread statistical fallacies and how they contribute to poor research: https://t.co/huW3drEnD7
New Stats blog: Effect Sizes for Open Science https://t.co/AcSiNVzTQE
Thinking in effect sizes, my latest in a series on stats education, is now out in JUNE. My favorite part is getting to tell the story of how focusing on effect sizes helped my lab optimize protocols to do more reliable research with fewer animals. https://t.co/FJAVJbPsfB
Hey look: replication research spurs a lab to test additional hypotheses and work out an important methodological moderator! Who could have guessed that direct replication might turn out to be useful in spurring scientific progress? https://t.co/Ccx8shR2Mm
A soon-to-be citation classic from my amazing colleague @Fernie103
Name Norms: A Guide to Casting Your Next Experiment https://t.co/b39XRSm9G1
Helpful when choosing names in your next vignette.
#SocSciResearch
Top
Recent Comments