The replication crisis isn’t just about sample size and statistical inference. Another key issue is measurement: the process of turning observations into quantitative statements about our sample. It’s tricky. In many cases we’ve run before we learned to walk, adopting methods …
The complexity of measuring a ‘simple’ behavior (novelty preference tests seem terrible) Read more »
We have a new preprint on how the New Statistics can save the world (sort of): https://psyarxiv.com/3mztg It’s for a special issue of the American Statistician on the them of “Beyond p values”. We welcome your feedback on via email, twitter (@TheNewStats), …
Pre-Print – The New Statistics for Better Science Read more »
What happens to the reputation of a paper when the results reported cannot be replicated? Here’s a graph of citations/year from two studies–an original and a replication study that found little to no effect. It’s just one example, but it …
Here’s a cool pre-print examining the quality of evidence in studies of the genetics of short-term memory in fruit flies (Tumkaya, Ott, & Claridge-Chang, 2018). The paper conducts a meta-analysis of different genes that have been linked to altered olfactory …
I (Bob) have met the pre-registration challenge! I pre-registered a set of replication studies (Calin-Jageman, 2018), and now that they are published, I’ve received confirmation from the Center for Open Science that I have met the challenge–a check for $1,000 …
There’s a fantastic editorial out in the European Journal of Neuroscience (Mitchell, 2018) arguing that standards need to be much higher in the field of neurogenomics–that’s the study of how genes relate to differences in brain structure and function. The …
A bracing call for better science when linking genes to brain function Read more »
You may have seen it on the news: being an expert makes you close-minded. This was circa 2015, and the news reports were about this paper (Ottati, Price, Wilson, & Sumaktoyo, 2015) by Victor Ottati’s group, published in JESP. The paper …
Gaining expertise doesn’t have to close your mind–another adventure in replication Read more »
This isn’t a statistics post–it’s about Bob’s neuroscience research. Most long-term memories are ‘forgotten’–meaning that recall becomes less and less likely. Psychologists have long known, though, that forgetting is complex, and that fragments of a memory can remain. For example, …
Joe Tex sang it well: You’ve got to build your love on a solid foundation. Applied to science: you should build a research program that is robust, generative, and fruitful.. a solid foundation for exploring the hidden mechanisms at work …
This fall I (Bob) was invited to give a talk at Indiana University as part of a series on good science and statistical practice organized by the university’s Social Science Research Commons (SSRC). The SSRC is like a core facility …
Video – Getting started with the New Statistics and Open Science Read more »