APS just wrapped up. Geoff and I were privileges to help host a symposium on making progress moving the field away from p values towards the New Statistics. Our co-conspirators were fellow text-book author Susan Nolan, Psychological Science editor Stephen…
Introduction to the New Statistics
The online community and blog for ITNS
Month: May 2017
Getting the whole story: journals could be more encouraging
Even though replication is a cornerstone of the scientific method, psychology journals rarely publish direct replications (though that situation may be changing). Why not? Is it self-censorship, with authors not bothering to conduct or submit such studies? Or is it…
from the APS Convention in Boston
Bob and I are in Boston this weekend for the annual APS Convention. It’s great to catch up, and discuss a million things about ITNS and this blog, and our future plans. Our publisher told us yesterday that early signs…
Confirmatory Research – A special issue of JESP
Catching up a bit, but in November of 2016 the Journal of Experimental Social Psychology published a special issue dedicated just to confirmatory research. http://www.sciencedirect.com.proxy.cc.uic.edu/science/journal/00221031/67/supp/C The whole issue is well-worth reading: There is an excellent guide to pre-registration (ostensibly for…
A cool new journal is Open
APS (The Association for Psychological Science) recently launched its sixth journal: Advances in Methods and Practices in Psychological Science. A dreadful mouthful of a title–why not drop ‘Advances in’ for a start–but it looks highly promising. Maybe it will become…
Publishing unexpected results as a moral obligation for scientists
Amen! A revised European Code of Conduct for Research Integrity now specifically calls on researchers and publishers to not bury negative results. Specifically, the guidelines formulate this principle for publication and dissemination: Authors and publishers consider negative results to be…
What the datasaurus tells us: Data pictures are cool
In various places in ITNS, especially Chapter 11 (Correlation) we discuss how important it is to make good pictures of data, to reveal what’s really going on. Calculating a few summary statistics–or even CIs–often just doesn’t do the job. Many…
Now for some good news: SIPS
The Society for the Improvement of Psychological Science (SIPS) held its first meeting last year, with around 100 good folks attending. Working groups have been–would you believe–working hard since then. The second meeting is 30 July to 1 August, in…
Methodological awakening: backlash against the backlash
Science has had some rough times lately, no doubt. No need to rehearse the many findings indicating that we have some problems that need a fixing. As Will Gervais put it, we’re in the midst of a “methodological awakening”. The…
Replication problems are not competence problems
Why do some replication studies fail to produce the expected results? There are lots of possible reasons: the expectation might have been poorly founded, the replication study could have been under-powered, there could be some unknown moderator, etc. Sure, but…
New Stats blog: NeuRA Ahead of the Open Science Curve https://thenewstatistics.com/itns/2019/12/07/neura-ahead-of-the-open-science-curve/
flashbulb memory: @dstephenlindsay was visiting, and we went to Geoff Cummings’s talk. As it all sunk in, we slid down our chairs in horror. The next day, I starting fixing things in my lab—but Steve started fixing all of psychological science. https://journals.sagepub.com/doi/full/10.1177/0956797619893653
Bootstrap methods are not a license to use small sample sizes:
“When sample sizes are too small, no amount of bootstrapping can lead to reliable inferences because the skewness and the tails of certain distributions cannot be captured properly.”
https://psyarxiv.com/kxarf/
New Stats blog: I Join an RCT: A View From the Other Side https://thenewstatistics.com/itns/2019/11/27/i-join-an-rct-a-view-from-the-other-side/
Back in April the British Neuroscience Association adopted reforms to enhance research credibility (@robustgar):
https://journals.sagepub.com/doi/full/10.1177/2398212819844167
So impressed with this statement.
So envious of the BNA--way ahead of @SfNJournals on these issues (though good steps at eNeuro).
Today I'm thankful for any graduate program whose LoR portal requires only a letter upload and none of those rating scales.
Its only p-hacking if it comes from the pihâque region of France. Otherwise it's just sparkling malpractice
New Stats blog: Replications: How Should We Analyze the Results? https://thenewstatistics.com/itns/2019/11/22/replications-how-should-we-analyze-the-results/
We examined close to 1 million confidence intervals in PubMed abstracts and found a huge and unbelievable number of intervals that were just below the magic 0.05 statistically significant threshold https://bmjopen.bmj.com/content/9/11/e032506.full, with @Jonathan_D_Wren
Top
Recent Comments