Of all Open Science practices, researchers often find preregistration most strange, and perhaps most puzzling and challenging. Of the three Open Science badges, the Prereg badge is the rarest, at least so far. “Does it really make much difference?” “But…
Introduction to the New Statistics
The online community and blog for ITNS
Month: December 2016
The New Statistics seems OK to use with the Psychology Major Field Test
“If my department switches to the new statistics, will this tank our majors’ scores on the Major Field Test, which our administration uses as an important assessment tool?” This was one of the first questions asked during a workshop Craig…
Clinical Psychological Science goes Open
Adopting Open Science poses challenges, which vary across fields of research. For example, it may be especially difficult to carry out replications in clinical psychology if participants with the needed clinical diagnosis are hard to find. But Scott Lilienfeld, the…
A chilling picture
In ITNS you may notice dot points like: Focus on effect sizes Be mindful of variability Find a revealing picture Here’s an illustration of the potency of those 3 bullet points. It’s from a recent article in The Conversation. It…
The first review
The first review of ITNS on Amazon: If you are reading ITNS, you too may care to post a review? Geoff
Get into the discussion – The Psych Methods and Practices Group on Facebook
Robert Ross pointed me towards PsychMAP, the Psychology Methods and Practices Discussion Group hosted on Facebook. It’s a very strong group; you can easily become completely absorbed scrolling through the posts and responses. https://www.facebook.com/groups/psychmap/
SIPS: Getting better all the time
The Beatles sang about “getting so much better all the time”. So perhaps Getting Better by Paul McCartney and John Lennon should be the theme song of Open Science? (Although some of the lyrics would need to be expunged…) Bob…
NHST: The double whammy!
When I gave a talk at the HFESA conference, I started of course with an example of the damage done by NHST. My chosen article describes three examples in the field of road safety of how reliance on statistical significance…
Open Data, Re-usable Code
It feels like every day there is a new development in the Open Science movement. It’s overwhelming, but exciting. Here’s a site that I only just stumbled on: Kaggle. It provides high-quality curated data sets for statistical exploration. It also…
New Stats blog: NeuRA Ahead of the Open Science Curve https://thenewstatistics.com/itns/2019/12/07/neura-ahead-of-the-open-science-curve/
flashbulb memory: @dstephenlindsay was visiting, and we went to Geoff Cummings’s talk. As it all sunk in, we slid down our chairs in horror. The next day, I starting fixing things in my lab—but Steve started fixing all of psychological science. https://journals.sagepub.com/doi/full/10.1177/0956797619893653
Bootstrap methods are not a license to use small sample sizes:
“When sample sizes are too small, no amount of bootstrapping can lead to reliable inferences because the skewness and the tails of certain distributions cannot be captured properly.”
https://psyarxiv.com/kxarf/
New Stats blog: I Join an RCT: A View From the Other Side https://thenewstatistics.com/itns/2019/11/27/i-join-an-rct-a-view-from-the-other-side/
Back in April the British Neuroscience Association adopted reforms to enhance research credibility (@robustgar):
https://journals.sagepub.com/doi/full/10.1177/2398212819844167
So impressed with this statement.
So envious of the BNA--way ahead of @SfNJournals on these issues (though good steps at eNeuro).
Today I'm thankful for any graduate program whose LoR portal requires only a letter upload and none of those rating scales.
Its only p-hacking if it comes from the pihâque region of France. Otherwise it's just sparkling malpractice
New Stats blog: Replications: How Should We Analyze the Results? https://thenewstatistics.com/itns/2019/11/22/replications-how-should-we-analyze-the-results/
We examined close to 1 million confidence intervals in PubMed abstracts and found a huge and unbelievable number of intervals that were just below the magic 0.05 statistically significant threshold https://bmjopen.bmj.com/content/9/11/e032506.full, with @Jonathan_D_Wren
Top
Recent Comments