Of all Open Science practices, researchers often find preregistration most strange, and perhaps most puzzling and challenging. Of the three Open Science badges, the Prereg badge is the rarest, at least so far. “Does it really make much difference?” “But…
Introduction to the New Statistics
The online community and blog for ITNS
Month: December 2016
The New Statistics seems OK to use with the Psychology Major Field Test
“If my department switches to the new statistics, will this tank our majors’ scores on the Major Field Test, which our administration uses as an important assessment tool?” This was one of the first questions asked during a workshop Craig…
Clinical Psychological Science goes Open
Adopting Open Science poses challenges, which vary across fields of research. For example, it may be especially difficult to carry out replications in clinical psychology if participants with the needed clinical diagnosis are hard to find. But Scott Lilienfeld, the…
A chilling picture
In ITNS you may notice dot points like: Focus on effect sizes Be mindful of variability Find a revealing picture Here’s an illustration of the potency of those 3 bullet points. It’s from a recent article in The Conversation. It…
The first review
The first review of ITNS on Amazon: If you are reading ITNS, you too may care to post a review? Geoff
Get into the discussion – The Psych Methods and Practices Group on Facebook
Robert Ross pointed me towards PsychMAP, the Psychology Methods and Practices Discussion Group hosted on Facebook. It’s a very strong group; you can easily become completely absorbed scrolling through the posts and responses. https://www.facebook.com/groups/psychmap/
SIPS: Getting better all the time
The Beatles sang about “getting so much better all the time”. So perhaps Getting Better by Paul McCartney and John Lennon should be the theme song of Open Science? (Although some of the lyrics would need to be expunged…) Bob…
NHST: The double whammy!
When I gave a talk at the HFESA conference, I started of course with an example of the damage done by NHST. My chosen article describes three examples in the field of road safety of how reliance on statistical significance…
Open Data, Re-usable Code
It feels like every day there is a new development in the Open Science movement. It’s overwhelming, but exciting. Here’s a site that I only just stumbled on: Kaggle. It provides high-quality curated data sets for statistical exploration. It also…
https://science.sciencemag.org/content/367/6475/240?utm_campaign=toc_sci-mag_2020-01-16&et_rid=17172836&et_cid=3167079
“In an era when every restaurant is obliged to publish on its front door the hygiene rating in their kitchen, we're seriously not saying whether a trial that costs millions of dollars has broken the law [...] by failing to report its results?”@bengoldacre
More evidence that superstition does not strongly influence performance.
https://econtent.hogrefe.com/doi/abs/10.1024/1010-0652/a000263
Still, the idea won't die. The original study was cited 29 times last year (2019) vs. 5 cites for the replications I conducted with @Fernie103 showing negligible effect.
Sensible reporting guidelines for exp bio: show the data, make confirm vs. exploratory clear, emphasize effect size and uncertainty. Good resource.
Two colleagues and I just published an editorial/review for how to present data and stats in experimental biology journals. It explains new guidelines adopted by three American pharmacology journals.
http://molpharm.aspetjournals.org/content/molpharm/97/1/49.full.pdf
Polisci types: Beyond voting, what are the most effective things I can do towards the 2020 elections? ($ to a pac? A candidate? Volunteer to canvas? Phone bank?)
What is actually helpful?
Never cared so much before. Not asking for a friend.
(@BrendanNyhan?)
Doing more with confidence intervals. https://replicationnetwork.com/2020/01/10/doing-more-with-confidence-intervals/
Top
Recent Comments