Meet Petra: Enthusiasm for Archaeology, Open Science, and Better Statistics

Lunch with Petra Vaiglova

It was a pleasure to meet Petra Vaiglova a few days ago while she was in Melbourne for an archaeological science conference. Fiona Fidler joined us for lunch–thanks to her for hosting.

Originally from the Czech Republic (Czechia), Petra has lived, studied, and worked all over the world, as you can see at her site. Her doctorate is from Oxford. Her TEDx talk outlines some of her research interests.

She arrived in Australia a couple of years ago as a post doc at Griffith University, Queensland. Soon after, she launched into organising what became a three-day online Workshop on Good Statistical Practice in Archaeology–open to anyone of any discipline.

I first learned of her enthusiasm for statistical reform and Open Science when she kindly invited me to speak at that workshop. I gave a talk on the new statistics, and another on using Bob’s new esci software in jamovi–in archaeological science, as in any other discipline. I posted about the workshop here.

Earlier this year Petra took up a lectureship at ANU in Canberra, and enthusiastically took on teaching statistics and topics in archaeological science to both undergraduate and postgraduate students.

She expressed keen interest in our second edition, even volunteering to help. Over many months last year she worked through final drafts of most chapters, picking up many errors and infelicities. Later she worked painstakingly through the proofs of many chapters, picking up elusive tiny errors. She made an immense contribution to ITNS2, as Bob and I acknowledge on p. xxvii.

So last week Petra, Fiona and I had much to discuss. Petra will be at AIMOS in November (more details here), no doubt meeting many of the good folks who make the Meta-science scene in Australia so lively and multi-disciplinary.

As an associate editor of the Journal of Archaeological Science she is helping develop guidelines for that journal to encourage reproducibility and Open Science practices.

I discovered years ago that archaeological science has Open Science lessons for us all–see my post here. I wish Petra all strength for her continuing efforts towards statistical reform and Open Science!

Geoff

Beth Morling on the 2nd edition of ITNS

Yes, we’re excited about the upcoming 2nd edition of Introduction to the New Statistics. Though we’re not braggarts by nature, hard not to crow from this feedback from Beth Morling, author of the fantastic textbook Research Methods in Psychology, APS fellow, and the 2023 winner of the Charles L. Brewer Distinguished Teaching of Psychology Award (congrats, Beth!). Here’s Beth’s feedback:

Cumming and Calin-Jageman are psychology’s New Statistics evangelists, and with this text they demonstrate how to train our field’s newest scholars.  This book explains the statistical estimation process with patience and clarity.  Just as importantly, each section keeps students in mind. The authors anticipate learners’ misconceptions, build quantitative reasoning with “eyeballing” tips, and offer more practice just when students need it. It’s a great text for students and for anyone who wants to deepen their understanding. 

Beth Morling
Professor of Psychological and Brain Sciences
University of Delaware

Simine Writes About Our Second Edition

A clear and accessible introduction to statistics, perfect for beginners. This book covers both the old and the new – giving students the fundamentals they need to understand their field, while equipping them with a more sophisticated understanding of the pros and cons of those established practices. The focus on open science and integration with statistical tools (e.g., JAMOVI) makes the book particularly useful for training future researchers.

That’s the endorsement of our forthcoming second edition by Simine Vazire. Bob and I are, of course, enormously appreciative of her generous words. I recently posted (here) about her appointment as the incoming Editor-in-Chief of Psychological Science–a fantastic development imho.

The bunch of balloons on the right sketch Simine’s main research interests. Who better to write about Open Science and what’s needed to help us all–and our students–do better science? Thanks Simine.

Geoff

Free Online APA Conference on Teaching Research Excellence in Psychology, December 14th 2023 9:00am to 2:30pm EST

If you want to wrap up your winter semester with an invigorating online conference on teaching research excellence, you’re in luck, as the APA’s Teaching Research Excellence conference will be held via Zoom on December 14th, 2023 from 9:00 am to 2:30pm EST.

You can register to attend for free: https://docs.google.com/forms/d/e/1FAIpQLSeJV0SWNBRi206hmjMe3s2vaGVF-y2ksgseFtwteOrxUnsP8Q/viewform

The full program is below. It includes talks from John Edlund (Research Director of Psi Chi and executive editor of JSP, associate editor at Collabra Psychology), Stephen Chew (director of the Culture & Family Development Lab at Wellesley College), and Bob. The conference is organized by Zane Zheng of Lasell University.

Dorothy Writes About Our Second Edition

“If I were teaching introductory statistics to undergraduates, this is the textbook I’d use. The things that make it distinctive are first, the focus on estimation rather than p-values (though the latter are covered), second, the link with free open-source software that allows users to explore analyses and visualisations, and third an emphasis on open science practices, coupled with red flags and examples of DFY (Don’t Fool Yourself!). There are plenty of exercises, quizzes, and take-home messages, which will bring the material alive even for the most maths-phobic students.”

…so writes Dorothy Bishop about our second edition. Bob and I are hugely grateful, and chuffed, to have her generous words.

Dorothy is Emeritus Professor of Developmental Neuropsychology at Oxford University, and one of the tiny number of scholars so broadly accomplished that they can list FBA, FMedSci, FRS after their name, meaning being a Fellow of The British Academy, The Academy of Medical Sciences, and the Royal Society.

She writes an award-winning blog, numerous tweets (@deevybee), and, as “Deevy Bishop“, several detective novels.

She has long written about meta-science issues. Search her blog and find many interesting reads. She was a co-author of A manifesto for reproducible science. Since “retirement” she has become even more involved in meta-science, as recounted here.

You can see why Bob and I are so happy that she felt able to write so positively about the new edition of ITNS.

Geoff

P.S. Replying to the copy-editor is done, page proofs expected in a couple of weeks. The Routledge page for ITNS2 is here, 21 March the publication date. Note one error: full colour, not “B/W”.

ITNS Second Edition: Now the Bookmark

For the second edition we are expecting copy editing in late October, then from late November we have just three weeks to correct the page proofs and make two indexes. Phew. Routledge estimates the book will be released (ebook, softback, hardback) by March.

Meanwhile bookmarks for the new edition are with my local printers. If you meet up with Bob or me in person, maybe we’ll have bookmarks to hand out. They do work in other books, tho’ maybe not so good for kindle, etc?

For the record, below are the bookmarks for ITNS, first edition, and for UTNS, my first book, before Bob came on board. All three bookmarks have the same back. These older two may be becoming collectors’ items?

Happy reading,

Geoff

2nd Edition Now With Routledge!

Bob and I are delighted to report that we’ve submitted ITNS2 to the publisher. Routledge say to expect it ‘early in 2024’. We’re hoping they may have something in time for faculty making textbook decisions for the N. Hemisphere Spring Semester.

Not only a new cover design, but also: Bob’s wonderful esci 1.0.1 is now available in jamovi, with a new name and new logo.

esci is now Estimation Statistics with Confidence Intervals, and the logo is:

The floating difference axis is a worthy logo because it’s so central to our estimation approach, and appears in so many esci analyses.

Bob will have more to say about esci 1.0.1 but here’s how to start:

  • At the jamovi downloads page, click the latest version for your choice of Windows, macOS, or Linux. (Currently 2.4.5 for Windows.) Install jamovi.
  • In jamovi, click the large plus sign, top right, choose ‘Manage Installed’, scroll through the ‘Available’ modules to find esci 1.0.1, click to install.
  • Enjoy seeing a new menu appear: esci with its logo.

We hope all these goodies serve you and your students well and we look forward to hearing about your experiences.

Geoff

A Great Introduction to Open Science: The Pennington Book

A clear and highly readable account of the last decade or so, with lots of help to put Open Science into practice. Find details here.

  • A mere 80 pages, but well-informed and comprehensive.
  • Lots of engaging stories, infectious enthusiasm.
  • Numerous links so you can follow up anything of particular interest.
  • Statistical issues are mentioned but not discussed in detail, so the book will fit well alongside the second edition of ITNS.

As a student, Charlotte Pennington became fascinated by stereotype threat, a long-established concept in social psychology. In 2013 she eagerly started her PhD on the topic. However, despite her careful efforts many of her studies found little or no difference between her groups. These studies were repeatedly refused publication. Feeling pressure to gain publications in good journals she became anxious and depressed. Then in 2016 she discovered discussions of the replication crisis and Open Science. She accepted that many of findings she had encountered as established had now been shown not to be replicable. She read further and soon made it her passion to teach about the story of the emergence and development of Open Science, and what now needs to be done to achieve efficient research and a trustworthy research literature. Hence this book–it’s a valuable contribution.

Geoff

Pennington, C. (2023). A student’s guide to Open Science: Using the replication crisis to reform psychology. McGraw Hill, Open University Press.

Online Talks & Workshops, Feb 8-11: Stats Reform, Open Science, R

Archaeology?! Yes, but it’s for everyone–registrations are coming from across science, and from students to seasoned researchers. All welcome. Opening keynote by Nicole Lazar of ASA ‘beyond p < .05‘ fame. I’m speaking later on the first day.

  • More info is below and here. (Go here to get times in your time zone. See note ‘PLEASE DO NOT FILL THIS POLL IN’.)
  • FREE registration is here.

Feel free to come along. Enjoy. Geoff

AIMOS: Recorded Session Gems Now Online

Bob tweeted about it, I posted about it, and recently it happened: The AIMOS zoomfest. The program is here.

AIMOS, just 3 years old, advances meta-science, a big part of which is the scholarship and advocacy that advances Open Science. This is the third conference, and now, supported by a generous donation, planning is in full swing for the establishment of a Journal of Metascience–to be open, of course. (I don’t think that journal title has been settled yet.)

Many sessions were recorded and are now online. Below are a few gems–there are many more worth exploring, at the YouTube channel. It’s great to hear of OS advances and advice from law, economics, medicine… and many more.

Brian Nosek: The Story so far here

Brian, ED of the Center for Open Science, describes the massive OS progress these last ten years. His abstract is a neat summary:

Scholarly studies of science are as old as science itself. The last 10 years of metascience has a unique character. Compared with other scholarly treatments, it is more data-driven, collaborative, grounded in the discipline it studies, applied, interventionist, and activist. Metascience studies how the system works, proposes how it should work, develops interventions to change how it works, and evaluates whether those interventions are having the desired effects. The last 10 years reflects the emergence of metascience as a scholarly activity not just to understand science but to improve it.

Rose O’Day: We Need to get on With Getting Stuff Done here

Brian gave us an informative welcome. Rose book-ended the meeting by sending us off energised to actually get real change done. She was given the online equivalent of a standing ovation.

Bob Explaining The New Statistics to Improve Statistics Education

Alas, the recording system slipped up, so no video. Bob did a rapid-fire and very neat job. His slides are here.

Meta-Analysis: the Latest here

Three minitalks, then discussion. Highlights for me included: Tari Turner (1:40 – 14:00) on how ‘live meta-analysis‘ provided constantly updated coronavirus evidence to guide ever-changing public policy these last two years. And Shinichi Nakagawa (14:40 – 29:40) on meta-analysis of variances, with diverse great examples of why this can be vitally important.

Assessing the Risk of Bias in the Studies in a Meta-Analysis

Alas again, no recording for this workshop run by Matt Page. We heard about his ROB-ME tool, and in small groups used it for a couple of examples. My take-away: It’s not possible to avoid considerable subjectivity in assessing bias. The only solution is for all researchers to follow the full Open Science list of better practices (of course). But it’s a tool worth investigating; it may be the best we have. Read about it here and here.

How to Start a Revolution in Your Discipline

A terrific discussion, again with no recording. Lots of hand-wringing about how hard it is to get take-up of OS practices. Dorothy Bishop responded by advocating a focus on small philanthropic funding bodies, for which every dollar really matters. Therefore they, more than any other stakeholder, are likely be most responsive to the argument that OS practices can greatly increase the cost-effectiveness of research.

WikiJournals, and Bridging From Journals to Wikipedia here (see 29:20 – 36:00)

Pages in Wikipedia typically get 1,000 times as many views as a journal article–or more. I hadn’t known about the many efforts to find some sort of integration. Some journals have rules about authors posting an update or new page to Wikipedia. Wikijournals have appeared. The experiments continue. Fascinating stuff from Thomas Shafee, of La Trobe.

What does damage to scientific progress look like? here

Time for three cold showers to enrage us, and energise our future efforts towards OS and research integrity. It’s chaired by the indefatigable David Vaux (Davo), distinguished fraud detective and campaigner for an Australian Research Integrity body–against strong university opposition. (Shame!)

Other AIMOS gems

There are lots of other gems to discover. That YouTube site? It’s here.

Happy digging,

Geoff