‘Statistical significance’ is one of the most widely misunderstood phrases in science, according to a 2013 Scientific American
It’s a controversial topic. Probability values (p-values) have been used as a way to measure the significance of research studies since the 1920s, with thousands of researchers relying on them since. With this reliance, though, comes misunderstanding and, therefore, misuse.
This misunderstanding is what the latest episode of the How Researchers Changed the World podcast explores, in conversation with statistician Ron Wasserstein.
In particular, the podcast focuses on Ron’s research into the misuse of p-values as a measure of statistical significance, which culminated in his 2016 paper: ‘The American Statistical Association’s statement on P-values: Context, Process and Purpose.’
Significance tests and p-values are widely used, according to Ron, to remove ‘uncertainty’ from scientific research. But uncertainty exists everywhere, and scientific research is no exception. For Ron, uncertainty in research should be embraced and accepted.
“Significance tests and dichotomised p-values … have turned many researchers into what I’ll call ‘scientific snowbirds’, trying to avoid dealing with uncertainty by escaping to a happier place.”
- Ron Wasserstein
With increasing use, and misuse, of p-values, statistics as a whole was starting to get a badname. Some journals even banned the use of p-values and other statistical methods. So, Ron was tasked with leading the creation of a framework outlining how p-values should be used in research, which would be published as a statement by the American Statistical Association , a leading authority in the statistics world.
“We were challenged to do the ASA statement on p-values because of these attacks on statistics as a whole field of research.”
- Ron Wasserstein
It wasn’t a simple task, but although the debate regarding p-values continues, the statement has had an impact on the research world beyond what Ron could ever have imagined…
The podcast is available on Apple Podcasts, Spotify, Stitcher and Android podcast providers - or head to www.howresearchers.com.
For more information, or to interview Ron Wasserstein, please contact: email@example.com
Presented by Dr Kaitlyn Regehr
Alongside the researcher, the podcast is presented by Dr Kaitlyn Regehr. Dr Kaitlyn Regehr is an academic scholar who specializes in digital and modern culture, gender studies, and new technology. She also regularly features on BBC World as a topic specialist.
12-week learning programs - supercharge your research career
Alongside the podcast are two 12-week learning programs for early and mid-career researchers. They’re delivered online, with one chapter by email each week. Over 12 weeks these chapters build into an indispensable guide.
The early career program covers everything you need to know to get your research published and build your profile as a researcher. The mid-career program is the go-to-guide for managing mid-career challenges, boosting the impact of your research, and enhancing your profile as a researcher.
Supported by Taylor & Francis Group
Taylor & Francis Group are proud to support How Researchers Changed the World.
As one of the world’s leading publishers of scholarly journals, books, eBooks, and reference works, Taylor & Francis Group provides people all over the world with the knowledge to grow their careers, expand their education, and advance their field.
Challenge your thinking at www.tandfonline.com
Produced by Monchü
The How Researchers
series is written and produced by Monchü. They work with world changing organisations to make the world a fairer happier place with strategy and design thinking.
Find out more at www.monchu.uk