top banner top banner
index
RegularArticles
ReplicationStudies
SpecialIssues
Vignettes
EditorialBoard
Instructions4Authors
JournalGuidelines
Messages
Submission

Search publications

When are scientific findings deemed practically or theoretically relevant? A literature review on minimum-effect testing

Full text PDF
Bibliographic information: BibTEX format RIS format XML format APA style
Cited references information: BibTEX format APA style
Doi: 10.20982/tqmp.21.2.p082

Riesthuis, Paul , Cribbie, Robert A.
82-94
Keywords: minimum-effect testing; interval hypotheses; smallest effect size of interest; minimally meaningful effect size; minimally clinically important difference
(data file)   (Appendix)

Null-hypothesis significance testing and p-values have been criticized for their focus on whether an effect is merely different from zero. To address this limitation, Murphy and Myors (1999) introduced minimum-effect testing to psychology researchers in the Journal of Applied Psychology approximately 25 years ago. Minimum-effect tests go beyond assessing whether an effect is statistically significantly different from 0; they also examine whether it is larger in magnitude than a predefined effect size (in a positive or negative direction) that is considered practically or theoretically meaningful. The usefulness of these tests depends largely on how researchers determine and justify the smallest effect size they consider meaningful, known as the smallest effect size of interest (SESOI). As minimum-effect tests are gaining popularity, we conducted a systematic literature review to examine how researchers in psychology apply minimum-effect tests, including how they define and justify their SESOI. We found that many studies relied on unstandardized effect sizes to define their SESOI. However, appropriate justifications for SESOIs were often missing, and in some cases, no justification was provided at all. Additionally, SESOIs were sometimes determined after data collection, or it was unclear when they were established. Furthermore, many studies did not account for minimum-effect testing in their power analyses. We offer several recommendations to improve the implementation of minimum-effect tests in psychological research.


Pages © TQMP;
Website last modified: 2025-12-23.
Template last modified: 2022-03-04 18h27.
Page consulted on .
Be informed of the upcoming issues with RSS feed: RSS icon RSS