Issues with data and analyses: Errors, underlying themes, and potential solutions.

Andrew W Brown, Kathryn A Kaiser, David B Allison

Journal: Proceedings of the National Academy of Sciences of the United States of America 2018;115(11):2563-2570

PMID: 29531079

Abstract

Some aspects of science, taken at the broadest level, are universal in empirical research. These include collecting, analyzing, and reporting data. In each of these aspects, errors can and do occur. In this work, we first discuss the importance of focusing on statistical and data errors to continually improve the practice of science. We then describe underlying themes of the types of errors and postulate contributing factors. To do so, we describe a case series of relatively severe data and statistical errors coupled with surveys of some types of errors to better characterize the magnitude, frequency, and trends. Having examined these errors, we then discuss the consequences of specific errors or classes of errors. Finally, given the extracted themes, we discuss methodological, cultural, and system-level approaches to reducing the frequency of commonly observed errors. These approaches will plausibly contribute to the self-critical, self-correcting, ever-evolving practice of science, and ultimately to furthering knowledge.

Address: Office of Energetics and Nutrition Obesity Research Center, University of Alabama at Birmingham, Birmingham, AL 35294.; Office of Energetics and Nutrition Obesity Research Center, University of Alabama at Birmingham, Birmingham, AL 35294 [email protected].
Bant logo

© Copyright 2026, Nutrition Evidence

NED wishes to thank the following organisations for their support:

We use cookies to improve your experience and analyze site traffic with Google Analytics. By continuing to use our site, you agree to our use of cookies. Learn more.