Research – Miller on “Beyond Statistical Significance: A Holistic View of What Makes a Research Finding”

January 23, 2023


Students often believe that statistical significance is the only determinant of whether a quantitative result is “important.” In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction, causality, generalizability, and changeability of the independent variable. I illustrate these issues with examples from an empirical study of the association between how much time teenagers spent playing video games and time spent reading. I describe how study design and context determine each of those aspects of “importance,” and close by summarizing how to provide a holistic view of importance when writing about a quantitative analysis. I also include exercises to guide students through applying these concepts to articles in newspapers and scholarly journals.

Read Article

Jane Miller is a Professor and Faculty Mentoring Director at the Bloustein School

Recent Posts

Shaul Picker Receives 2024 Mortensen-Voorhees Award

Shaul Picker is the 2024 recipient of the Mortensen-Voorhees Award for Achievement in Transportation Studies. This award is granted annually to the highest-achieving student with a concentration in transportation at the Edward J. Bloustein School of Urban Planning and...

NJSPL – Key Insights from Early Offshore Wind Implementation

By Jessica Parineet Offshore wind development is in its early stages in the United States, with just under one gigawatt (GW) of utility scale capacity constructed. State decarbonization goals have catalyzed industry progress thus far, however the Biden administration...

EJB Talks: Political Update with Stuart Shapiro and Amy Cobb

Analyzing Trump's Guilty Verdict and the 2024 Election Outlook Stuart Shapiro welcomes back Amy Cobb MPAP '18 for a political update in the final EJB Talks episode of the spring 2024 season. They discuss the potential consequences of Trump's guilty verdict for...

Racial composition of road users, traffic citations, and police stops

Significance This study pioneers in mapping the racial composition of roads. Our findings highlight a disproportionate rate of citations for moving violations among Black drivers through both speed camera enforcement but more so via police stops, challenging the...

Traffic Speeds Decrease When Bike Lane is Present

Rutgers researchers make finding after looking for ways to lower the incidence of vehicle crashes Read original article on Rutgers Today, June 3, 2024 Rutgers University–New Brunswick researchers conducting a study at a high-traffic intersection in a Jersey Shore town...

Upcoming Events