New Williams et al. Research on Improving Survey Inference

November 25, 2024

Improving Survey Inference Using Administrative Records Without Releasing Individual-Level Continuous Data

Abstract

Probability surveys are challenged by increasing nonresponse rates, resulting in biased statistical inference. Auxiliary information about populations can be used to reduce bias in estimation. Often continuous auxiliary variables in administrative records are first discretized before releasing to the public to avoid confidentiality breaches. This may weaken the utility of the administrative records in improving survey estimates, particularly when there is a strong relationship between continuous auxiliary information and the survey outcome. In this paper, we propose a two-step strategy, where the confidential continuous auxiliary data in the population are first utilized to estimate the response propensity score of the survey sample by statistical agencies, which is then included in a modified population data for data users. In the second step, data users who do not have access to confidential continuous auxiliary data conduct predictive survey inference by including discretized continuous variables and the propensity score as predictors using splines in a Bayesian model. We show by simulation that the proposed method performs well, yielding more efficient estimates of population means with 95% credible intervals providing better coverage than alternative approaches. We illustrate the proposed method using the Ohio Army National Guard Mental Health Initiative (OHARNG-MHI). The methods developed in this work are readily available in the R package AuxSurvey.

Keywords: Bayesian predictive inference; Rstan; continuous auxiliary variables; generalized additive model; inclusion propensity; poststratification.

Citation

Williams SZ, Zou J, Liu Y, Si Y, Galea S, Chen Q. Improving Survey Inference Using Administrative Records Without Releasing Individual-Level Continuous Data. Stat Med. 2024 Nov 18. doi: 10.1002/sim.10270. Epub ahead of print. PMID: 39557420.

Recent Posts

“Work Trends RU” Podcast with WorkingNation’s Jane Oates

This week's guest on the Heldrich Center's Work Trends RU podcast is Jane Oates, Senior Policy Advisor at WorkingNation. She and Dr. Carl Van Horn discuss WorkingNation’s mission, objectives, and accomplishments; the power of digital storytelling; the challenges of...

Zhang et al. Study Street-View Greenspace and Exercise

GPS-based street-view greenspace exposure and wearable assessed physical activity in a prospective cohort of US women Abstract Background Increasing evidence positively links greenspace and physical activity (PA). However, most studies use measures of greenspace, such...

NJSPL: Some College, No Credential Population in NJ

Overview of the Some College, No Credential Population and Educational Outcomes in New Jersey, 2023–2024 New Jersey State Policy Lab Supporting New Jersey residents in returning to college after leaving without a credential has been an increasing focus of the state’s...

Loh and Noland Explore Public Charging Station Disparities

Equal charging for all: Are there income-based disparities in public charging stations? Abstract We compare charging station accessibility for different income groups in the San Francisco Bay Area. Using a microsimulation model, we estimate charging station...

Heldrich Center Releases New Work Trends Brief and Website

The Heldrich Center for Workforce Development is pleased to announce the availability of two new research products resulting from its long-running public opinion polling series, Work Trends. To better understand the public’s attitudes about work, employers, and the...