Reconsidering Sampling and Costs for Face-to-Face Surveys in the 21st Century

Abstract

Some fundamental factors important for designing multistage face-to-face household surveys in the United States have not been reconsidered since they were established in the 1940s despite vast changes in all aspects of conducting these surveys. This research examines how some changes, particularly data sources and data collection costs, might affect sample designs. Modern data collection methods and tools, address-based household lists, multimode designs, and training and management methods are critical components in the cost structure of today’s surveys. We explore a sample design that uses Census tracts at the first stage rather than counties as traditionally used. The tract design then samples households directly without the additional stages of subsampling of segments in the traditional design. We present statistical and operational issues associated with the designs and discuss the cost implications. Our examination finds that, for household surveys in the United States that include face-to-face data collection, tract designs that have twice as many sampled first-stage units (but the same overall sample size) have roughly the same cost as the county design, with effective sample sizes in the range of about 25 percent higher to as much as four times higher than the county design.