4 Kinds of Survey Error: Sampling, Measurement, Coverage and Non-Response

1. Sampling Error.

 

Sampling error is essentially the degree to which a survey statistic differs from its “true” value due to the fact that the survey was conducted among only one of many possible survey samples.  It is a degree of uncertainty that we are willing to live with.  Even most non-researchers have a basic understanding, or at least awareness, of sampling error due to the media’s reference to the “margin of error” when reporting public survey results.

2. Measurement Error.  

Measurement error is the degree to which a survey statistic differs from its “true” value due to imperfections in the way the statistic is collected.  The most common type of measurement error is one researchers deal with on a daily basis:  poor question wording, with faulty assumptions and imperfect scales.

3. Coverage Error.

Coverage error is another important source of variability in survey statistics; it is the degree to which statistics are off due to the fact that the sample used does not properly represent the underlying population being measured.

There was generally more concern about coverage error in the past; these days, the combination of increasing internet penetration and fast/easy/cheap online survey panels has made it possible to accurately represent many target populations.  Concern about coverage error is still an important conversation; however, it is being discussed more in academic and thought-leadership circles than by the average day-t0-day research practitioner.

4. Non-Response Error.

My guess is that non-response error would be the least named type of error in our hypothetical survey.  Telephone survey houses historically have routinely made 20 or more call-backs to households that do not answer the telephone.  This practice has dwindled due to a combination of the expense of conducting so many call-backs, and the dramatic growth of online surveys, where it is just easier to replace non-responders with fresh sample.  It is also not considered acceptable in an online context to conduct scores of follow-up emails; that would get the sender sent to a blacklist post haste.

workshop-selfadministered-mobile-survey-workshop-dr-michael-bosnjak-free-university-of-bozenbolzano-mobile-research-conference-2011-7-728

Source: http://researchaccess.com/2011/11/4-kinds-of-survey-error-sampling-measurement-coverage-nonresponse/

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s