Census Sensibility


© Frank Monaldo

National polling during the 1996 presidential elections provides an important lesson in the nature of statistics and the dangers inherent even in their ostensibly professional application. These lessons should make us less sanguine about the potential use of sampling for the official 2000 US Census.

Right up to Election Day, major national polls had President Bill Clinton ahead of Senator Robert Dole by double-digit percentage point leads. Leave aside the question of whether these polls had the self-fulfilling effect of making Clinton's re-election seem inevitable. Most major polls radically erred and predicted election results far outside the stated margins of error.

One major poll consistently found much smaller differences between support for Clinton and Dole, the Zogby poll by John Zogby. The table below shows the major poll predictions and the actual election outcome. Zogby's results mirrored the actual election tallies, giving Clinton an eight percent edge, far smaller than the 18 percent margin predicted by the CBS/New York Times poll.

Table: 1996 President Polls and Election Results. Values are in percentage. The last column is the margin between the Clinton and Dole percentages.
Poll Clinton Dole Perot Margin
CBS/NY Times 53 35 9 18
Pew Research 49 36 8 13
ABC News 51 39 9 12
Harris 51 39 9 12
NBC/WSJ 49 37 9 12
Reuters/Zogby 49 41 8 8
1996 Election 49 41 8 8

How is this possible? The stated margins of error were only a few percent. How could reputable, statistically savvy pollsters arrive at such radically different results? The reason is because the quoted margin of error, the sampling or random error is just one error source. All the polls suffered from about the same level of sampling error, but they labored under different levels of systematic error.

Given a finite, randomly selected sample of a population, the size of the sample determines how well that sample can characterize the population. These statistics are well understood. For example, let's say I want to know the mean height of the population. I can randomly select 100 people from the population and measure their heights. Sampling error tells me how close I can expect the mean height of 100 people in my sample to approximate the mean height of the entire population. Clearly, if I increase my sample size to 1,000 or 10,000 or 100,000, the mean height of my sample will more likely represent the mean height of the entire population.

Go To Page: 1 2 3


The copyright of the article Census Sensibility in Conservative Politics is owned by . Permission to republish Census Sensibility in print or online must be granted by the author in writing.

Post this Article to facebook Add this Article to del.icio.us! Digg this Article furl this Article Add this Article to Reddit Add this Article to Technorati Add this Article to Newsvine Add this Article to Windows Live Add this Article to Yahoo Add this Article to StumbleUpon Add this Article to BlinkLists Add this Article to Spurl Add this Article to Google Add this Article to Ask Add this Article to Squidoo


Here's the follow-up discussion on this article: View all related messages

39.   Jul 20, 1998 8:19 AM
Joel:

First, you have me mis-identified; whatever my feelings of voter apathy may be, I don't think they've come up on this thread (except in the context of under-representation in a "blow-out" ele ...


-- posted by JeredWM


38.   Jul 20, 1998 8:07 AM
Jered -

You said:

"And, of course, need I remind again, the sampling methods of the census would (presumably) be open to review.

Jered, isn't it you that was talking about vot ...


-- posted by JoelG


37.   Jul 20, 1998 6:51 AM
Frank:

Come on... You claim to use statistics daily. Wouldn't you love to have a sample size of 250k?

For those who don't know any statistics, the value of sample size is completely independen ...


-- posted by JeredWM


36.   Jul 17, 1998 5:45 PM
Dear Jered:


A small but important point: the proposal is to enumerate or count 90% of the population not sample it. The "count" for the remaining 10% will be extrapolated from a sample of 250,00 ...


-- posted by Frank_Monaldo


35.   Jul 17, 1998 10:18 AM
Joel:

I'll try to say this as kindly as possible... It is only "too obvious" to you because you don't seem to know what the proposed plan is.

If the plan were indeed to have "a bunch of people b ...


-- posted by JeredWM





For a complete listing of article comments, questions, and other discussions related to Frank Monaldo's Conservative Politics topic, please visit the Discussions page.