Scribd
Upload
174 views

Random Sampling Error - 2013-03-02

This document discusses random sampling error and how it can influence data collection and conclusions. Random sampling error occurs because it is impossible to sample an entire population, so a representative sample must be used instead. However, samples can never perfectly match the full population, introducing potential errors. Further, opinion polls cited in media often mislead people by suggesting margins of error convey more certainty than they do. Poor poll design can also skew results and introduce large inaccuracies not captured by margins of error. Experimental design must account for potential errors from non-representative sampling to obtain meaningful results.

Uploaded by

Chandra Andjar
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
174 views

Random Sampling Error - 2013-03-02

This document discusses random sampling error and how it can influence data collection and conclusions. Random sampling error occurs because it is impossible to sample an entire population, so a representative sample must be used instead. However, samples can never perfectly match the full population, introducing potential errors. Further, opinion polls cited in media often mislead people by suggesting margins of error convey more certainty than they do. Poor poll design can also skew results and introduce large inaccuracies not captured by margins of error. Experimental design must account for potential errors from non-representative sampling to obtain meaningful results.

Uploaded by

Chandra Andjar
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Published on Explorable.com (https://explorable.

com)

Random Sampling Error


Random sampling errors are one type of experimental error that everybody should know.
Anyone who reads polls on the internet, or in newspapers, should be aware that sampling
errors [1] could vastly influence the data and lead people to draw incorrect conclusions [2].
To further compound the random sampling errors, many survey [3] companies, newspapers
and pundits are well aware of this, and deliberately manipulate polls to give favorable results.
In any experiment [4] where it is impossible to sample an entire population, usually due to
practicality and expense, a representative sample must be used.
Of course, when you use a sample group, it can never fully match the entire population, and
there will always be some likelihood of random sampling error [5].
Any researcher must strive to ensure that the sample is as representative as possible, and
statistical [6] tests have inbuilt checks and balances to take this into account.
To illustrate how to ensure that your statistics [6] are as accurate as possible, we are going to
use the example of an opinion poll. These are one of the most commonly misinterpreted
representations of data, and failure to take into account the nuances of statistics can paint an
incorrect picture.

Margin of Error - A False Picture


The problem is, when you see an opinion poll in a newspaper or internet site, you will usually
see a margin of error [7], such a + or - 3%. The temptation is to think that the polls will be
accurate within this figure.
For example, if a poll gives one political party (A) a 42% share of the vote, and the
other (B) 39%, this opens up a number of possible results. (A) could have 45%, (B)
36%. Both could be 39% or (B) could actually be ahead, 42% versus 39%. Of
course, the results could show any variation in between those extremes.
Complicated enough?

To complicate the picture further, even this random sampling error can be wildly inaccurate.
Any opinion poll may give the margin of error, but this can convey a false sense of security
and make people assume that the results 'must' lie within this range.
In fact, these figures could actually be completely wrong, and the numbers are only ever an
estimate.

The Problem With Random Sampling Error


The problem is that these results only show the random sampling error within that specific
group. They show the chances of the results in that group occurring purely by chance, exactly
like the 95% confidence margin [8] employed by many scientific researchers.
However, this is a very narrow definition and is often misunderstood.
In an opinion poll, there is no guarantee that the sample of 1000 or 10 000 people is truly
representative of the larger population as a whole.
There have been many extremely inaccurate polls conducted over the years, and they fell
down due to poor design and not understanding all of the relevant factors.
For example, an opinion poll company conducting telephone polls may make the
mistake of only telephoning during office hours, when most of the population is at
work, skewing the data.
In addition, poorer families do not always have a fixed line telephone and use unregistered
cell phones, again leaving a huge potential for inaccuracy. The margins of error would be
perfectly acceptable, in these cases, but the overall findings would still be horribly wrong.
Modern polling companies are very skilled at designing polls to select samples [9] from many
elements of the population, and via various media, so big errors rarely happen. Despite this,
opinion polls must always be taken as a guide only, not an exact representation of how an
election is likely to unfold.

Random Sampling Error and Experimental Design


The mistakes made by pollsters relate directly to any type of experiment [10] involving random
sample groups.
Statistics can only work with the data [11] provided and, if your design is poorly thought out, will
not be able to cover up these errors [12]. Garbage in definitely equals garbage out.

Bibliography
Husch, B. (1971). Planning a Forest Inventory. Rome, Italy: Food and Agriculture
Organization of the United Nations

Urdan, T.C. (2005). Statistics in Plain English, Mahwah, NJ: Lawrence Erlbaum
Weisberg, H.F. (2005).The Total Survey Error Approach: A Guide to the New Science of
Survey Research. Chicago: University of Chicago Press
Related pages:
Probability Sampling [13]
What is Sampling? [14]
Confidence Interval [8]
Random Error [15]
Sampling Error [1]

Latest ideas

[18]

[19]

The Mad-Genius Paradox: Creativity Could Be Tied To Both Sanity And Madness [19]

[20]

Belive [20]

[21]

Talent vs Training [21]

[22]

Sworn In On A Kindle [22]


Citation:
Martyn Shuttleworth [16] (Apr 6, 2009). Random Sampling Error. Retrieved Jul 01, 2014 from

Explorable.com: https://explorable.com/random-sampling-error [17]


Source URL: https://explorable.com/random-sampling-error
Links:
[1] https://explorable.com/sampling-error, [2] https://explorable.com/drawing-conclusions, [3]
https://explorable.com/survey-research-design, [4] https://explorable.com/experimental-research, [5]
http://www.pollingreport.com/sampling.htm, [6] https://explorable.com/statistics-tutorial, [7]
https://explorable.com/statistics-margin-of-error, [8] https://explorable.com/statistics-confidence-interval,
[9] https://explorable.com/population-sampling, [10] https://explorable.com/experimental-error, [11]
https://explorable.com/statistical-data-sets, [12] https://explorable.com/type-I-error, [13]
https://explorable.com/probability-sampling, [14] https://explorable.com/what-is-sampling, [15]
https://explorable.com/random-error, [16] https://explorable.com/users/martyn, [17]
https://explorable.com/random-sampling-error, [18] https://explorable.com/ideas, [19]
https://explorable.com/ideas/the-mad-genius-paradox-creativity-could-be-tied-to-both-sanity-andmadness, [20] https://explorable.com/ideas/believe, [21] https://explorable.com/ideas/talent-vs-training,
[22] https://explorable.com/ideas/sworn-in-on-a-kindle

You might also like