In this Concept, you will learn how to calculate the range, interquartile range, and the standard deviation for a population and a sample. You will learn to distinguish between the variance and the standard deviation, as well as calculate and apply Chebyshev’s Theorem to any set of data.
Watch This
For an introduction to measures of spread, or variation, see onlinestatbook, Summarizing Distributions: Measures of Variability (7:00).
Citation: Online Statistics Education: A Multimedia Course of Study (http://onlinestatbook.com/). Project Leader: David M. Lane, Rice University.
Guidance
In the previous Concepts, we studied measures of central tendency. Another important feature that can help us understand more about a data set is the manner in which the data are distributed, or spread. Variation and dispersion are words that are also commonly used to describe this feature. There are several commonly used statistical measures of spread that we will investigate in this lesson.
Range
One measure of spread is the range. The range is simply the difference between the largest value (maximum) and the smallest value (minimum) in the data.
Example A
Return to the data set used in the previous lesson, which is shown below:
75, 80, 90, 94, 96
The range of this data set is \begin{align*}96 - 75 = 21\end{align*}
The range is useful because it requires very little calculation, and therefore, gives a quick and easy snapshot of how the data are spread. However, it is limited, because it only involves two values in the data set, and it is not resistant to outliers.
Interquartile Range
The interquartile range is the difference between the \begin{align*}Q_3\end{align*}
Example B
A recent study proclaimed Mobile, Alabama the wettest city in America (http://www.livescience.com/environment/070518_rainy_cities.html). The following table lists measurements of the approximate annual rainfall in Mobile over a 10 year period. Find the range and \begin{align*}IQR\end{align*}
Rainfall (inches) | |
---|---|
1998 | 90 |
1999 | 56 |
2000 | 60 |
2001 | 59 |
2002 | 74 |
2003 | 76 |
2004 | 81 |
2005 | 91 |
2006 | 47 |
2007 | 59 |
Figure: Approximate Total Annual Rainfall, Mobile, Alabama. Source: http://www.cwop1353.com/CoopGaugeData.htm
First, place the data in order from smallest to largest. The range is the difference between the minimum and maximum rainfall amounts.
To find the \begin{align*}IQR\end{align*}
In this example, the range tells us that there is a difference of 44 inches of rainfall between the wettest and driest years in Mobile. The \begin{align*}IQR\end{align*}
Standard Deviation
The standard deviation is an extremely important measure of spread that is based on the mean. Recall that the mean is the numerical balancing point of the data. One way to measure how the data are spread is to look at how far away each of the values is from the mean. The difference between a data value and the mean is called the deviation. Written symbolically, it would be as follows:
\begin{align*}\text{Deviation} = x-\overline{x}\end{align*}
Let’s take the simple data set of three randomly selected individuals’ shoe sizes shown below:
9.5, 11.5, 12
The mean of this data set is 11. The deviations are as follows:
\begin{align*}x\end{align*} |
\begin{align*}x-\overline{x}\end{align*} |
---|---|
9.5 | \begin{align*}9.5 - 11 = -1.5\end{align*} |
11.5 | \begin{align*}11.5 - 11 = 0.5\end{align*} |
12 | \begin{align*}12 - 11 = 1\end{align*} |
Notice that if a data value is less than the mean, the deviation of that value is negative. Points that are above the mean have positive deviations.
The standard deviation is a measure of the typical, or average, deviation for all of the data points from the mean. However, the very property that makes the mean so special also makes it tricky to calculate a standard deviation. Because the mean is the balancing point of the data, when you add the deviations, they always sum to 0.
Observed Data | Deviations |
---|---|
9.5 | \begin{align*}9.5 - 11 = -1.5\end{align*} |
11.5 | \begin{align*}11.5 - 11 = 0.5\end{align*} |
12 | \begin{align*}12 - 11 = 1\end{align*} |
Sum of deviations | \begin{align*}-1.5 + 0.5 + 1 = 0\end{align*} |
Therefore, we need all the deviations to be positive before we add them up. One way to do this would be to make them positive by taking their absolute values. This is a technique we use for a similar measure called the mean absolute deviation. For the standard deviation, though, we square all the deviations. The square of any real number is always positive.
Observed Data \begin{align*}x\end{align*} |
Deviation \begin{align*}x-\overline{x}\end{align*} |
\begin{align*}(x-\overline{x})^2\end{align*} |
---|---|---|
9.5 | \begin{align*}-1.5\end{align*} |
\begin{align*}(-1.5)^2=2.25\end{align*} |
11.5 | 0.5 | \begin{align*}(0.5)^2=0.25\end{align*} |
12 | 1 | 1 |
\begin{align*}\text{Sum of the squared deviations} = 2.25 + 0.25 + 1 = 3.5\end{align*}
We want to find the average of the squared deviations. Usually, to find an average, you divide by the number of terms in your sum. In finding the standard deviation, however, we divide by \begin{align*}n-1\end{align*}
Example C
The following are scores for two different students on two quizzes:
Student 1: \begin{align*}100; \quad 0\end{align*}
Student 2: \begin{align*}50; \quad 50\end{align*}
Note that the mean score for each of these students is 50.
Student 1: Deviations: \begin{align*}100 - 50 = 50; \quad 0 - 50 = -50\end{align*}
Squared deviations: \begin{align*}2500; \quad 2500\end{align*}
Variance \begin{align*}=5000\end{align*}
Standard Deviation \begin{align*}=70.7\end{align*}
Student 2: Deviations: \begin{align*}50 - 50 = 0; \quad 50 - 50 = 0\end{align*}
Squared Deviations: \begin{align*}0; \quad 0\end{align*}
Variance \begin{align*}= 0\end{align*}
Standard Deviation \begin{align*}= 0\end{align*}
Student 2 has scores that are tightly clustered around the mean. In fact, the standard deviation of zero indicates that there is no variability. The student is absolutely consistent.
So, while the average of each of these students is the same (50), one of them is consistent in the work he/she does, and the other is not. This raises questions: Why did student 1 get a zero on the second quiz when he/she had a perfect paper on the first quiz? Was the student sick? Did the student forget about the quiz and not study? Or was the second quiz indicative of the work the student can do, and was the first quiz the one that was questionable? Did the student cheat on the first quiz?
There is one more question that we haven't answered regarding standard deviation, and that is, "Why \begin{align*}n-1\end{align*}
When we claim to have the standard deviation, we are making the following statement:
“The typical distance of a point from the mean is ...”
But we might be off by a little from using a sample, so it would be better to overestimate \begin{align*}s\end{align*} to represent the standard deviation.
Formulas
Sample Standard Deviation:
\begin{align*}s=\sqrt{\frac{\sum_{i=1}^n (x_i-\overline{x})^2}{n-1}}\end{align*}
where:
\begin{align*}x_i\end{align*} is the \begin{align*}i^{\text{th}}\end{align*} data value.
\begin{align*}\overline{x}\end{align*} is the mean of the sample.
\begin{align*}n\end{align*} is the sample size.
Variance of a sample:
\begin{align*}s^2= \frac{\sum_{i=1}^n (x_i-\overline{x})^2}{n-1}\end{align*}
where:
\begin{align*}x_i\end{align*} is the \begin{align*}i^{\text{th}}\end{align*} data value.
\begin{align*}\overline{x}\end{align*} is the mean of the sample.
\begin{align*}n\end{align*} is the sample size.
Chebyshev’s Theorem
Pafnuty Chebyshev was a \begin{align*}19^{\text{th}}\end{align*} Century Russian mathematician. The theorem named for him gives us information about how many elements of a data set are within a certain number of standard deviations of the mean.
The formal statement for Chebyshev’s Theorem is as follows:
The proportion of data points that lie within \begin{align*}k\end{align*} standard deviations of the mean is at least:
\begin{align*}1-\frac{1}{k^2}, \ k>1\end{align*}
Example D
Given a group of data with mean 60 and standard deviation 15, at least what percent of the data will fall between 15 and 105?
15 is three standard deviations below the mean of 60, and 105 is 3 standard deviations above the mean of 60. Chebyshev’s Theorem tells us that at least \begin{align*}1-\frac{1}{3^2} = 1-\frac{1}{9} = \frac{8}{9} \approx 0.89 =89\%\end{align*} of the data will fall between 15 and 105.
On the Web
The following links discuss various issues related to measures of spread, including 1) why the population standard deviation is calculated by dividing by the entire population N, while the standard deviation of a sample is calculated by dividing by the total sample N minus 1; and 2) Why the standard deviation is calculated by a rather complex process of summing the squares of the differences between the data points and the mean, averaging these differences, and then taking the square root of the average, rather than simply averaging the nonsquared absolute differences.
http://mathcentral.uregina.ca/QQ/database/QQ.09.99/freeman2.html
http://mathforum.org/library/drmath/view/52722.html
http://edhelper.com/statistics.htm
http://www.newton.dep.anl.gov/newton/askasci/1993/math/MATH014.HTM
Guided Practice
Return to the rainfall data from Mobile. The mean yearly rainfall amount is 69.3, and the sample standard deviation is about 14.4. Use this information to answer the following questions:
a) What percentage of the data is within two standard deviations of the mean?
b) Is the following answer significant?
c) What is the main advantage of Chebyshev's Theorem?
Solutions:
a) Chebyshev’s Theorem tells us about the proportion of data within \begin{align*}k\end{align*} standard deviations of the mean. If we replace \begin{align*}k\end{align*} with 2, the result is as shown:
\begin{align*}1-\frac{1}{2^2} = 1- \frac{1}{4}=\frac{3}{4}\end{align*}
So the theorem predicts that at least 75% of the data is within 2 standard deviations of the mean.
b) According to the drawing above, Chebyshev’s Theorem states that at least 75% of the data is between 40.5 and 98.1. This doesn’t seem too significant in this example, because all of the data falls within that range.
c) The advantage of Chebyshev’s Theorem is that it applies to any sample or population, no matter how it is distributed.
Explore More
- Following are bowling scores for two people: Luna - 112, 105, 138, 125, and 115; Chris - 142, 116, 100, 132, and 105.
- Show that Chris and Luna have the same mean and range.
- Whose performance is more variable? Explain.
- Use the rainfall data from figure 1 to answer this question.
- Calculate and record the sample mean:
- Complete the chart to calculate the variance and the standard deviation.
Year | Rainfall (inches) | Deviation | Squared Deviations |
---|---|---|---|
1998 | 90 | ||
1999 | 56 | ||
2000 | 60 | ||
2001 | 59 | ||
2002 | 74 | ||
2003 | 76 | ||
2004 | 81 | ||
2005 | 91 | ||
2006 | 47 | ||
2007 | 59 |
For 3-4, use the Galapagos Tortoise data below.
Island or Volcano | Number of Individuals Repatriated |
---|---|
Wolf | 40 |
Darwin | 0 |
Alcedo | 0 |
Sierra Negra | 286 |
Cerro Azul | 357 |
Santa Cruz | 210 |
Española | 1293 |
San Cristóbal | 55 |
Santiago | 498 |
Pinzón | 552 |
Pinta | 0 |
- Calculate the range and the \begin{align*}IQR\end{align*} for this data.
- Calculate the sample standard deviation for this data.
- If \begin{align*}\sigma^2=9\end{align*}, then the population standard deviation is:
- 3
- 8
- 9
- 81
- Which data set has the largest standard deviation?
- 10 10 10 10 10
- 0 0 10 10 10
- 0 9 10 11 20
- 20 20 20 20 20
- How do you determine which measure of spread best describes a particular data set?
- What information does the standard deviation tell us about the specific, real data being observed?
- What are the effects of outliers on the various measures of spread?
- How does altering the spread of a data set affect its visual representation(s)?
Technology Notes:
Calculating Standard Deviation on the TI-83/84 Graphing Calculator
Enter the data 9.5, 11.5, 12 in list L1 (see first screen below).
Then choose '1-Var Stats' from the CALC submenu of the STAT menu (second screen).
Enter L1 (third screen) and press [ENTER] to see the fourth screen.
In the fourth screen, the symbol \begin{align*}s_x\end{align*} is the sample standard deviation.
Answers for Explore More Problems
To view the Explore More answers, open this PDF file and look for section 1.5.