1.4: Measures of Spread
Learning Objectives
- Calculate the range and interquartile range.
- Calculate the standard deviation for a population and a sample, and understand its meaning.
- Distinguish between the variance and the standard deviation.
- Calculate and apply Chebyshev’s Theorem to any set of data.
Introduction
In the last lesson, we studied measures of central tendency. Another important feature that can help us understand more about a data set is the manner in which the data are distributed, or spread. Variation and dispersion are words that are also commonly used to describe this feature. There are several commonly used statistical measures of spread that we will investigate in this lesson.
Range
One measure of spread is the range. The range is simply the difference between the largest value (maximum) and the smallest value (minimum) in the data.
Example: Return to the data set used in the previous lesson, which is shown below:
75, 80, 90, 94, 96
The range of this data set is \begin{align*}96 - 75 = 21\end{align*}
The range is useful because it requires very little calculation, and therefore, gives a quick and easy snapshot of how the data are spread. However, it is limited, because it only involves two values in the data set, and it is not resistant to outliers.
Interquartile Range
The interquartile range is the difference between the \begin{align*}Q_3\end{align*}
Example: A recent study proclaimed Mobile, Alabama the wettest city in America. Source: http://www.livescience.com/environment/070518_rainy_cities.html. The following table lists measurements of the approximate annual rainfall in Mobile over a 10 year period. Find the range and \begin{align*}IQR\end{align*}
Rainfall (inches) | |
---|---|
1998 | 90 |
1999 | 56 |
2000 | 60 |
2001 | 59 |
2002 | 74 |
2003 | 76 |
2004 | 81 |
2005 | 91 |
2006 | 47 |
2007 | 59 |
Figure: Approximate Total Annual Rainfall, Mobile, Alabama. Source: http://www.cwop1353.com/CoopGaugeData.htm
First, place the data in order from smallest to largest. The range is the difference between the minimum and maximum rainfall amounts.
To find the \begin{align*}IQR\end{align*}
In this example, the range tells us that there is a difference of 44 inches of rainfall between the wettest and driest years in Mobile. The \begin{align*}IQR\end{align*}
Standard Deviation
The standard deviation is an extremely important measure of spread that is based on the mean. Recall that the mean is the numerical balancing point of the data. One way to measure how the data are spread is to look at how far away each of the values is from the mean. The difference between a data value and the mean is called the deviation. Written symbolically, it would be as follows:
\begin{align*}\text{Deviation} = x-\overline{x}\end{align*}
Let’s take the simple data set of three randomly selected individuals’ shoe sizes shown below:
9.5, 11.5, 12
The mean of this data set is 11. The deviations are as follows:
\begin{align*}x\end{align*} |
\begin{align*}x-\overline{x}\end{align*} |
---|---|
9.5 |
\begin{align*}9.5 - 11 = -1.5\end{align*} |
11.5 |
\begin{align*}11.5 - 11 = 0.5\end{align*} |
12 |
\begin{align*}12 - 11 = 1\end{align*} |
Notice that if a data value is less than the mean, the deviation of that value is negative. Points that are above the mean have positive deviations.
The standard deviation is a measure of the typical, or average, deviation for all of the data points from the mean. However, the very property that makes the mean so special also makes it tricky to calculate a standard deviation. Because the mean is the balancing point of the data, when you add the deviations, they always sum to 0.
Observed Data | Deviations |
---|---|
9.5 |
\begin{align*}9.5 - 11 = -1.5\end{align*} |
11.5 |
\begin{align*}11.5 - 11 = 0.5\end{align*} |
12 | \begin{align*}12 - 11 = 1\end{align*} |
Sum of deviations | \begin{align*}-1.5 + 0.5 + 1 = 0\end{align*} |
Therefore, we need all the deviations to be positive before we add them up. One way to do this would be to make them positive by taking their absolute values. This is a technique we use for a similar measure called the mean absolute deviation. For the standard deviation, though, we square all the deviations. The square of any real number is always positive.
Observed Data \begin{align*}x\end{align*} | Deviation \begin{align*}x-\overline{x}\end{align*} | \begin{align*}(x-\overline{x})^2\end{align*} |
---|---|---|
9.5 | \begin{align*}-1.5\end{align*} | \begin{align*}(-1.5)^2=2.25\end{align*} |
11.5 | 0.5 | \begin{align*}(0.5)^2=0.25\end{align*} |
12 | 1 | 1 |
\begin{align*}\text{Sum of the squared deviations} = 2.25 + 0.25 + 1 = 3.5\end{align*}
We want to find the average of the squared deviations. Usually, to find an average, you divide by the number of terms in your sum. In finding the standard deviation, however, we divide by \begin{align*}n-1\end{align*}. In this example, since \begin{align*}n=3\end{align*}, we divide by 2. The result, which is called the variance, is 1.75. The variance of a sample is denoted by \begin{align*}s^2\end{align*} and is a measure of how closely the data are clustered around the mean. Because we squared the deviations before we added them, the units we were working in were also squared. To return to the original units, we must take the square root of our result: \begin{align*}\sqrt{1.75} \approx 1.32\end{align*}. This quantity is the sample standard deviation and is denoted by \begin{align*}s\end{align*}. The number indicates that in our sample, the typical data value is approximately 1.32 units away from the mean. It is a measure of how closely the data are clustered around the mean. A small standard deviation means that the data points are clustered close to the mean, while a large standard deviation means that the data points are spread out from the mean.
Example: The following are scores for two different students on two quizzes:
Student 1: \begin{align*}100; \quad 0\end{align*}
Student 2: \begin{align*}50; \quad 50\end{align*}
Note that the mean score for each of these students is 50.
Student 1: Deviations: \begin{align*}100 - 50 = 50; \quad 0 - 50 = -50\end{align*}
Squared deviations: \begin{align*}2500; \quad 2500\end{align*}
Variance \begin{align*}=5000\end{align*}
Standard Deviation \begin{align*}=70.7\end{align*}
Student 2: Deviations: \begin{align*}50 - 50 = 0; \quad 50 - 50 = 0\end{align*}
Squared Deviations: \begin{align*}0; \quad 0\end{align*}
Variance \begin{align*}= 0\end{align*}
Standard Deviation \begin{align*}= 0\end{align*}
Student 2 has scores that are tightly clustered around the mean. In fact, the standard deviation of zero indicates that there is no variability. The student is absolutely consistent.
So, while the average of each of these students is the same (50), one of them is consistent in the work he/she does, and the other is not. This raises questions: Why did student 1 get a zero on the second quiz when he/she had a perfect paper on the first quiz? Was the student sick? Did the student forget about the quiz and not study? Or was the second quiz indicative of the work the student can do, and was the first quiz the one that was questionable? Did the student cheat on the first quiz?
There is one more question that we haven't answered regarding standard deviation, and that is, "Why \begin{align*}n-1\end{align*}?" Dividing by \begin{align*}n-1\end{align*} is only necessary for the calculation of the standard deviation of a sample. When you are calculating the standard deviation of a population, you divide by \begin{align*}N\end{align*}, the number of data points in your population. When you have a sample, you are not getting data for the entire population, and there is bound to be random variation due to sampling (remember that this is called sampling error).
When we claim to have the standard deviation, we are making the following statement:
“The typical distance of a point from the mean is ...”
But we might be off by a little from using a sample, so it would be better to overestimate \begin{align*}s\end{align*} to represent the standard deviation.
Formulas
Sample Standard Deviation:
\begin{align*}s=\sqrt{\frac{\sum_{i=1}^n (x_i-\overline{x})^2}{n-1}}\end{align*}
where:
\begin{align*}x_i\end{align*} is the \begin{align*}i^{\text{th}}\end{align*} data value.
\begin{align*}\overline{x}\end{align*} is the mean of the sample.
\begin{align*}n\end{align*} is the sample size.
Variance of a sample:
\begin{align*}s^2= \frac{\sum_{i=1}^n (x_i-\overline{x})^2}{n-1}\end{align*}
where:
\begin{align*}x_i\end{align*} is the \begin{align*}i^{\text{th}}\end{align*} data value.
\begin{align*}\overline{x}\end{align*} is the mean of the sample.
\begin{align*}n\end{align*} is the sample size.
Chebyshev’s Theorem
Pafnuty Chebyshev was a \begin{align*}19^{\text{th}}\end{align*} Century Russian mathematician. The theorem named for him gives us information about how many elements of a data set are within a certain number of standard deviations of the mean.
The formal statement for Chebyshev’s Theorem is as follows:
The proportion of data points that lie within \begin{align*}k\end{align*} standard deviations of the mean is at least:
\begin{align*}1-\frac{1}{k^2}, \ k>1\end{align*}
Example: Given a group of data with mean 60 and standard deviation 15, at least what percent of the data will fall between 15 and 105?
15 is three standard deviations below the mean of 60, and 105 is 3 standard deviations above the mean of 60. Chebyshev’s Theorem tells us that at least \begin{align*}1-\frac{1}{3^2} = 1-\frac{1}{9} = \frac{8}{9} \approx 0.89 =89\%\end{align*} of the data will fall between 15 and 105.
Example: Return to the rainfall data from Mobile. The mean yearly rainfall amount is 69.3, and the sample standard deviation is about 14.4.
Chebyshev’s Theorem tells us about the proportion of data within \begin{align*}k\end{align*} standard deviations of the mean. If we replace \begin{align*}k\end{align*} with 2, the result is as shown:
\begin{align*}1-\frac{1}{2^2} = 1- \frac{1}{4}=\frac{3}{4}\end{align*}
So the theorem predicts that at least 75% of the data is within 2 standard deviations of the mean.
According to the drawing above, Chebyshev’s Theorem states that at least 75% of the data is between 40.5 and 98.1. This doesn’t seem too significant in this example, because all of the data falls within that range. The advantage of Chebyshev’s Theorem is that it applies to any sample or population, no matter how it is distributed.
Lesson Summary
When examining a set of data, we use descriptive statistics to provide information about how the data are spread out. The range is a measure of the difference between the smallest and largest numbers in a data set. The interquartile range is the difference between the upper and lower quartiles. A more informative measure of spread is based on the mean. We can look at how individual points vary from the mean by subtracting the mean from the data value. This is called the deviation. The standard deviation is a measure of the average deviation for the entire data set. Because the deviations always sum to zero, we find the standard deviation by adding the squared deviations. When we have the entire population, the sum of the squared deviations is divided by the population size. This value is called the variance. Taking the square root of the variance gives the standard deviation. For a population, the standard deviation is denoted by \begin{align*}\sigma\end{align*}. Because a sample is prone to random variation (sampling error), we adjust the sample standard deviation to make it a little larger by dividing the sum of the squared deviations by one less than the number of observations. The result of that division is the sample variance, and the square root of the sample variance is the sample standard deviation, usually notated as \begin{align*}s\end{align*}. Chebyshev’s Theorem gives us information about the minimum percentage of data that falls within a certain number of standard deviations of the mean, and it applies to any population or sample, regardless of how that data set is distributed.
Points to Consider
- How do you determine which measure of spread best describes a particular data set?
- What information does the standard deviation tell us about the specific, real data being observed?
- What are the effects of outliers on the various measures of spread?
- How does altering the spread of a data set affect its visual representation(s)?
Review Questions
- Use the rainfall data from figure 1 to answer this question.
- Calculate and record the sample mean:
- Complete the chart to calculate the variance and the standard deviation.
Year | Rainfall (inches) | Deviation | Squared Deviations |
---|---|---|---|
1998 | 90 | ||
1999 | 56 | ||
2000 | 60 | ||
2001 | 59 | ||
2002 | 74 | ||
2003 | 76 | ||
2004 | 81 | ||
2005 | 91 | ||
2006 | 47 | ||
2007 | 59 |
Variance:
Standard Deviation:
Use the Galapagos Tortoise data below to answer questions 2 and 3.
Island or Volcano | Number of Individuals Repatriated |
---|---|
Wolf | 40 |
Darwin | 0 |
Alcedo | 0 |
Sierra Negra | 286 |
Cerro Azul | 357 |
Santa Cruz | 210 |
Española | 1293 |
San Cristóbal | 55 |
Santiago | 498 |
Pinzón | 552 |
Pinta | 0 |
- Calculate the range and the \begin{align*}IQR\end{align*} for this data.
- Calculate the sample standard deviation for this data.
- If \begin{align*}\sigma^2=9\end{align*}, then the population standard deviation is:
- 3
- 8
- 9
- 81
- Which data set has the largest standard deviation?
- 10 10 10 10 10
- 0 0 10 10 10
- 0 9 10 11 20
- 20 20 20 20 20
On the Web
The following links discuss various issues related to measures of spread, including 1) why the population standard deviation is calculated by dividing by the entire population N, while the standard deviation of a sample is calculated by dividing by the total sample N minus 1; and 2) Why the standard deviation is calculated by a rather complex process of summing the squares of the differences between the data points and the mean, averaging these differences, and then taking the square root of the average, rather than simply averaging the non squared absolute differences.
http://mathcentral.uregina.ca/QQ/database/QQ.09.99/freeman2.html
http://mathforum.org/library/drmath/view/52722.html
http://edhelper.com/statistics.htm
http://www.newton.dep.anl.gov/newton/askasci/1993/math/MATH014.HTM
Technology Notes: Calculating Standard Deviation on the TI-83/84 Graphing Calculator
Enter the data 9.5, 11.5, 12 in list L1 (see first screen below).
Then choose '1-Var Stats' from the CALC submenu of the STAT menu (second screen).
Enter L1 (third screen) and press [ENTER] to see the fourth screen.
In the fourth screen, the symbol \begin{align*}s_x\end{align*} is the sample standard deviation.
Image Attributions
Description
Tags:
Subjects:
Search Keywords:
Date Created:
Feb 23, 2012Last Modified:
Aug 11, 2015To add resources, you must be the owner of the section. Click Customize to make your own copy.