10.2: Test of Independence
Learning Objectives
- Understand how to draw data needed to perform calculations when running the chi-square test from contingency tables.
- Run the test of independence to determine whether two variables are independent or not.
- Use the test of homogeneity to examine the proportions of a variable attributed to different populations.
Introduction
As mentioned in the previous lesson, the chi-square test can be used to both estimate how closely an observed distribution matches an expected distribution (the goodness-of-fit test) and to estimate whether two random variables are independent of one another (the test of independence). In this lesson, we will examine the test of independence in greater detail.
The chi-square test of independence is used to assess if two factors are related. This test is often used in social science research to determine if factors are independent of each other. For example, we would use this test to determine relationships between voting patterns and race, income and gender, and behavior and education.
In general, when running the test of independence, we ask, “Is Variable \begin{align*}X\end{align*}
Drawing Data from Contingency Tables Needed to Perform Calculations when Running a Chi-Square Test
Contingency tables can help us frame our hypotheses and solve problems. Often, we use contingency tables to list the variables and observational patterns that will help us to run a chi-square test. For example, we could use a contingency table to record the answers to phone surveys or observed behavioral patterns.
Example: We would use a contingency table to record the data when analyzing whether women are more likely to vote for a Republican or Democratic candidate when compared to men. In this example, we want to know if voting patterns are independent of gender. Hypothetical data for 76 females and 62 males from the state of California are in the contingency table below.
Democratic | Republican | Total | |
---|---|---|---|
Female | 48 | 28 | 76 |
Male | 36 | 26 | 62 |
Total | 84 | 54 | 138 |
Similar to the chi-square goodness-of-fit test, the test of independence is a comparison of the differences between observed and expected values. However, in this test, we need to calculate the expected value using the row and column totals from the table. The expected value for each of the potential outcomes in the table can be calculated using the following formula:
\begin{align*}\text{Expected Frequency}=\frac{(\text{Row Total})(\text{Column Total})}{\text{Total Number of Observations}}\end{align*}
In the table above, we calculated the row totals to be 76 females and 62 males, while the column totals are 84 Democrats and 54 Republicans. Using the formula, we find the following expected frequencies for the potential outcomes:
The expected frequency for female Democratic outcome is \begin{align*}76 \bullet \frac{84}{138} = 46.26\end{align*}
The expected frequency for female Republican outcome is \begin{align*}76 \bullet \frac{54}{138} = 29.74\end{align*}
The expected frequency for male Democratic outcome is \begin{align*}62 \bullet \frac{84}{138} = 37.74\end{align*}
The expected frequency for male Republican outcome is \begin{align*}62 \bullet \frac{54}{138} = 24.26\end{align*}.
Using these calculated expected frequencies, we can modify the table above to look something like this:
Democratic | Democratic | Republican | Republican | Total | |
---|---|---|---|---|---|
Observed | Expected | Observed | Expected | ||
Female | 48 | 46.26 | 28 | 29.74 | 76 |
Male | 36 | 37.74 | 26 | 24.26 | 62 |
Total | 84 | 54 | 138 |
With the figures above, we are able to calculate the chi-square statistic with relative ease.
The Chi-Square Test of Independence
When running the test of independence, we use similar steps as when running the goodness-of-fit test described earlier. First, we need to establish a hypothesis based on our research question. Using our scenario of gender and voting patterns, our null hypothesis is that there is not a significant difference in the frequencies with which females vote for a Republican or Democratic candidate when compared to males. Therefore, our hypotheses can be stated as follows:
Null Hypothesis
\begin{align*}H_0:O=E\end{align*} (There is no statistically significant difference between the observed and expected frequencies.)
Alternative Hypothesis
\begin{align*}H_a:O \neq E\end{align*} (There is a statistically significant difference between the observed and expected frequencies.)
Using the table above, we can calculate the degrees of freedom and the chi-square statistic. The formula for calculating the chi-square statistic is the same as before:
\begin{align*}\chi^2=\sum_{} \frac{(O_{}-E_{})^2}{E_{}}\end{align*}
where:
\begin{align*}\chi^2\end{align*} is the chi-square test statistic.
\begin{align*}O_{}\end{align*} is the observed frequency value for each event.
\begin{align*}E_{}\end{align*} is the expected frequency value for each event.
Using this formula and the example above, we get the following expected frequencies and chi-square statistic:
Democratic | Democratic | Democratic | Republican | Republican | Republican | |
---|---|---|---|---|---|---|
Obs. Freq. | Exp. Freq. | \begin{align*}\frac{(O-E)^2}{E}\end{align*} | Obs. Freq. | Exp. Freq. | \begin{align*}\frac{(O-E)^2}{E}\end{align*} | |
Female | 48 | 46.26 | 0.07 | 28 | 29.74 | 0.10 |
Male | 36 | 37.74 | 0.08 | 26 | 24.26 | 0.12 |
Totals | 84 | 54 |
\begin{align*}\chi^2=0.07+0.08+0.10+0.12=0.37\end{align*}
Also, the degrees of freedom can be calculated as follows:
\begin{align*}df &= (C-1)(R-1)\\ &= (2-1)(2-1)=1\end{align*}
With an alpha level of 0.05, we look under the column for 0.05 and the row for degrees of freedom, which, again, is 1, in the standard chi-square distribution table (http://tinyurl.com/3ypvj2h). According to the table, we see that the critical value for chi-square is 3.841. Therefore, we would reject the null hypothesis if the chi-square statistic is greater than 3.841.
Since our calculated chi-square value of 0.37 is less than 3.841, we fail to reject the null hypothesis. Therefore, we can conclude that females are not significantly more likely to vote for a Republican or Democratic candidate than males. In other words, these two factors appear to be independent of one another.
On the Web
http://tinyurl.com/39lhc3y A chi-square applet demonstrating the test of independence.
Test of Homogeneity
The chi-square goodness-of-fit test and the test of independence are two ways to examine the relationships between categorical variables. To determine whether or not the assignment of categorical variables is random (that is, to examine the randomness of a sample), we perform the test of homogeneity. In other words, the test of homogeneity tests whether samples from populations have the same proportion of observations with a common characteristic. For example, we found in our last test of independence that the factors of gender and voting patterns were independent of one another. However, our original question was if females were more likely to vote for a Republican or Democratic candidate when compared to males. We would use the test of homogeneity to examine the probability that choosing a Republican or Democratic candidate was the same for females and males.
Another commonly used example of the test of homogeneity is comparing dice to see if they all work the same way.
Example: The manager of a casino has two potentially loaded dice that he wants to examine. (Loaded dice are ones that are weighted on one side so that certain numbers have greater probabilities of showing up.) The manager rolls each of the dice exactly 20 times and comes up with the following results:
1 | 2 | 3 | 4 | 5 | 6 | Totals | |
---|---|---|---|---|---|---|---|
Dice 1 | 6 | 1 | 2 | 2 | 3 | 6 | 20 |
Dice 2 | 4 | 1 | 3 | 3 | 1 | 8 | 20 |
Totals | 10 | 2 | 5 | 5 | 4 | 14 | 40 |
Like the other chi-square tests, we first need to establish a null hypothesis based on a research question. In this case, our research question would be something like, “Is the probability of rolling a specific number the same for Die 1 and Die 2?” This would give us the following hypotheses:
Null Hypothesis
\begin{align*}H_0:O=E\end{align*} (The probabilities are the same for both dice.)
Alternative Hypothesis
\begin{align*}H_a:O \neq E\end{align*} (The probabilities differ for both dice.)
Similar to the test of independence, we need to calculate the expected frequency for each potential outcome and the total number of degrees of freedom. To get the expected frequency for each potential outcome, we use the same formula as we used for the test of independence, which is as follows:
\begin{align*}\text{Expected Frequency}=\frac{(\text{Row Total})(\text{Column Total})}{\text{Total Number of Observations}}\end{align*}
The following table includes the expected frequency (in parenthesis) for each outcome, along with the chi-square statistic, \begin{align*}\chi^2=\frac{(O-E)^2}{E}\end{align*}, in a separate column:
Number Rolled on the Potentially Loaded Dice
1 | \begin{align*}\chi^2\end{align*} | 2 | \begin{align*}\chi^2\end{align*} | 3 | \begin{align*}\chi^2\end{align*} | 4 | \begin{align*}\chi^2\end{align*} | 5 | \begin{align*}\chi^2\end{align*} | 6 | \begin{align*}\chi^2\end{align*} | \begin{align*}\chi^2\end{align*} Total | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Dice 1 | 6(5) | 0.2 | 1(1) | 0 | 2(2.5) | 0.1 | 2(2.5) | 0.1 | 3(2) | 0.5 | 6(7) | 0.14 | 1.04 |
Dice 2 | 4(5) | 0.2 | 1(1) | 0 | 3(2.5) | 0.1 | 3(2.5) | 0.1 | 1(2) | 0.5 | 8(7) | 0.14 | 1.04 |
Totals | 10 | 2 | 5 | 5 | 4 | 14 | 2.08 |
\begin{align*}df &= (C-1)(R-1)\\ &= (6-1)(2-1)=5\end{align*}
From the table above, we can see that the value of the test statistic is 2.08.
Using an alpha level of 0.05, we look under the column for 0.05 and the row for degrees of freedom, which, again, is 5, in the standard chi-square distribution table. According to the table, we see that the critical value for chi-square is 11.070. Therefore, we would reject the null hypothesis if the chi-square statistic is greater than 11.070.
Since our calculated chi-square value of 2.08 is less than 11.070, we fail to reject the null hypothesis. Therefore, we can conclude that each number is just as likely to be rolled on one die as on the other. This means that if the dice are loaded, they are probably loaded in the same way or were made by the same manufacturer.
Lesson Summary
The chi-square test of independence is used to assess if two factors are related. It is commonly used in social science research to examine behaviors, preferences, measurements, etc.
As with the chi-square goodness-of-fit test, contingency tables help capture and display relevant information. For each of the possible outcomes in the table constructed to run a chi-square test, we need to calculate the expected frequency. The formula used for this calculation is as follows:
\begin{align*}\text{Expected Frequency}=\frac{(\text{Row Total})(\text{Column Total})}{\text{Total Number of Observations}}\end{align*}
To calculate the chi-square statistic for the test of independence, we use the same formula as for the goodness-of-fit test. If the calculated chi-square value is greater than the critical value, we reject the null hypothesis.
We perform the test of homogeneity to examine the randomness of a sample. The test of homogeneity tests whether various populations are homogeneous or equal with respect to certain characteristics.
Multimedia Links
For a discussion of the four different scenarios for use of the chi-square test (19.0), see American Public University, Test Requiring the Chi-Square Distribution (4:13).
For an example of a chi-square test for homogenity (19.0), see APUS07, Example of a Chi-Square Test of Homogenity (7:57).
For an example of a chi-square test for independence with the TI-83/84 Calculator (19.0), see APUS07, Example of a Chi-Square Test of Independence Using a Calculator (3:29).
Review Questions
- What is the chi-square test of independence used for?
- True or False: In the test of independence, you can test if two variables are related, but you cannot test the nature of the relationship itself.
- When calculating the expected frequency for a possible outcome in a contingency table, you use the formula:
- \begin{align*}\text{Expected Frequency} = \frac{(\text{Row Total})(\text{Column Total})}{\text{Total Number of Observations}}\end{align*}
- \begin{align*}\text{Expected Frequency} = \frac{(\text{Total Observations})(\text{Column Total})}{\text{Row Total}}\end{align*}
- \begin{align*}\text{Expected Frequency} = \frac{(\text{Total Observations})(\text{Row Total})}{\text{Column Total}}\end{align*}
- Use the table below to answer the following review questions.
Studied Abroad | Did Not Study Abroad | |
---|---|---|
Females | 322 | 460 |
Males | 128 | 152 |
(a) What is the total number of females in the sample?
450
280
612
782
(b) What is the total number of observations in the sample?
782
533
1,062
612
(c) What is the expected frequency for the number of males who did not study abroad?
161
208
111
129
(d) How many degrees of freedom are in this example?
1
2
3
4
(e) True or False: Our null hypothesis would be that females are as likely as males to study abroad.
(f) What is the chi-square statistic for this example?
1.60
2.45
3.32
3.98
- If the chi-square critical value at 0.05 and 1 degree of freedom is 3.81, and we have a calculated chi-square statistic of 2.22, we would:
- reject the null hypothesis
- fail to reject the null hypothesis
- True or False: We use the test of homogeneity to evaluate the equality of several samples of certain variables.
- The test of homogeneity is carried out the exact same way as:
- the goodness-of-fit test
- the test of independence