Have you ever conducted a survey? Take a look at this dilemma.
The eighth graders are conducting a survey. They want to know how many people enjoy pizza verses chicken. Karen is writing the survey. She only handed it out to all of the girls in the class. Her best friend Kevin said that she can't do this because the results will be skewed. Karen doesn't understand why this would be the case.
Do you know?
This Concept will teach you how to understand bias. By the end of the Concept, you will know why Kevin has made this statement.
A key concern in sampling methods is getting a representative group of the entire population. This gives the study validity; it helps us to believe what the results of the study say. However, many sampling methods are biased—they give an unfair preference to a certain group or exclude a certain segment of the population—which gives us less confidence in the results.
Any sampling method that favors one group or gives a group a smaller likelihood of participating is biased. Take a look at this situation.
A biologist measures the growth of plants but only samples plants near the entrance because she cannot reach plants in the middle of the greenhouse.
The plant growth may not have been the same near the door as in other parts of the greenhouse. She used convenience sampling which is not always the best choice for a sample.
What is bias? Bias is when one group of people is targeted more than another group. This provides only a specific view of the situation. Survey questions can reveal bias in the survey itself. Sometimes the people who create surveys hope for certain results and create questions to steer the answers. At other times, there are inadvertent cultural biases based on religion, language, age, economic level, etc.
We can learn to spot potential bias in survey questions by looking for questions that exclude a particular group or only include specific groups.
Can you find bias in the following questions?
|1. When you visited the restroom, was the cleanliness a) bad, b) okay, c) good?||There is the assumption that the person visited the bathroom.|
|2. At what time of the day do you usually use your swimming pool?||There is the assumption that the person has a swimming pool.|
|3. Which do you think is the most powerful book in the Bible?||There is the assumption that people belong to a certain religion or knows about the Bible.|
|4. What was more important to the history of America, the Emancipation Proclamation or Women’s Suffrage?||There is the assumption that people are familiar with these issues from U.S. history and that they understand the words.|
|5. Do you think you should go to church every Sunday?||There is the assumption that people believe in these ideas.|
If a person taking a survey does not feel like the options available for a question do not accurately represent his or her true response, a bias in the survey has occurred. They may feel confused or frustrated. In some cases, they may not even understand the meaning of the question because their education or background did not prepare them or they don’t even speak the language in which the survey is written.
Finally, some people may not be willing to tell the truth, for one reason or another. If a person is asked to identify themselves and then reveal confidential or personal information, they may not answer truthfully. They may not even take the survey seriously and not answer in a sincere manner.
Will the following surveys be biased? Explain your answer.
A survey on dog food preference where only people who own big dogs are surveyed.
Solution: This will be biased. The survey should include people who own big and small dogs.
The number of children who like chocolate ice cream. A survey is conducted which asks all children who come to the ice cream stand. The survey is conducted for three days.
Solution: No, this will be a fair survey.
The number of tenth graders who babysit, boys and girls in the tenth grade were randomly surveyed.
Solution: This will be a fair survey.
Now let's go back to the dilemma from the beginning of the Concept.
Kevin told Karen that the survey results would be skewed because she only asked the girls their opinion about pizza vs. chicken. Karen needs to ask the boys too since the survey is about the eighth grade not the "girls" in the eighth grade. Asking both boys and girls is the only way to ensure successful results.
- a method of gathering information about a population.
Here is one for you to try on your own.
A school polls parents about traffic congestion in the morning. They ask the parents of every 3rd car in the school drop-off area before school bell rings to rate the traffic.
Let’s think about this method of sampling. Is it the best one? Is it biased?
If there is traffic congestion, some people may be arriving late. This sampling method is biased because it only includes people who arrive on time. Their opinions may be different from those that arrive late. Therefore, this is not the best way to gather a sampling.
Directions: Are the following survey questions biased?
- How old is your spouse?
- How many times do you go to the park each month? a) 1-2, b) 3-5, c) 6-10, or d) more than 10
- Which is more important, the First or Second Amendment of the Constitution?
- Don’t you agree that equality for all Americans is important?
- Don't you think all people should drive a car?
- How do you feel about people who are vegetarians?
- How do you feel about your boss at work?
Directions: Look at the following survey and then answer each question.
A survey was conducted at a veterinarian's office. For one week, all of the clients were surveyed. They were asked if they enjoy the management of the office. The week that the survey was conducted, 12 out of 80 clients had appointments. The overall result is that the clients love the way the office is managed.
- Is this a biased survey?
- Why or why not?
- Is there a statistic that supports this conclusion?
- Do you believe that the overall result of the survey is accurate?
- Why or why not?
- How could this survey have been conducted to reach more of the clients?
- What kind of sampling was conducted?
- Would a random sample work better for this survey?