<img src="https://d5nxst8fruw4z.cloudfront.net/atrk.gif?account=iA1Pi1a8Dy00ym" style="display:none" height="1" width="1" alt="" />
Dismiss
Skip Navigation
Our Terms of Use (click here to view) have changed. By continuing to use this site, you are agreeing to our new Terms of Use.

Sampling and Bias

Sampling issues and bias

Atoms Practice
Estimated6 minsto complete
%
Progress
Practice Sampling and Bias
Practice
Progress
Estimated6 minsto complete
%
Practice Now
Turn In
Understanding Bias

License: CC BY-NC 3.0

The eighth graders are conducting a survey. They want to know how many people enjoy pizza versus chicken. Karen is writing the survey. She only handed it out to all of the girls in the class. Her best friend Kevin said that she can’t do this because the results will be skewed. Karen doesn’t understand why this would be the case. Can you help?

In this concept, you will learn to understand bias in surveys and samples.

Bias

A key concern in sampling methods is getting a representative group of the entire population. This gives the study validity; it helps people to believe what the results of the study say. However, many sampling methods are biased. They give an unfair preference to a certain group or exclude a certain segment of the population which gives us less confidence in the results.

Any sampling method that favors one group, or gives a group a smaller likelihood of participating, is biased.

Let’s look at an example.

A biologist measures the growth of plants but only samples plants near the entrance because she cannot reach plants in the middle of the greenhouse.

The plant growth may not have been the same near the door as in other parts of the greenhouse. She used convenience sampling which is not always the best choice for a sample.

Bias is when one group of people or subjects is targeted more than another group. This provides only a specific view of the situation. Survey questions can reveal bias in the survey itself. Sometimes the people who create surveys hope for certain results and create questions to steer the answers. At other times, there are inadvertent cultural biases based on religion, language, age, economic level, etc.

You can learn to spot potential bias in survey questions by looking for questions that exclude a particular group or only include specific groups.

Can you find bias in the following questions?

1. When you visited the restroom, was the cleanliness a) bad, b) okay, or c) good?

Bias: There is the assumption that the person visited the bathroom.

2. At what time of the day do you usually use your swimming pool?

Bias: There is the assumption that the person has a swimming pool.

3. Which do you think is the most powerful book in the Bible?

Bias: There is the assumption that people belong to a certain religion and are familiar with the Bible.

4. What was more important to the history of America, the Emancipation Proclamation or Women’s Suffrage?

Bias: There is the assumption that people are familiar with these issues from U.S. history and that they understand these concepts.

5. Do you think you should go to church every Sunday?

Bias: There is the assumption that people believe in these ideas.

If a person taking a survey does not feel like the options available for a question do not accurately represent his or her true response, a bias in the survey has occurred.

As well, some people may not be willing to tell the truth, for one reason or another. If a person is asked to identify themselves and then reveal confidential or personal information, they may not answer truthfully.

Examples

Example 1

Earlier, you were given a problem about the survey on pizza vs. chicken. Karen is surveying eighth graders to see how many enjoy pizza versus chicken. She handed out the survey to all of the girls in the class and Kevin said her survey results would be skewed.

Kevin is right. He told Karen that the survey results would be skewed because she only asked the girls their opinion about pizza vs. chicken. Karen needs to ask the boys too since the survey are about the eighth grade not the “girls” in the eighth grade. Asking both boys and girls is the only way to ensure successful results.

Example 2

A school polls parents about traffic congestion in the morning. They ask the parents of every 3rd car in the school drop-off area before the school bell rings to rate the traffic. Is this sampling method the best one? Is it biased?

The answer is yes, the sampling method is biased. If there is traffic congestion, some people may be arriving late. This sampling method is biased because it only includes people who arrive on time. Their opinions may be different from those that arrive late. Therefore, this is not the best way to gather a sampling.

Example 3

Is a survey on dog food preference bias where only people who own big dogs are surveyed?

The answer is yes, this survey will be biased. The survey should include people who own big and small dogs.

Example 4

Is a survey about the number of children who like chocolate ice cream bias if it is conducted by asking all children who come to the ice cream stand? The survey is conducted for three days.

The answer is no. This will be a fair survey.

Example 5

Is a survey about the number of tenth graders who babysit bias if it is conducted by randomly selecting boys and girls in the tenth grade?

The answer is no. This will be a fair survey.

Review

Are the following survey questions biased?

1. How old is your spouse?

2. How many times do you go to the park each month? a) 1-2, b) 3-5, c) 6-10, or d) more than 10

3. Which is more important, the First or Second Amendment of the Constitution?

4. Don’t you agree that equality for all Americans is important?

5. Don’t you think all people should drive a car?

6. How do you feel about people who are vegetarians?

7. How do you feel about your boss at work?

Look at the following survey and then answer each question.

A survey was conducted at a veterinarian’s office. For one week, all of the clients were surveyed. They were asked if they enjoy the management of the office. The week that the survey was conducted, 12 out of 80 clients had appointments. The overall result is that the clients love the way the office is managed.

8. Is this a biased survey?

9. Why or why not?

10. Is there a statistic that supports this conclusion?

11. Do you believe that the overall result of the survey is accurate?

12. Why or why not?

13. How could this survey have been conducted to reach more of the clients?

14. What kind of sampling was conducted?

15. Would a random sample work better for this survey?

Review (Answers)

To see the Review answers, open this PDF file and look for section 10.11. 

Notes/Highlights Having trouble? Report an issue.

Color Highlighted Text Notes
Please to create your own Highlights / Notes
Show More

Vocabulary

bias

Bias refers to a desire to achieve a specific result from a particular study, regardless of the data.

census

A census is an official enumeration of the entire population, with details as to age, sex, occupation, etc.

convenience sampling

Convenience sampling refers to the process of choosing a sample based on members who are easily accessible.

incorrect response bias

When an individual intentionally responds to a survey with an untruthful answer, this is called incorrect response bias.

incorrect sampling frame

Incorrect sampling frame occurs when the group from which you choose your sample does not include everyone in the population, or at least units that reflect the full diversity of the population.

judgement sampling

Judgment Sampling is a type of sampling occurs when the investigator already has made an assumption about a characteristic of the population, and samples are selected accordingly.

margin of error

The margin of error is found by multiplying the standard error of the mean by the z-score of the percent confidence level

non-response bias

Non-response bias is commonly caused by self-selection, subjects with a reason not to respond which may be unrelated to the actual study are not included, skewing the results.

questionnaire bias

Questionnaire bias occurs when the way in which the question is asked influences the response given by the individual.

Sample

A sample is a specified part of a population, intended to represent the population as a whole.

Sampling error (random variation)

Sampling error occurs whenever a sample is used instead of the entire population, where we have to accept that our results are merely estimates, and therefore, have some chance of being incorrect.

self-selection

Self-selection is a sampling method that requires the subject to offer a response to an input.

Survey

A survey is a method of collecting data where you ask a sample of people the same question.

undercoverage

Undercoverage describes a sample with too few members of a given group or demographic.

voluntary response bias

Voluntary response bias occurs when sample members are self-selected volunteers

Image Attributions

  1. [1]^ License: CC BY-NC 3.0

Explore More

Sign in to explore more, including practice questions and solutions for Sampling and Bias.
Please wait...
Please wait...