Sign In | Subscribe
Start learning today, and be successful in your academic & professional career. Start Today!
Loading video...
This is a quick preview of the lesson. For full access, please Log In or Sign up.
For more information, please see full course syllabus of Statistics
  • Discussion

  • Download Lecture Slides

  • Table of Contents

  • Transcription

  • Related Books

Bookmark and Share

Start Learning Now

Our free lessons will get you started (Adobe Flash® required).
Get immediate access to our entire library.

Sign up for

Membership Overview

  • Unlimited access to our entire library of courses.
  • Search and jump to exactly what you want to learn.
  • *Ask questions and get answers from the community and our teachers!
  • Practice questions with step-by-step solutions.
  • Download lesson files for programming and software training practice.
  • Track your course viewing progress.
  • Download lecture slides for taking notes.
  • Learn at your own pace... anytime, anywhere!

Sampling & Bias

Lecture Slides are screen-captured images of important points in the lecture. Students can download and print out these lecture slide images to do practice problems as well as take notes while watching the lecture.

  • Intro 0:00
  • Roadmap 0:05
    • Roadmap
  • Descriptive vs. Inferential Statistics 1:04
    • Descriptive Statistics: Data Exploration
    • Example
  • To tackle Generalization… 4:31
    • Generalization
    • Sampling
    • 'Good' Sample
  • Defining Samples and Populations 8:55
    • Population
    • Sample
  • Why Use Sampling? 13:09
    • Why Use Sampling?
  • Goal of Sampling: Avoiding Bias 15:04
    • What is Bias?
    • Where does Bias Come from: Sampling Bias
    • Where does Bias Come from: Response Bias
  • Sampling Bias: Bias from Bas Sampling Methods 19:34
    • Size Bias
    • Voluntary Response Bias
    • Convenience Sample
    • Judgment Sample
    • Inadequate Sample Frame
  • Response Bias: Bias from 'Bad' Data Collection Methods 28:00
    • Nonresponse Bias
    • Questionnaire Bias
    • Incorrect Response or Measurement Bias
  • Example 1: What Kind of Biases? 40:29
  • Example 2: What Biases Might Arise? 44:46
  • Example 3: What Kind of Biases? 48:34
  • Example 4: What Kind of Biases? 51:43

Transcription: Sampling & Bias

Hi and welcome to

Today we are going to be talking about sampling and bias.0002

The next couple of lectures they are going to be about the way that you collect the data and the different ways that are involved there.0006

It is really because we are going to be going into inferential statistics, so we are going to be talking about 0020

the difference between descriptive statistics and inferential statistics.0026

In that introduction we are going to start off with how do you collect the data in order to do inferential statistics.0032

Because of that we are going to be talking about how these two methods are involved simply to collect data and experiments to collect data.0038

The book of this lecture is going to be based on sampling.0050

It is going to be about why we use sampling, the goal of sampling which is to avoid biased 0053

and the types of biases that might occur because of different kinds of sampling. 0058

First let us start off with the difference between the descriptive statistics and inferential statistics.0066

You may not have noticed so far what we have been doing is largely descriptive statistics.0072

Everything that we been doing so far like visualizing data, summarizing data, getting things 0077

like the mean, median, and interquartile range, standard deviation.0083

All of these things are just about summarizing that data.0092

We have looked at doing that for one variable or two variables.0096

We have looked at getting mean, median, and mode and visualizing one variable at a time on bar graphs or histograms. 0102

We also looked at things like regression and correlation and looking at scatterplot, so visualizing and summarizing two variables at the time.0110

Even though we can do all of that stuff so far, there are still lots of things we cannot do that are important.0126

Here is one example, so maybe we could do stuff like this.0134

A sample of 53 out of 100 voters will vote for candidate A but here is what we do not know, will candidate A win the election?0138

How likely is that?0148

We could summarize our sample, we can visualize it but we cannot make any conclusions about it for the actual population.0153

We cannot do generalization.0164

This is what skill or ability is called.0167

We cannot do generalization going from the sample to understand something about the population.0172

That is something we cannot do yet.0179

Here is an example of something that you cannot do.0183

A sample of 20 preschoolers who are raised with pets scored an average of 5.6 out of 10 on a biology class but a sample of those without pets scored 4.5.0185

Does this mean that having pets make children better in biology?0197

We have no idea.0201

I could tell you I could summarize for you the sample of 20 preschoolers with pets and without pets.0203

I could summarize that.0210

I could visualize that for you and I could do that with these two variables whether they have been raised with pets or not.0211

The pets are the variable which is categorical and their score on the biology test which is continuous.0219

I could do that but I still cannot tell you whether having pets actually cause children to be better at biology.0226

This is compare and find causation.0234

We cannot figure out causation so far and that is really going from the data in order to have a theory about causation.0245

This is something that we are also not able to do.0256

Number one thing we cannot do is we cannot do any generalization.0259

Number two thing we cannot do is we cannot say anything about one variable causing another variable, but causing changes in another variable. 0264

First, in order to tackle generalization that is why we are going to take on sampling.0275

Sampling is going to help solve this problem. 0279

In order to take on the problem of not being able to determine causation we are going to be using experiments to do that. 0293

So, first, let us talk about sampling.0301

This is what a common generalization problem.0304

We have the sample that where 53 out of 100 voters will vote for candidate A but the question is will candidate A win the actual election?0309

Here our little sample is 100 potential voters.0319

If these 100 potential voters and we know what their opinion is like but the question is every voter in election, 0327

we want to predict their behavior and that is the problem. 0343

We only know about these 100 potential voters which is the subset and we do not know if they reflect every voter in the election. 0347

And so what we are really looking for is a way to get a sample of this population that actually represents this population well.0365

Sampling is the method of choosing or the items or cases in your study.0369

And so that is the whole idea behind sampling.0394

It is a method of choosing your particular sample.0396

Here is the thing, in order to select a good sample and so what is a good example?0401

A good sample is one that is a representative of sample and a representative meaning that 0412

this sample if it accurately reflects this population then that is a really good sample.0427

It is hard to guarantee a good example because there is just no way I could ever really know from looking at a tiny book if it actually reflects the population. 0434

The only way I could really know that if I knew everything about the population then I can compare it to my samples. 0445

Then all my samples are representatives but that is not the problem, we often cannot get the whole population.0450

How do I know if my sample is any good?0457

The bad news is we cannot really know but the good news is we determine a good sample by a good sampling method.0463

We are not going to judge your like recipe by how good the food actually turns out.0481

We are going to judge the recipe about by looking at how good the recipe or the techniques actually are.0488

In that way we do not judge a sample by actually knowing how representative it is but we think it is a good sample if it has a good sampling method.0495

And by good it, we mean unbiased.0505

That is what we are really looking for.0510

Ultimately, our goal is a representative sample, but in order to get there all we have are the tools at our hand is unbiased sampling method.0512

And so as long as you have an unbiased sampling method you are safe as you can be because 0524

there is no other way to check whether that sample is actually representative or not.0530

Before we go on, let us take a moment to define samples and population. 0539

A population is the entire universe of cases that you are interested in, entire set of cases you are interested in.0543

Sometimes population are manageable for instance, if your population is all the people in your school. 0564

So it is a manageable size.0572

Maybe your school has 10,000 people and I do not if it is a lie but it is still more manageable and it is very well defined.0576

It is easy to say all your student or maybe you have a company and your population is all your employees.0585

That is another sample, your employees.0596

That is another population.0598

That is sort of smaller and manageable but often times populations are quite large and unmanageable and even undefinable. 0600

For instance, Coca-Cola might be interested in potential customers.0607

That is really hard to say who the potential customer of Coca-Cola.0614

They might be as diverse as cho la la from India, or like businessman in New York City.0617

In McDonald's people might be customers of potential customers for Coca-Cola.0627

The entire set of case is whatever you are actually interested in. 0635

Often times in psychological or sociological or social science studies, the entire cases you are interested 0640

in our something like all adolescents or all American adolescents or all adults.0652

Those are some pretty wide-ranging populations that are very, very difficult to define and pinpoint. 0664

So if it would be impossible to collect data on all of those people.0673

Now the sample is drawn from that population. 0677

It is the subset of the population.0681

The sample is the subset of the population not only that but the sample is also the people 0688

who are actually in your city or the cases that are actually in your study.0697

It does not to be people. 0702

For instance, it could be pills made in your factory.0704

You are not going to look at every single pill made in your factory that would be the population, but maybe you will take a sample.0708

You will take one bottle from a case and that will be your sample.0713

The sample is the subset that you collect data on.0718

These are presumably the ones in your study or data set. 0731

That is the difference between populations and samples.0743

When we collect data from an entire population that is very rare but it does sometimes happen and that is called a census. 0746

When you collect data from every single case that you are interested in.0764

That is very, very thorough.0771

That is often not what we do.0774

Here we use sampling methods and here we collect data on a sample.0777

Why use sampling?0791

Why not always do a census?0793

Well the census is very, very difficult.0794

If your population is manageable, for instance, let us say you go to a high school and your high school has 1,000 people in it.0800

That might not be impossible to collect data on everybody.0809

Usually for something like wanting to know about adolescents living in the United States then doing census is very, very hard.0813

Obviously sampling can save you money and time.0823

Sampling also makes it possible to collect more information on each individual case.0833

Basically the idea there is that when you collect census information you can usually only collect very little 0840

or shallow information about every case you are interested in.0849

But if you do sampling presumably you can go in depth with each case. 0853

Finally, sometimes testing or collecting data will sometimes destroy the item of interest.0858

For instance Ben & Jerry's might want to use sampling to maintain quality control of their ice cream products.0865

In order to do that, one of the things they do is they cut the entire carton in half to just make sure 0874

that all ice cream is mixed with the ice cream on top tastes the same as ice cream on the bottom, that the flavors are the consistent all the way through.0878

In order to do that, you would have to destroy a pint of ice cream and that one pint of ice cream that cannot be sold.0888

If you did a census, you would destroy every single one of your products, right?0895

You do not want to do census in order to do quality control. 0899

Let us talk about the goal of sampling. 0906

The big goal of sampling whenever you are trying to do sampling is to avoid biased or we want to avoid biased.0909

The whole reason is we want our sample to be representative of our population.0915

Biased means that our sample is not representative that is somehow our sample is giving us values 0935

that are too small or too large or skewed in some way away from the population. 0944

Maybe the population mean is 5, but our sampling method gives us samples that are consistently to low or maybe too high.0950

What we want is a sample when we use the sampling method that this method would give us the even distribution.0962

Biased is getting samples that are consistently too low or high for population.0973

Just because of the sampling method results in a sample that is a little bit different from the population does not mean it is a bad sampling method.0998

If it consistently gives you bad samples, that is a bad sampling method.1007

That is a biased.1012

But because of chance whenever we draw from a population randomly we would not get some spread around the mean.1013

What we want from a good sampling method is that those samples, that sampling method, those samples reflect the actual distribution of the population. 1025

For instance, let us say we had this box of marbles and it is a mix of red and white, and it is the even mix of red and white. 1037

But let us say we have a sampling method that only takes from this side.1047

What we really want is a sampling method that goes sort of around randomly and takes samples from everywhere instead of just from one side.1057

That is what we mean by biased, when the actual method itself is biased.1069

Where does the biased come from?1075

Well, the one that I mentioned is that biased can come from the actual sampling method.1079

What we mean by that is that your actual method as picking the sample is somehow biased.1098

I will give you some examples in the next slide.1104

The other way that you could get biased is actually sort of bad news because even when you have a good sample 1108

you might still have biased and that might be because of something like response biased. 1118

This would be because somehow the way that you are collecting the data or somehow something 1123

is going wrong in the way that the data is being measured. 1130

Biased from method of collecting or measuring your cases or variables.1134

Those kind of biases are also dangerous because that is even when you have an 1158

unbiased sample, you might still have biased that comes from response biased.1165

We will first talk about sampling biased and then we will talk about response biased. 1171

Sampling biased will come from bad sampling methods, already skewed sampling methods. 1177

One sort of bad biased that you want to avoid is biased that comes from size biased.1186

The size biased is whenever you have a method that gives a larger individual, the better chance. 1193

Method gives larger individuals more chance of being in the sample. 1200

For instance, let us say you wanted to collect data on insects from various places, various lakes in your state.1221

You have a map of the state and you decide to drop a handful of rice from up here and 1234

just throw it and wherever the rice lands I’m going to go to that pond or lake to collect some insects. 1241

Now, the problem with that is that bigger lakes will have a greater chance of being landed on by the rice 1250

and so those bigger lakes will be overly represented in your sample and the smaller lakes would not.1257

That is often a poor method of sampling.1264

Another biased method of sampling is when you ask people to volunteer to be in a sample.1274

Letting people volunteer to be in the sample. 1284

Sometimes this sampling method is used, but it should be always noted that this has a biased in it.1295

For instance, you might only collect data from people who care more or more passionate about this issue 1301

or maybe they are people who have more time on their ends.1310

One thing might be when people send out an email survey and ask people would you take some time to fill it out?1314

People who check their email more.1321

People who are online at work all the time.1323

Those might be the people that are overly represented in your sample when perhaps you just want a sample from just regular people from all acts of life.1326

Voluntary response bias is often something that comes about. 1338

Now another very, very common bias or biased sampling method rather is a convenient sample.1342

Basically the idea is take whatever is handy, so maybe you want to know about adolescent behavior, 1353

but you just sample from people in your high school because you go to that high school.1365

This is a really frequent sampling method and most a lot of social science studies for better or for worse. 1374

A lot of universities have a subject pool where people can participate in studies and those are just university students.1385

Even though these social science studies want to know about human behavior with a real yet information is people taking psych 101 for college students. 1394

So that is a pretty biased sample. 1407

Really, it is just using whatever is handy so the people around you, the people in your school, the people who happen to be at a particular location. 1411

Maybe if you are a biologist, you would sample ponds in a 10 mile radius around your institution.1423

All of those methods are biased because of convenience.1431

They are just based on the convenience.1437

Another biased sampling method is a judgment sample.1440

A judgment sample is one where you are trying to be representative.1449

You are really trying hard and because you trying to be representative, you actually get an expert 1453

or expert like reasons in order to pick certain people or institutions, or lakes, or whatever it is for your study.1458

Use expert judgment to select sample.1469

For instance, maybe a professor wants to do research on elementary schools.1483

How would he pick the elementary schools?1488

Well, one thing you might do is pick them based on socioeconomic status of the community 1490

and so he would have the even mixture of the different strata of SES in his community.1497

There he is trying to use his expert judgment and using expert knowledge in order to create a representative sample. 1508

Now the problem with this is that experts do not know everything.1518

Even with the best of intentions and the best and most updated knowledge, we might still have a biased sample 1522

because maybe we did not know that some factor was really important.1529

Or maybe because of the way we picked it there was systematic bias introduced.1533

The final thing is when you have what is called an inadequate sampling frame.1543

Sampling frame is the pool of potential cases.1549

The pool of potential cases that you are going to include in your study.1560

If you have a small sampling frame, if you say this is my pool of people that I’m going drop from them 1566

and then that would be worse than if you had a larger and more representative sampling frame.1574

Often this is the case when people get directories somehow, the telephone directory, not everybody is listed in the telephone directory 1579

and once you try to use the telephone directory in order to pick people who would be in your study 1589

that might be an inadequate sampling frame because you would systematically be biased against people 1595

who do not like to list their number publicly or who just recently moved or something like that.1601

Those are cases of a inadequate sampling frame where your pool of original potential cases was not big enough.1610

Let me say a final thing about these five different types of biased sampling methods.1622

They are bad, and I will put bad quotes, they are bad because they produce biased.1631

They are bad because they do not produce representative samples.1634

That is what I mean by bad.1644

It does not mean that they are not used.1646

If I quote used quite frequently, voluntary response bias is quite frequent, convenient sampling is a very common method.1648

Judgment samples are also very common.1659

Although they are bad, it is not that they are not used.1664

It is just that you need to know that when you read a study and it says that use the convenient sample, 1666

it is good for us to keep that in mind and take the results of the study with a grain of salt.1672

Here is the bad news, let us say somehow you figured out this great way to sample and you avoid size bias 1683

and voluntary response bias and you are not convenience sampling and you did not necessarily use expert judgments 1692

and you have a big enough sampling frame you can still have bias in your data.1699

It is crazy because even though you might try your hardest to avoid all of those things you might still have bias because of bad data collection method.1710

Once again by bad, I’m going to put that in quote because it is going to make it systematically biased but it is not that these are not common.1722

They are actually quite common.1731

The first kind of a bad data collection bias comes from what it is called nonresponse bias. 1734

Remember, a lot of studies are voluntary and so some people may just not want to participate, they might not volunteer. 1744

They might decline being part of your sample.1754

And so those people who choose not to respond, you do not have data on them but they might be very important to the population.1757

There are systematically not represented in the population. 1767

The nonresponse bias is you could think of it as the who bias.1772

You systematically avoid to the sample is missing the people who do not want to respond for whatever reason. 1781

For instance, in that case where you email out a survey those people who do not respond 1805

even though you emailed out the survey to perfectly representative group of people.1811

The people who choose not to finish the survey, you are not going to have data for them.1818

Let us say you want to do a study on whether teachers and their teaching methods change over time 1824

and you want to go into teachers classrooms but you have to have their permissions.1837

Now the teachers to choose not to participate in your study, we do not know about their behavior. 1843

We do not know about their teaching methods and who knows why they do not want to participate. 1849

Maybe they are such awesome teachers and they just want to focus on their students.1853

Or maybe they are terrible and they are ashamed and so they would not want anybody going in there watching them.1857

You never know and those nonresponses are actually stealing your data. 1864

The other bad data collection method is the bias from bad data collection methods is what we call a questionnaire bias.1871

A questionnaire bias is very broad and this is sort of what I think of as the how bias because the way you word something, 1881

the way you word a question, the tone of voice that you ask, the context in which you ask, the order of questions. 1893

All of these things affect the answer. 1913

Because of that, it is very hard to avoid the questionnaire bias.1926

All of these tiny little variables actually might affect the way that your data is collected, the kind of data that gets collected.1933

Let me just give you an example. 1942

This sort of famous example by Amos Traverski, a Nobel prize-winning economist and behavioral economists.1947

He asked people these two questions. 1960

Basically in one situation, they said okay I want you to tell me which one of these things you are going to choose.1968

First I’m going to give you $100 then I’m going to give you a risky choice versus a safe choice.1978

I want you to tell me which of these two choices that you want to take with your $100.1997

One is take a risk, you put the coin and if you get the heads you will lose nothing but if you get tails you will lose that $100.2003

That is the risky choice.2027

The safe choice is this, I will just give you $50.2029

People obviously will choose this option because it is like “what I can lose money?” or you just give me $50.2049

For sure I’m just going to get the $50.2057

Sounds reasonable.2063

But let us say I ask the question slightly differently.2065

Here is $200, the risky choice remains the same.2068

Heads you will lose nothing, tails you will lose $100.2077

It does not sound like a great choice, right2086

What is the safe option this time?2090

Now the safe option is you lose $50.2093

Let us think about this for a second.2106

A lot of people would say I’m going to go to this option.2108

Let us think.2114

In the first game, if you have $100 I will give you $50, you would end up with $150 here.2117

That is your choice.2126

Here you have a chance of losing 0 or losing 100.2129

Here if I put safe, I will still end up with $150.2135

All of a sudden, this option looks so terrible compared to this one and the same choice was this option looks good compared to this one.2148

One of the things they found is that one thing is people are really sensitive to this framing in terms of classes starting 2163

with $200 and going down to $150 is a lot worse than starting with $100 and going up to $150.2169

Even though the $150 is exactly the same.2175

People are very lost adverse.2179

The second thing is that people are more likely to take risks when you frame things in terms of loses.2183

All of a sudden, risks sounds pretty good to us.2190

But if we frame things in terms of games then risks sounds terrible and we rather have the safer option. 2193

What they have done is that they have shown us with saving lives, saving the environment, like all kinds of stuffs.2201

People make choices differently when you frame the question in terms of losses or in terms of games, in terms of risk or safety.2208

All of those things play a role.2217

This is just a small example, but you could see that every question that we work we have all kind of choices in how we asked it.2220

We could ask people are you feeling anxious rate on a scale of 1 to 4 or we can ask the exact opposite are you feeling calm?2229

We can ask either one of those and get to same idea that we wanted to get to. 2239

So how do you choose?2245

To those are questionnaire biases when we have bad data collection methods. 2248

The final bias from bad data collection is when we have incorrect responses or measurement bias.2254

Incorrect responses are pretty straightforward, but it is also sort of unavoidable.2262

These are things like maybe you ask people questions and they have incorrect memories or maybe sometimes they straight up why?2268

Nothing says that people cannot lie to you.2281

Maybe people will be like did you vote in the last election?2284

Maybe somebody asked that on a survey.2290

Maybe people say that they did not but I have thoughts about it, so that is sort of like voting or my candidate won anyway so it is like I voted.2292

Maybe they might just check off yes or maybe you might ask them did you know you follow the doctor's instructions since the last time last doctor's visit?2299

People might look back and say I did not do it every day, but I did it like twice.2316

Sure I followed all the doctors instructions.2322

People might be well-meaning and still end up having an incorrect response, or they may be generally trying to remember did I do that2327

I do not know.2335

Maybe I think I did and maybe just convince themselves that they did do it.2336

Incorrect responses have a lot of different sources but they are unavoidable.2341

They are very hard to avoid anyway. 2347

The other thing is measurement bias.2350

Something about the way your measuring it is wrong.2352

For instance, let us say you wanted to measure people heights but your ruler is sort of worn down on one side.2356

Then your measurement tool is already off.2366

Maybe you are collecting people’s times on the stopwatch, but your stopwatch is off.2370

Things like that make it to problematic for you. 2376

Actual measuring tool is off.2379

These are all kinds of biases that might come from bad data collection methods.2389

By bad I just mean that they result in systematic bias.2395

Although they are going to be ways that we can try to mediate some of the things, we could try to build in some checks and balances.2398

We could do a lot of other things.2409

A lot of these times these biases even though we try as best we can, they do not completely go away. 2412

There always sort of their lurking in the background and whenever you meet a study you want to watch out for these different biases. 2420

Let us start with some example. 2433

People generally want to appear knowledgeable and agreeable even to strangers, how might that affect 2436

the result of a telephone survey conducted by a school on the satisfaction of graduates with their education?2441

What biases should we worry about?2448

Well, one thing we want to start off with is the biases that come from sampling methods.2451

Sampling method bias.2459

Would people's desire to appear knowledgeable and agreeable, would that somehow biased this?2461

I think mostly, it probably would not affect the sampling method because the sampling method we will be choosing who to call.2475

It probably would not affect that but it may affect the response biases.2484

First out of sampling or selection bias versus response bias, those are the two different kinds of biases that we could choose from. 2492

It is probably the desire to appear knowledgeable and agreeable or most likely affect the response biases more than the sampling bias.2515

Sampling you have the desires of the participant have served less to do with it than the desires of the experimenter or researcher. 2526

We are going to have to worry about response bias.2543

One thing might be is would this desire affect the nonresponse bias.2545

Perhaps because perhaps the people who choose to actually take part in the telephone survey, those people might be the ones who really want to please people.2556

You might get people pleasers over represented and maybe there are people who are less social or less agreeable but they would be underrepresented.2570

As for questionnaire bias, perhaps there might be some of that bias but that would depend mostly on the question and less on the participant themselves.2591

The other thing that we probably do have to worry about is the incorrect responses.2604

People might try to think back and when they think back and somebody ask them do you think college really was valuable to you 2616

or how satisfied are you with your educational experience.2626

They might think back and just remember all the good times or their favorite professors 2630

and they might forget all their useless professors or classes they thought were so useless.2638

They might incorrectly remember or have a bias in their memories.2648

Or maybe it might just be as simple as you know, maybe some of them went to a game 2656

or something recently for their school and some of that school spirit gets activated and it may have nothing to do with educational experience. 2664

But still color their thoughts about their educational experience.2672

I would say that the two biases that we should worry about the most are nonresponsive and incorrect response bias.2679

Examples 2, at a meeting of local democrats the organizers wanted to estimate how well the party will do in the next election.2689

They use the people at the meeting for their sample.2696

What biases might arise?2699

Already we know that this is going to entail sampling bias.2701

The sampling bias is definitely going to be part of it.2708

Out of the different types of sampling bias which of these might be involved?2712

Sampling bias is not really a thing here because it is not that bigger people are going to be more represented 2717

by the bigger donors are represented or may be bigger donors.2726

That might be a possibility but really the problem is going to be voluntary response bias. 2739

The reason is that these people volunteered to come to this meeting so it is definitely the people who are carrying 2752

maybe their extreme democrats, maybe they hate republicans, whatever it is these people are volunteered that are there not randomly, 2760

but because they really chosen to be there that night.2770

Also another thing that we see that is that this is definitely a convenient sample. 2775

They are just taking the people who can do that.2780

It is a convenience sample certainly, it is not a judgment sample because these people were not picked for some reason.2783

Definitely they had an inadequate sampling frame, but that sort of goes along with convenient sample.2791

Because of these sampling biases we know that the sample is already biased other than any response biases 2799

that might be working here in the background. 2810

Certainly, there is the nonresponse bias.2814

All the people who did not come to the meeting for whatever reason maybe they are republicans, maybe they are democrats, but they are not that into it.2820

Maybe they are independent and they did not want to go to meeting for democrats, even though they are interested in this candidate.2821

The nonresponse bias is important to note.2838

There might be incorrect responses because of this biased sample.2845

They might ask them do your friends vote democrat and a lot of when they think back, 2856

when they think about their democratic friends because they are sort of in the democratic context.2867

They might have incorrect responses that stand from poor context.2873

Context is the questionnaire bias.2888

Questionnaire bias is when something about the way that it is asked changes the answer. 2894

If an organizer of a democratic meeting asks the question, maybe these people will say yes I am very democrat or I am very interested.2902

Example 3, a news magazine conducted a poll in Americans asking them to agree or disagree with one of two statements.2917

Statement 1, the government should try to balance their budget with both spending cuts and taxes.2924

Statement 2, I will be disappointed if taxes were raised this year. 2931

What kind of biases should we worry about?2935

Let us break this down real quick.2939

Does it say anything about sampling?2944

It did not say anything about sampling. 2948

We have no idea how their sampling so we can pretty much rule out sampling bias because it has nothing about sample. 2949

We are probably got to be focusing on the response biases.2957

We do not know how they are asking so we cannot really say anything about the nonresponsive, 2962

but it definitely seems like there are questionnaire biases that work here.2967

Because maybe people say government should definitely try to balance their budget.2978

They might say that they agree but they might also agree with this statement that they will be disappointed if taxes are raised this year.2984

People might use this statement to say Americans are in favor raising taxes as well as spending cuts 2996

and then somebody might use this to say Americans are very against raising taxes 3004

because they would be disappointed if taxes were raised this year.3010

Even though people might probably agree with both of these statements, it does not necessarily mean that they are against each other.3015

It is not that they are being internally inconsistent or hypocritical.3030

It is mostly because of the way these things are worded.3033

Of course we might say the government should try this.3039

It is pretty meek and it is not saying that the determinant has 2 but also this statement is pretty weak too.3043

It is just saying I would be disappointed if taxes were raised this year.3052

It is not saying I would move to Canada if taxes were raised this year. 3056

I would hate my politicians if the taxes are raised this year.3062

Because of the way that these statements are worded, you might be able to push people to sort of agree 3064

or disagree with the statement that with the idea that taxes are bad or good.3072

Questionnaire bias is definitely one.3081

Would there be an incorrect answer bias?3083

Not necessarily if they had worded these differently people would probably have a different opinion. 3089

That is still a question nearby more than incorrect response bias.3096

Let us say questionnaire biases are the only one here. 3101

And finally, in example 4 it says to estimate how many students in the city have passed the AP statistics test.3106

A researcher post a message on the website asking local teachers to report how many students took the exam and how many students passed?3113

What kind of biases shall we worry about?3120

Definitely we know that their sampling being mentioned here, the way that the researcher is sampling 3123

is that they are posting a message on our website and asking local teachers to respond.3128

There is definitely sampling bias. 3136

First of all, it is probably true that these people are only going to do this if they are volunteering.3144

There is voluntary response bias.3153

Also it is skewed towards people who are going to this website and so that is sort of a convenient sample.3160

You are only taking people who happen to come to this website anyway.3175

Let us see.3183

These are really the two big ones being perpetrated here, but in addition to sampling bias there is also some response biases at work here. 3188

Definitely there is the nonresponse bias.3207

That is because there are going to be teachers who are not reporting anything. 3215

Maybe they had 0 students take the AP exam or they have 0 students that actually pass and maybe they are ashamed.3218

Or maybe that some of the teachers were quite influential in teaching AP statistics they might just not be on the website.3227

Or maybe they do not have time to respond.3237

That is one definite problem.3241

Another problem might be incorrect responses.3244

Maybe some teachers will just misremember how many of their students actually took or pass the exam or they might have been incorrect for other reasons.3256

They might just have been off for other reasons.3267

The nonresponse and the incorrect response bias that is probably there.3270

That is it for sampling and biases.3279

Thanks for using