The Sampling Distribution of a Sample Mean
Site: | Saylor Academy |
Course: | MA121: Introduction to Statistics |
Book: | The Sampling Distribution of a Sample Mean |
Printed by: | Guest user |
Date: | Saturday, September 7, 2024, 7:41 PM |
Description
First, this section discusses the mean and variance of the sampling distribution of the mean. It also shows how central limit theorem can help to approximate the corresponding sampling distributions. Then, it talks about the properties of the sampling distribution for differences between means by giving the formulas of both mean and variance for the sampling distribution. Using the central limit theorem, it also talks about how to compute the probability of a difference between means being beyond a specified value.
Sampling Distribution of the Mean
Learning Objectives
- State the mean and variance of the sampling distribution of the mean
- Compute the standard error of the mean
- State the central limit theorem
The sampling distribution of the mean was defined in the section introducing sampling distributions. This section reviews some important properties of the sampling distribution of the mean introduced in the demonstrations in this chapter.
Mean
The mean of the sampling distribution of the mean is the mean of the population from which the scores were sampled. Therefore, if a population has a mean , then the mean of the sampling distribution of the mean is also
. The symbol
is used to refer to the mean of the sampling distribution of the mean. Therefore, the formula for the mean of the sampling distribution of the mean can be written as:
Variance
The variance of the sampling distribution of the mean is computed as follows:
That is, the variance of the sampling distribution of the mean is the population variance divided by , the sample size (the number of scores used to compute a mean). Thus, the larger the sample size, the smaller the variance of the sampling distribution of the mean.
(optional) This expression can be derived very easily from the variance sum law. Let's begin by computing the variance of the sampling distribution of the sum of three numbers sampled from a population with variance . The variance of the sum would be
. For
numbers, the variance would be
. Since the mean is
times the sum, the variance of the sampling distribution of the mean would be
times the variance of the sum, which equals
.
The standard error of the mean is the standard deviation of the sampling distribution of the mean. It is therefore the square root of the variance of the sampling distribution of the mean and can be written as:
The standard error is represented by a because it is a standard deviation. The subscript
indicates that the standard error in question is the standard error of the mean.
Central Limit Theorem
The central limit theorem states that:
Given a population with a finite mean and a finite non-zero variance
, the sampling distribution of the mean approaches a normal distribution with a mean of
and a variance of
as
, the sample size, increases.
The expressions for the mean and variance of the sampling distribution of the mean are not new or remarkable. What is remarkable is that regardless of the shape of the parent population, the sampling distribution of the mean approaches a normal distribution as increases. If you have used the "Central Limit Theorem Demo," you have already seen this for yourself. As a reminder, Figure 1 shows the results of the simulation for
and
. The parent population was a uniform distribution. You can see that the distribution for
is far from a normal distribution. Nonetheless, it does show that the scores are denser in the middle than in the tails. For
the distribution is quite close to a normal distribution. Notice that the means of the two distributions are the same, but that the spread of the distribution for
is smaller.
Figure 1. A simulation of a sampling distribution.
The parent population is uniform. The blue line under "16"
indicates that 16 is the mean. The red line extends from
the mean plus and minus one standard deviation.
Figure 2 shows how closely the sampling distribution
of the mean approximates a normal distribution even when the parent
population is very non-normal. If you look closely you can see
that the sampling distributions do have a slight positive skew.
The larger the sample size, the closer the sampling distribution
of the mean would be to a normal distribution.
Figure 2. A simulation of a sampling distribution.
The parent population is very non-normal.
Source: David M. Lane, https://onlinestatbook.com/2/sampling_distributions/samp_dist_mean.html This work is in the Public Domain.
Video
Questions
Question 1 out of 5.
The population has a mean of and a standard deviation of
. The
sample size of your sampling distribution is
. What is the mean of
the sampling distribution of the mean?
Question 2 out of 5.
The population has a mean of and a standard deviation of
. The
sample size of your sampling distribution is
. What is the variance
of the sampling distribution of the mean?
Question 3 out of 5.
The population has a mean of and a standard deviation of
. The
sample size of your sampling distribution is
. What is the standard
error of the mean?
Question 4 out of 5.
The sampling distribution of the mean, with , of a moderately negatively skewed distribution is:
Positively skewed
Negatively skewed
About normal
Question 5 out of 5.
The entire student body of students
took a test. These test scores have a mean of
, a standard deviation
of
, and are slightly positively skewed. If you randomly chose
of
these test scores and calculated the mean over and over again, what
could be the mean, standard deviation, and skew of this distribution?
Mean = , SD =
, Skew =
Mean = , SD =
, Skew =
Mean = , SD =
, Skew =
Mean = , SD =
, Skew = about
Mean = , SD =
, Skew = about
Answers
- The mean of the sampling distribution of the mean is the mean of the
population from which the scores were sampled, in this case
.
- The variance of the sampling distribution of the mean is the population
variance divided by
. The population SD is
, so the population variance is
.
- The standard error is the standard deviation of the population divided by the square root of
. In this case,
- According to the central limit theorem, regardless of the shape of the
parent population, the sampling distribution of the mean approaches a
normal distribution as
increases. In this case, a sample size of
is sufficiently large to cause the sampling distribution of the mean to look about normal.
- Mean =
, SD =
, Skew = about
: This problem is asking about the sampling distribution of the mean: Mean =
, SD =
=
=
, Skew = about
because the central limit theorem states that the sampling distribution of the mean would be about normal with a large enough
.
Sampling Distribution of Difference Between Means
Learning Objectives
- State the mean and variance of the sampling distribution of the difference between means
- Compute the standard error of the difference between means
- Compute the probability of a difference between means being above a specified value
Statistical analyses are very often concerned with the difference between means. A typical example is an experiment designed to compare the mean of a control group with the mean of an experimental group. Inferential statistics used in the analysis of this type of experiment depend on the sampling distribution of the difference between means.
The sampling distribution of the difference between means can be thought of as the distribution that would result if we repeated the following three steps over and over again: (1) sample scores from Population
and
scores from Population
compute the means of the two samples (
and
), and (3) compute the difference between means,
. The distribution of the differences between means is the sampling distribution of the difference between means.
As you might expect, the mean of the sampling distribution of the difference between means is:
which says that the mean of the distribution of differences between sample means is equal to the difference between population means. For example, say that the mean test score of all 12 -year-olds in a population is and the mean of 10 -yearolds is 25. If numerous samples were taken from each age group and the mean difference computed each time, the mean of these numerous differences between sample means would be
.
From the variance sum law, we know that:
which says that the variance of the sampling distribution of the difference between means is equal to the variance of the sampling distribution of the mean for Population plus the variance of the sampling distribution of the mean for Population
. Recall the formula for the variance of the sampling distribution of the mean:
Since we have two populations and two samples sizes,
we need to distinguish between the two variances and sample sizes.
We do this by using the subscripts and
. Using this convention,
we can write the formula for the variance of the sampling distribution
of the difference between means as:
Since the standard error of a sampling distribution is the standard
deviation of the sampling distribution, the standard error of
the difference between means is:
Just to review the notation, the symbol on the left contains a sigma , which means it is a standard deviation. The subscripts
indicate that it is the standard deviation of the sampling distribution of
.
Now let's look at an application of this formula. Assume there are two species of green beings on Mars. The mean height of Species is
while the mean height of Species
is
. The variances of the two species are
and
, respectively and the heights of both species are normally distributed. You randomly sample
members of Species
and
members of Species
. What is the probability that the mean of the
members of Species
will exceed the mean of the
members of Species
by
or more? Without doing any calculations, you probably know that the probability is pretty high since the difference in population means is
. But what exactly is the probability?
First, let's determine the sampling distribution of the difference between means. Using the formulas above, the mean is
The standard error is:
The sampling distribution is shown in Figure 1 . Notice that it is normally distributed with a mean of 10 and a standard deviation of . The area above
is shaded blue.
Figure 1. The sampling distribution of
the difference between means.
The last step is to determine the area that is shaded blue. Using either a table or the normal calculator, the area can be determined to be
. Thus the probability that the mean of the sample from Species
will exceed the mean of the sample from Species
by
or more is
.
As shown below, the formula for the standard error of the difference between means is much simpler if the sample sizes and the population variances are equal. When the variances and samples sizes are the same, there is no need to use the subscripts and
to differentiate these terms.
This simplified version of the formula can be used for the following problem: The mean height of 15 -year-old boys (in ) is
and the variance is
. For girls, the mean is
and the variance is
. If eight boys and eight girls were sampled, what is the probability that the mean height of the sample of girls would be higher than the mean height of the sample of boys? In other words, what is the probability that the mean height of girls minus the mean height of boys is greater than
?
As before, the problem can be solved in terms of the sampling distribution of the difference between means (girls - boys). The mean of the distribution is
. The standard deviation of the distribution is:
A graph of the distribution is shown in Figure 2 . It is clear that it is unlikely that the mean height for girls would be higher than the mean height for boys since in the population boys are quite a bit taller. Nonetheless it is not inconceivable that the girls' mean could be higher than the boys' mean.
Figure 2. Sampling distribution of the
difference between mean heights.
A difference between means of or higher is a difference of
standard deviations above the mean of
. The probability of a score
or more standard deviations above the mean is
.
Video
Questions
Question 1 out of 4.
Population has a mean of
and a variance of
. Population
has a
mean of
and a variance of
. You sample
scores from Pop
and
scores from Pop
.
What is the mean of the sampling distribution of the difference between
means (Pop
- Pop
)?
The mean height of
Question 4 out of 4.
The
mean time to complete a task is millisecond for 3rd graders and
milliseconds for 5th graders. The variances of the two grades are
for 3rd graders and
for 5th graders. The times for both
grades are normally distributed. You randomly sample
3rd graders and
5th graders. What is the probability that the mean time of the 3rd
graders will exceed the mean time of the 5th graders by
msec or
more?
Answers
- The mean of the distribution of the difference between sample means is
equal to the difference between population means.
- The variance of the sampling distribution of the difference between
means is equal to the variance of the sampling distribution of the mean
for Pop
plus the variance of the sampling distribution of the mean for Pop
.
- Mean =
, SD =
, Plug these into the normal calculator and find the area above
. You get.
. A similar question using this data appears in the text.
- Mean =
=
, Var =
=
, SD =
=
, Use the normal calculator to calculate the area above
for a distribution with this mean and SD. You get
.