Sampling Distribution of the Mean and Standard Deviation in Various Populations

The sampling distributions for the sample mean and the sample standard deviation are explored for a finite population, as well as several infinite populations (normal, uniform, Laplace, gamma). All distributions are chosen to have the same mean, , and standard deviation, , as the finite population. The finite population consists of the marks of 256 students on a midterm test. The population distribution is shown in the top plot. The bottom plot shows normal approximation to the sampling distribution (exact for the sample mean if the population is also normal) and its empirical estimate using the histogram. These histograms are available sample sizes, and for 1000, 5000 and 10000 samples at a time.
From the central limit theorem, the sampling distribution of the sample mean is approximated by for infinite populations. In the finite population case, the standard deviation is reduced slightly due to the finite-sample correction factor (see the Details section).
The sampling distribution for the sample standard deviation is more complicated, but as increases it is also approximated by a normal distribution. However, in this case, we need to use simulation to estimate the parameters in the approximating normal sampling distribution.
In all cases, as increases, the sampling distribution becomes more concentrated about the true parameter and the normal distribution approximation improves.
It is interesting that in the case of the mean, all sampling distributions converge to the same distribution as expected by the central limit theorem. But the sampling distribution for the standard deviation is very complex analytically for non-normal populations. Our computer experiments illustrate that it is approximately normal. Notice these distributions, although all approximately normal, depend on the population distribution.
The sensitivity of the results to random variation may be explored by varying the random seed.


  • [Snapshot]
  • [Snapshot]
  • [Snapshot]
  • [Snapshot]
  • [Snapshot]
  • [Snapshot]
  • [Snapshot]


In the infinite population case, the sample mean has a normal distribution with mean 76 and standard deviation , where is the sample size.
Sampling in the finite population is without replacement. In this case, the variance of the sampling distribution for the mean is adjusted by multiplying by the finite population correction factor , where is the population size.
[1] I. McLeod, "Simple Random Sampling," Encyclopedia of Statistical Sciences, Vol. 12, 2nd ed. (S. Kotz, C. B. Read, N. Balakrishnan, and B. Vidakovic, eds.), New York: Wiley, 2005 p. 7740.
    • Share:

Embed Interactive Demonstration New!

Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details »

Files require Wolfram CDF Player or Mathematica.

Mathematica »
The #1 tool for creating Demonstrations
and anything technical.
Wolfram|Alpha »
Explore anything with the first
computational knowledge engine.
MathWorld »
The web's most extensive
mathematics resource.
Course Assistant Apps »
An app for every course—
right in the palm of your hand.
Wolfram Blog »
Read our views on math,
science, and technology.
Computable Document Format »
The format that makes Demonstrations
(and any information) easy to share and
interact with.
STEM Initiative »
Programs & resources for
educators, schools & students.
Computerbasedmath.org »
Join the initiative for modernizing
math education.
Step-by-Step Solutions »
Walk through homework problems one step at a time, with hints to help along the way.
Wolfram Problem Generator »
Unlimited random practice problems and answers with built-in step-by-step solutions. Practice online or make a printable study sheet.
Wolfram Language »
Knowledge-based programming for everyone.
Powered by Wolfram Mathematica © 2018 Wolfram Demonstrations Project & Contributors  |  Terms of Use  |  Privacy Policy  |  RSS Give us your feedback
Note: To run this Demonstration you need Mathematica 7+ or the free Mathematica Player 7EX
Download or upgrade to Mathematica Player 7EX
I already have Mathematica Player or Mathematica 7+