Math and statistics

The normal distribution without the mystery

The bell curve shows up everywhere: exam scores, heights, measurement error, hypothesis test results. Yet many people use the normal distribution as a memorized recipe: find the z in a table, read a number, and hope they looked at the right column. The mystery disappears once you grasp three simple ideas. First, the curve needs only two numbers, the mean and the standard deviation. Second, the z-score swaps the original unit for "how many standard deviations above or below the mean", which lets you compare things that have nothing in common. Third, probability is area under the curve, and every question like "what is the chance of exceeding X?" is just picking the right area. This guide walks through those ideas with numbers checked by the [normal distribution calculator](tool:calculadora-distribuicao-normal), shows the curve as a chart, and ends with the mistakes that mislead most often.

J-Kit9 min readIntermediate
  • Normal distribution
  • Z-score
  • 68-95-99.7 rule
  • P-value
  • Statistics

Key takeaways

  • The normal is defined by μ (mean) and σ (standard deviation). Every probability question becomes an area under the curve.
  • z = (x − μ) ÷ σ says how many standard deviations x is from the mean. It is what lets you compare 82 points on one exam with 640 on another.
  • The 68-95-99.7 rule is an approximation: the exact values are 68.27%, 95.45% and 99.73%. And it only holds if the data really are approximately normal.
  • A z of 1.96 gives a two-sided p-value of 0.05, and the one-sided 5% cutoff is 1.645. Mixing the two up is one of the most common errors in hypothesis testing.

What the normal curve describes

The normal distribution is a symmetric curve, tallest at the middle and falling fast to both sides. The NIST statistics handbook writes its density with two parameters: μ, the location parameter, which says where the center is, and σ, the scale parameter, which says how wide the curve is. The case μ = 0 and σ = 1 is called the standard normal. Changing μ slides the curve sideways without altering its shape; increasing σ flattens and widens it, because the same total area (which is always 1) has to spread out further.

f(x) = exp( −(x − μ)² ÷ (2σ²) ) ÷ ( σ × √(2π) )
μ
the mean, the center of the curve.
σ
the standard deviation, which controls the width.
x
the value whose curve height you want.
The normal density. It only gives the height of the curve at each point; what answers "what is the chance" is the area under it.
00.10.20.30.4-404Distance from the mean (in x units)Densityσ = 1σ = 2
The standard normal curve (σ = 1) and a wider one (σ = 2), from −4 to 4. Both have total area 1, which is why the σ = 2 curve is lower. Peak of the standard curve: 0.3989.
View the data
xσ = 1σ = 2
-400.03
-300.06
-20.050.12
-10.240.18
00.40.2
10.240.18
20.050.12
300.06
400.03

Z-score: measuring everything in standard deviations

To use a standard normal table, every value has to be converted. The NIST table page says exactly that: standardize your value by subtracting the mean and dividing by the standard deviation, then look up the result. That result is the z-score, and it has no unit: it is "how many standard deviations above (positive) or below (negative) the mean".

z = (x − μ) ÷ σ
With mean 100 and standard deviation 15, the value 130 gives z = (130 − 100) ÷ 15 = 2.
Three values on a scale with mean 100 and standard deviation 15 (like IQ-style tests), with z and percentile.
Value xzPercentile (P(X ≤ x))Above x
70−22.28%97.72%
85−115.87%84.13%
130297.72%2.28%

The real power of z shows when comparing different scales. Suppose 82 points on an exam with mean 70 and standard deviation 8, and 640 points on another with mean 500 and standard deviation 100. In raw numbers you cannot say which was better. In z terms: the first result has z = (82 − 70) ÷ 8 = 1.5 (93.32nd percentile) and the second has z = (640 − 500) ÷ 100 = 1.4 (91.92nd percentile). The first score was relatively better, even though it looks "smaller".

The 68-95-99.7 rule

The empirical rule is the normal’s mental shortcut: about 68% of values fall within 1 standard deviation of the mean, 95% within 2 and 99.7% within 3. The exact values, which the calculator returns, are 68.27%, 95.45% and 99.73%. Applied to the scale with mean 100 and standard deviation 15, the rule becomes three concrete ranges.

Empirical rule with μ = 100 and σ = 15.
RangeIntervalRuleExact
μ ± 1σ85 to 11568%68.27%
μ ± 2σ70 to 13095%95.45%
μ ± 3σ55 to 14599.7%99.73%

Areas, percentiles and computed examples

Every probability question on the normal follows the same path: standardize, choose the region (below, above, between or outside) and read the area. The inverse exists too: given a percentile, find the value. The examples use exam scores with mean 70 and standard deviation 10, and the scale with mean 100 and standard deviation 15.

  1. Who scores above 85?z = (85 − 70) ÷ 10 = 1.5. The area to the right of 1.5 is 6.68%. About 1 in 15 students.
  2. Who scores above 60?z = (60 − 70) ÷ 10 = −1. The area to the right of −1 is 84.13%, the complement of the 15.87th percentile.
  3. What is the cutoff for the top 10%?Find the z that leaves 10% on the right: 1.2816. Then x = 70 + 1.2816 × 10 = 82.82.
  4. Between which values do the central 95% fall (μ = 100, σ = 15)?z = ±1.96, so from 100 − 1.96 × 15 = 70.60 to 100 + 1.96 × 15 = 129.40.
  5. What is the chance of landing between 90 and 110 (μ = 100, σ = 15)?z runs from −0.667 to 0.667. The area between them is 49.50%, well below the 68% for ±1σ, because the interval is narrower than 1 standard deviation.

Try your own values in the tool below: it draws the shaded area, shows the z of each limit and also solves the inverse direction (from percentile to value).

Normal distribution calculator: probabilities, z-score, percentiles and p-value with the area chart.Open the tool full page

P-values and critical values

In a z test, the p-value is the area in the tails beyond the observed statistic. In a two-sided test both tails count; in a one-sided test only one does. A z of 1.96 leaves 2.5% in each tail, hence the two-sided p of 0.05. A z of 2.5 gives p = 0.0124; a z of 1.8 in a right-tailed one-sided test gives p = 0.0359. The critical values below are the ones that come up most.

Most-used critical z values.
ConfidenceαTwo-sided zOne-sided z
90%0.101.6451.282
95%0.051.9601.645
99%0.012.5762.326
99.9%0.0013.2913.090

When the population standard deviation is unknown and the sample is small, the reference becomes Student’s t distribution, with heavier tails. With a statistic of 2.1 and 9 degrees of freedom, the two-sided p is 0.0651 and the test does not reject at 5%. The same statistic read as a z would give 0.0357 and would reject. Choosing the wrong distribution changes the conclusion. The hypothesis test calculator helps set up the full test.

Common mistakes

Assuming the 68-95-99.7 rule works for any data

It describes the normal curve, not data in general. Check the shape with a histogram. On skewed data, the share within 2 standard deviations can be quite different from 95%.

Mixing up two-sided and one-sided

The critical z at 5% is 1.96 two-sided and 1.645 one-sided. Using the wrong one doubles or halves your real significance level. Decide the direction of the test before looking at the data.

Reading the curve’s height as a probability

Density can exceed 1 on narrow curves and is not a probability. Probability is always area. The chance of an exact value is zero; only intervals have a chance.

Using the wrong standard deviation

The z of one observation uses the standard deviation of the data. The z of a sample mean uses the standard error, σ ÷ √n. Swapping one for the other makes a result look far more (or far less) extreme than it is.

Treating a "large z" as certainty

A z of 3 leaves 0.27% in the two tails combined. Rare is not impossible: among thousands of observations, a few z values above 3 are expected. A low p-value does not prove the effect is large or that the hypothesis is false.

Frequently asked questions

What is a z-score?
It is the distance from a value to the mean measured in standard deviations: z = (x − μ) ÷ σ. A z of 2 means two standard deviations above the mean; a z of −1, one below. Because it has no unit, it lets you compare values from different scales.
How does the 68-95-99.7 rule work?
In approximately normal data, about 68% fall within 1 standard deviation of the mean, 95% within 2 and 99.7% within 3. The exact values are 68.27%, 95.45% and 99.73%. For heavily skewed data the rule does not hold.
What is the difference between z and t?
The normal (z) assumes the population standard deviation is known. Student’s t is used when it is estimated from the sample, especially with small samples, and has heavier tails. With many degrees of freedom the two become practically the same.
Why does 1.96 appear so often?
Because it is the z that leaves 2.5% in each tail, i.e. 95% in the middle. It is the two-sided critical value for the 95% confidence level, the most used in confidence intervals and tests.
Can I use the normal with any data set?
No. It is a model. Before using it, look at the histogram and check for skew and extreme values. For means of large samples the normal is usually a good approximation, but for skewed individual data it can mislead.

The normal distribution boils down to a mean, a standard deviation and areas under a curve. The z-score converts any value into standard deviations and lets you compare different scales; the 68-95-99.7 rule gives the intuition (with exact values of 68.27%, 95.45% and 99.73%); and p-values and critical values are just tail areas. The essential care is to check that the data really are approximately normal, to choose one or two tails before looking at the result, and not to confuse standard deviation with standard error. With that, probability questions stop being a recipe and become a calculation you can explain.

Sources & references

  1. NIST/SEMATECH e-Handbook of Statistical Methods, 1.3.6.6.1 Normal Distribution
  2. NIST/SEMATECH e-Handbook, 1.3.6.7.1 Cumulative Distribution Function of the Standard Normal Distribution
  3. Mathwords, Empirical Rule