The t-distribution (also called Student’s t-distribution) is a probability distribution used to estimate population parameters when the sample size is small and the population standard deviation is unknown. It is bell-shaped and symmetric like the normal distribution, but it is shorter at the peak and has heavier (fatter) tails. As the degrees of freedom increase, the t-distribution approaches the standard normal distribution and becomes almost indistinguishable from it.
In short, the t-distribution accounts for the extra uncertainty that comes from estimating the standard deviation from a small sample rather than knowing it for the whole population. It is denoted by the letter ‘t’, and it sits at the heart of the t-tests and confidence intervals that researchers rely on every day.
“It is usual, however, to assume a normal distribution… when we are dealing with the means of small samples, this assumption is not justified.” The t-distribution was introduced by William Sealy Gosset, who published it in 1908 under the pen name ‘Student’ while working as a chemist at the Guinness brewery in Dublin.— Student (W. S. Gosset), “The Probable Error of a Mean”, Biometrika, 1908