Home Statistical Dictionary Analysis of Variance

Analysis of Variance

A statistical framework for testing whether the means of three or more groups are equal, by comparing the variability between group means to the variability within groups.

Hypothesis TestingIntermediateFree

In Plain English

Analysis of variance, ANOVA, answers a question that a simple t-test can't: are the means of three or more groups all the same, or does at least one differ? Its clever trick is right there in the name, it works entirely by comparing two kinds of variance, how much the group means spread out from each other, versus how much individual observations spread out within each group. If the between-group spread is much larger than you'd expect from within-group noise alone, that's evidence the group means genuinely differ.

Definition

Analysis of variance (ANOVA) tests the null hypothesis that the means of groups are all equal, by comparing between-group variability (how much group means differ from the overall grand mean) to within-group variability (how much individual observations differ from their own group's mean), via the F-statistic , where each mean square is a sum of squares divided by its degrees of freedom. Under the null hypothesis of equal group means, follows an F distribution, a large F-statistic indicates the between-group variability is larger than within-group noise alone would explain, evidence that at least one group mean genuinely differs. ANOVA generalizes directly to more complex designs, factorial (two-way and higher) ANOVA for multiple categorical factors, repeated measures ANOVA for correlated observations, and ANCOVA for models incorporating a continuous covariate alongside categorical group membership.

Formula

Notation

Mean square between groups (between-group variability, adjusted for degrees of freedom)
Mean square within groups (within-group variability, adjusted for degrees of freedom)

Properties

  • ANOVA is exactly equivalent to a two-sample t-test in the special case of exactly two groups, F = t², this equivalence is a useful mental check: ANOVA isn't a fundamentally different tool from the t-test, it's the natural generalization of the same mean-comparison logic to more than two groups.
  • A significant overall ANOVA F-test tells you that at least one group mean differs from the others, but not which one(s), this is exactly why a significant ANOVA is typically followed by post-hoc pairwise comparison tests (like Tukey's HSD or Scheffe's test), which identify specifically which group pairs differ while controlling the overall false-positive rate across all the pairwise comparisons.
  • ANOVA's decomposition of total variability into between-group and within-group components traces back to Ronald Fisher's work at Rothamsted Experimental Station in the 1920s, developed specifically for analyzing agricultural field trials with multiple treatment groups, the same origin as much of modern experimental design theory.

At a Glance

Testswhether the means of 3 or more groups are all equal
Core logiccompare between-group variability to within-group variability
Reference distributionthe F distribution
Generalizes tofactorial ANOVA, repeated measures ANOVA, and ANCOVA
Last updated August 8, 2026← Back to the Dictionary