Machine Learning Foundations

Bias-Variance Tradeoff, explained

The bias-variance tradeoff describes the balance between models that are too simple to capture structure and models that are too sensitive to training data noise.
Back to Glossary

Part of the Semantic Notion technical glossary.

Short Definition

The bias-variance tradeoff describes the balance between models that are too simple to capture structure and models that are too sensitive to training data noise.

Intuition

High-bias models miss the pattern. High-variance models chase noise. Good generalization usually needs a balance.

Technical Definition

The tradeoff decomposes expected prediction error into bias, variance, irreducible noise, and interactions depending on the setting.

Example

A linear model may have high bias on nonlinear data, while a very deep tree may have high variance.

Common Misunderstandings

Bias here is statistical error, not social bias.
Modern deep learning complicates the simple textbook U-shaped curve, but the intuition remains useful.

Start here

Need the broader concept map?

Return to the glossary index to move from this definition into adjacent AI, ML, mathematics, and computer science terms.