Machine Learning Foundations

Train-Validation-Test Split, explained

A train-validation-test split separates data used for fitting, tuning, and final evaluation.

Part of the Semantic Notion technical glossary.

Short Definition

A train-validation-test split separates data used for fitting, tuning, and final evaluation.

Intuition

You train on one portion, make choices on another, and reserve a final portion to estimate how the model performs on unseen data.

Technical Definition

The split partitions available data into training data for parameter estimation, validation data for model selection, and test data for final performance estimation.

Example

A team may train on 70 percent of examples, tune on 15 percent, and report final metrics on the remaining 15 percent.

Common Misunderstandings

The test set should not guide iterative model decisions.

Random splits can be invalid for time-series or grouped data.

Same Category

More from Machine Learning Foundations

BackpropagationBackpropagation is the algorithm used to compute gradients through a neural network efficiently.Bias-Variance TradeoffThe bias-variance tradeoff describes the balance between models that are too simple to capture structure and models that are too sensitive to training data noise.Binary ClassificationBinary classification is a prediction task where each example belongs to one of two classes.DropoutDropout is a regularization technique that randomly disables parts of a neural network during training.FeatureA feature is an input signal used by a model to make a prediction or learn a representation.Feature EngineeringFeature engineering is the process of transforming raw data into model inputs that make useful patterns easier to learn.

Essays that use this concept

AI EvaluationHow to Evaluate AI Systems in Production

Start here

Need the broader concept map?

Return to the glossary index to move from this definition into adjacent AI, ML, mathematics, and computer science terms.

Browse Glossary