Training Data Contamination Examples?
5.4BRAINROT SCOREtraining data contamination When items from a test or benchmark set end up in a model's training data, so the model has effectively seen the exam in advance and its scores overstate what it can really do. Often discussed as benchmark leakage.
Origin:A paper on benchmark leakage submitted to arXiv on April 29, 2024 describes the problem as a benchmark example, from the training or test split, appearing in a model's pretraining data. Wikipedia's data leakage article covers the related older machine-learning idea and methods such as Min-K% for detecting pretraining data.
First Seen:2020s (LLM evaluation discussion; dated paper April 2024)
Peak Era:2024-2026
Aura Impact:+1 Aura (Using It Correctly In Context)
EXAMPLE USAGE
""Its test score jumped, but training data contamination could explain why.""
Want the full breakdown — categories, trend velocity, platform distribution, and community voting on training data contamination? Visit the full dictionary entry for training data contamination.