[ SLANG ][ AI ][ NOUN ]
When a model's training data accidentally (or not-so-accidentally) includes the actual questions and answers from a benchmark it's later evaluated on, inflating its score without reflecting genuine improved capability.
REAL-WORLD EXAMPLE
"Turns out that shockingly high score was just benchmark contamination, the test questions were sitting in the training set."
LORE & ORIGIN
Named directly by AI researchers auditing suspiciously high benchmark results, borrowing 'contamination' from the same concept in data science where test data leaks into a training set.
FIRST SEEN
2023
PEAK POPULARITY
2023-2026 (Current Era)
CURRENT STATUS
Mainstream Slang
Related To:Eval GamingEval Awareness
EQUIVALENT CONCEPTS IN OTHER LANGUAGES
AURA IMPACT β
+15 AURA
TREND STATUS
β HIGH RISING FAST Β· MODERATE
CULTURE CATEGORY
[ SLANG ][ AI ][ NOUN ]
RELATED TERMS
MENTIONS OVER TIME
2023202420252026
RELATED SEARCHES
>what is benchmark contamination?>benchmark contamination meaning?>benchmark contamination examples?>benchmark contamination vs eval gaming?>eval awareness meaning?
RELATED TOPICS
TOP PLATFORMS
TikTok
52%
YouTube
20%
Twitter / X
14%
Reddit
9%
Others
5%
WHEN DID YOU FIRST HEAR THIS?
CLICK AN OPTION BELOW TO CAST YOUR VOTE.
[ VOTE TO REVEAL COMMUNITY RESULTS ]