Benchmark Contamination Vs Eval Gaming?
6.9BRAINROT SCOREBENCHMARK CONTAMINATION— ORIGIN, MEANING & USAGE
Benchmark Contamination When a model's training data accidentally (or not-so-accidentally) includes the actual questions and answers from a benchmark it's later evaluated on, inflating its score without reflecting genuine improved capability.
EXAMPLE USAGE
"Turns out that shockingly high score was just benchmark contamination, the test questions were sitting in the training set."
EVAL GAMING— ORIGIN, MEANING & USAGE
Eval Gaming Optimizing an AI model specifically to score well on known benchmark tests, rather than to genuinely improve its real-world usefulness — teaching to the test rather than actually getting smarter.
EXAMPLE USAGE
"The benchmark score looks great but real usage feels the same as before, classic eval gaming."
BENCHMARK CONTAMINATION VS EVAL GAMING
When a model's training data accidentally (or not-so-accidentally) includes the actual questions and answers from a benchmark it's later evaluated on, inflating its score without reflecting genuine improved capability.
Optimizing an AI model specifically to score well on known benchmark tests, rather than to genuinely improve its real-world usefulness — teaching to the test rather than actually getting smarter.
In short: Benchmark Contamination (mainstream slang) and Eval Gaming (mainstream slang) are frequently used together in the same Gen Z/Alpha vocabulary, but describe distinct concepts — see the full entries for category tags, related terms, and live trend data.
Want the full breakdown — categories, trend velocity, platform distribution, and community voting on Benchmark Contamination? Visit the full dictionary entry for Benchmark Contamination.