Lost in Aggregation: How Benchmarks Overlook Irreplaceable Model Strengths

Tabular machine learning benchmarks typically summarize performance by averaging scores, ranks, or pairwise wins across datasets. Such aggregates are useful for selecting robust default models, but they can obscure a different question: which models are necessary to attain peak performance on partic...