Where The Curve Turns Twice
You sweep the width multiplier of a ResNet on a CIFAR-10 training set carrying 15% label noise, holding the optimizer, epochs and data fixed, and record final errors:
| width | train error | test error |
|---|---|---|
| 4 | 24.0% | 33.1% |
| 10 | 7.9% | 27.4% |
| 18 | 0.0% | 36.2% |
| 26 | 0.0% | 29.0% |
| 64 | 0.0% | 21.3% |
Where does the interpolation threshold sit, and what does the classical bias-variance reading get wrong here?
Sign in to answer questions and track your progress
Sign In