Foundations 0/0

Foundations

Supervised learning

Learning a function from labelled examples with nearest neighbours, linear regression and logistic regression, and telling whether the model will hold up on data it has not seen. The train, validation and test split used here is the same one used to judge a language model.

0 / 30 solved

Questions

0/30 solved
Question Module Tags Difficulty Success
1. Majority Rules Nearest Neighbors & Evaluation Basics
knnclassification
Easy 76%
2. Everything Is The Same Distance Nearest Neighbors & Evaluation Basics
knncurse-of-dimensionality +2
Medium 60%
3. Too Cool, Too Chill Nearest Neighbors & Evaluation Basics
knnbias-variance
Easy 86%
4. Distance Weights Flip the Vote Nearest Neighbors & Evaluation Basics
knnweighted-voting +2
Easy 50%
5. Scaled Before Split Nearest Neighbors & Evaluation Basics
cross-validationdata-leakage +2
Medium 79%
6. Reading the Grid Nearest Neighbors & Evaluation Basics
confusion-matrixevaluation
Easy 43%
7. Same Ratio, Every Fold Nearest Neighbors & Evaluation Basics
cross-validationclass-imbalance
Easy 75%
8. The LOO Tax Nearest Neighbors & Evaluation Basics
cross-validationcomplexity
Medium 88%
9. Mean Versus Median Intercept Linear Regression
linear-regressionloss-functions +2
Medium 82%
10. Adding Noise Cannot Lower It Linear Regression
linear-regressionr-squared +2
Easy 50%
11. Funnel in the Residuals Linear Regression
linear-regressionheteroscedasticity +2
Medium 15%
12. Huber at a Residual of Ten Linear Regression
huber-lossrobust-regression +2
Medium 100%
13. The Free Intercept Linear Regression
bias-tricklinear-regression +1
Easy 100%
14. Normal Equation Roadblock Linear Regression
linear-regressionnormal-equation
Easy 75%
15. Ridge's Bias Trade Linear Regression
linear-regressionridge-regression
Medium 67%
16. Straight Line, Curved Squeeze Logistic Regression
logistic-regressionsigmoid +1
Easy —
17. Log-Odds Slope Logistic Regression
logistic-regressioninterpretation
Easy —
18. Raise the Bar Logistic Regression
thresholdprecision-recall +1
Easy —
19. Punish the Confident Wrong Logistic Regression
cross-entropyloss-function +1
Medium —
20. No Shortcut Formula Logistic Regression
optimizationbag-of-words +1
Medium —
21. Gradient At A Confident Mistake Logistic Regression
logistic-regressioncross-entropy +2
Medium —
22. Runaway Weights Logistic Regression
logistic-regressionseparability
Medium 50%
23. Gap Between the Lines Generalization
overfitting
Easy —
24. Where the Error Lives Generalization
bias-varianceunderfitting +1
Medium 59%
25. Wrong Medicine Generalization
underfittingbias-variance +2
Medium 33%
26. Three-Way Split Decision Generalization
train-val-test-split
Medium —
27. Will More Rows Help Generalization
learning-curvebias-variance +2
Medium —
28. Same Distribution, Different Day Generalization
iid-assumptioncovariate-shift
Medium 40%
29. Same Folds, Paired Comparison Generalization
cross-validationmodel-selection +2
Medium —
30. Inputs Look The Same Generalization
concept-driftdistribution-shift +2
Medium —