05:00
10:00
As MSE increases, RMSE also does, and \(R^2\) should decrease. And vice versa.
(notice that \(Y\) is measured in meters, m)
I’d say B is definitely the best but what’s after that?
| Case | RMSE | MSE | Case | RMSE | MSE | Case | RMSE | MSE |
|---|---|---|---|---|---|---|---|---|
| A | \(\approx 2 \mbox{ m}\) | \(\approx 4 \mbox{ m}^2\) | B | \(\approx 1 \mbox{ m}\) | \(\approx 1 \mbox{ m}^2\) | C | \(\approx 2 \mbox{ m}\) | \(\approx 4 \mbox{ m}^2\) |
| D | \(\approx 5 \mbox{ m}\) | \(\approx 25 \mbox{ m}^2\) | E | \(\approx 3 \mbox{ m}\) | \(\approx 9 \mbox{ m}^2\) | F | \(\approx 6 \mbox{ m}\) | \(\approx 36 \mbox{ m}^2\) |
| Case | \(\mbox{MSE}_\mbox{baseline}\) | Case | \(\mbox{MSE}_\mbox{baseline}\) | Case | \(\mbox{MSE}_\mbox{baseline}\) |
|---|---|---|---|---|---|
| A | \(\approx 2^2=4 \mbox{ m}^2\) | B | \(\approx 3^2=9 \mbox{ m}^2\) | C | \(\approx 2^2 = 4 \mbox{ m}^2\) |
| D | \(\approx 5^2=25 \mbox{ m}^2\) | E | \(\approx 5^2=25 \mbox{ m}^2\) | F | \(\approx 6^2=36 \mbox{ m}^2\) |
| Case | \(R^2\) | Case | \(R^2\) | Case | \(R^2\) |
|---|---|---|---|---|---|
| A | \(\approx 1- \frac{4\mbox{ m}^2}{4\mbox{ m}^2} = 0\) | B | \(\approx 1-\frac{1 \mbox{ m}^2}{9 \mbox{ m}^2} \approx 0.89\) | C | \(\approx 1- \frac{4\mbox{ m}^2}{4\mbox{ m}^2} = 0\) |
| D | \(\approx 1- \frac{25\mbox{ m}^2}{25\mbox{ m}^2} = 0\) | E | \(\approx 1- \frac{9 \mbox{ m}^2}{25 \mbox{ m}^2} = 0.64\) | F | \(\approx 1- \frac{49\mbox{ m}^2}{49\mbox{ m}^2} = 0\) |
The models in A, C, D, F just don’t really do much better than baseline at all…
A and D because the function is bad. Choose a nonlinear function next time! C and F just seem to have no interesting structure at all in them, it’s just useless data…
\(\mbox{RMSE}_C \approx 2 \mbox{ m} < 3 \mbox{ m} \approx \mbox{RMSE}_E\) but… \(R^2_C \approx 0 \ll 0.64 \approx R^2_E\)
\(\mbox{RMSE}_C \approx 2 \mbox{ m} < 3 \mbox{ m} \approx \mbox{RMSE}_E\) but… \(R^2_C \approx 0 \ll 0.64 \approx R^2_E\)
time_being_pet, which lm formula is most appropriate to predict hunger, based on the below visualization?formula = hunger ~ I(time_being_pet^2). Careful! poly(time_being_pet, degree = 2, raw = TRUE) wouldn’t be equivalent. Why?
In Latin
‘Dog’ is canis ([ˈka.nɪs])
(write this down)
In Latin
‘House’ is domus ([ˈdɔ.mʊs])
(write this down)
In Latin
‘Girl’ is puella ([puˈɛl.la])
(write this down)
Do you know Latin now? Let’s test you
Do you know Latin now? Let’s test you
What’s Latin for ‘dog’?
What’s Latin for ‘house’?
What’s Latin for ‘girl’?
Do you know Latin now? Let’s test you
Wow! 3/3??
Perfect! You clearly know Latin now!
What’s Latin for ‘trumpet’?
You overfitted!
You just learned the training set by heart because you have a complex brain ( = complex model) and you had a 100% score on the training set.
But when I tested you on new data you got 0% on the test set.
05:00
40:00
45:00
