You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Tuning at end of King County example does not improve score #142
"Tuning does not improve our test score. It's possible the tuned model does not generalise any better, or that, by chance, we're just doing worse on this particular test set. As the difference is so small, further analysis will likely not settle the issue either way, and we're probably happy to use the simpler, untuned model, or the random forest model with similar performance (or try tuning the random forest model as well). "
Activity
ablaom commentedon Apr 12, 2024
I think we can just add a sentence like,
"Tuning does not improve our test score. It's possible the tuned model does not generalise any better, or that, by chance, we're just doing worse on this particular test set. As the difference is so small, further analysis will likely not settle the issue either way, and we're probably happy to use the simpler, untuned model, or the random forest model with similar performance (or try tuning the random forest model as well). "