BUS265 Machine Learning and

Digital Technology
Lecture 4: In-class formative assessment

Dr Valentin Danchev School of Business and Management

Queen Mary University of London
Multiple-choice questions

• There is always a single good answer.

2
Multiple-choice questions

More complex models

• a) have better predictive performance
• b) tend to overfit more
• c) are easier to train than simpler models
• d) are very interpretable

3
Multiple-choice questions

In the following, choose the single best answer:

Cross-validation is used to estimate generalization performance

• True
• False

4
Multiple-choice questions

In the following, choose the single best answer:

Adding more complexity to a model will generally increase its performance on
the training set.

• True

• False

5
Multiple-choice questions

In the following, choose the single best answer:

Complex models generally give better generalization performance than simple
models

• True

• False

6
Multiple-choice questions

In the following, choose the single best answer:

Complex models generally give better generalization performance than simple
models

• True

• False

7
Multiple-choice questions

You have specified ten regression models and want to find the best one by 5-fold
cross-validation. How should you calculate the overall cross-validated fit?"
• Answer 1: "Calculate the fit on the training set for each fold and take the best one.”
• Answer 2: "Average the goodness of fit on the training set across each fold.”

• Answer 3: "Average the goodness of fit on the test set across each fold.”
• Answer 4: "Average the goodness of fit on the train and test set across each fold."

• Answer 5: "Calculate the fit on the test set for each fold and take the best one."

8
Multiple-choice questions

Question: "How is model complexity related to its propensity to underfit/overfit the original
data?"

• Answer 1: "More complex models are more likely to underfit the original data."
• Answer 2: "More complex models are less likely to overfit the original data."

• Answer 3: "More complex models are more likely to overfit the original data."
• Answer 4: "More complex models are as likely to underfit or overfit the original data as
less complex models."

9
Acknowledgements

• Courses/slides by Foster Provost, Panos Adamopoulos, Karolis Urbonas, Leonid

Zhukov, Mladen Kolar, John Kelleher, Chirag Shah, Gabor Bekes and Gabor
Kezdi

10
Thank you

Thank you