Question

Which of the following statement(s) is/are correct about Stacking in the context of machine learning?
(A) A logistic regression will definitely work better in the second stage as compared to other classification models.
(B) A machine learning model is trained on predictions of multiple machine learning models.
(C) First stage models are trained on full/partial feature space of training data.
Choose the correct answer from the options given below:

• (B) and (C) only.
• (A) and (B) only.
• (A) and (C) only.
• (B) only.

Hint:

Understand that stacking uses base models to generate predictions, which are then used by a meta-model for final predictions.

Answer 1

The Correct Option is A

(A): Incorrect. Logistic regression is often used in the second stage but not guaranteed to work better than other classifiers. (B): Correct. Stacking involves training a meta-model (e.g., logistic regression) on predictions of base models. (C): Correct. First stage models are trained on the feature space of the training data.