Ensemble Methods Bagging and Boosting Quiz

Submit

2. Voting ensembles combine predictions from diverse models using:

Majority vote or weighted averaging

Sequential error correction

Bootstrap sampling only

Gradient descent optimization

Submit

5. What is out-of-bag (OOB) error in bagging?

Error from samples not used in a particular bootstrap sample

Total error across all models

Error on the validation set

Error from overfitting

Submit

7. Which statement about bagging and boosting is true?

Both reduce variance equally

Bagging reduces variance; boosting reduces bias

Both are sequential methods

Boosting is always superior to bagging

Submit

9. In bagging, does each base model use the same training data?

Yes, exactly the same

No, different bootstrap samples

Only for the first model

Depends on the algorithm

10. XGBoost improves upon standard gradient boosting by incorporating:

Regularization and second-order derivatives

Only bagging techniques

Random sampling without replacement

Equal weighting of all samples

11. What is the primary goal of bagging in ensemble learning?

Reduce variance by training multiple models on random subsets

Increase bias by focusing on hard examples

Eliminate overfitting completely

Reduce training time significantly

12. What is the final prediction in bagging for classification?

Average of all model predictions

Majority vote among base learners

Weighted sum based on accuracy

Prediction from the strongest model only

13. In bagging, are the base learners trained in parallel or sequentially?

Sequentially

Parallel

Both equally

Depends on dataset size

Submit

15. Which of the following is a disadvantage of boosting?

High sensitivity to outliers

Reduced interpretability

Sequential nature increases training time

All of the above

16. In gradient boosting, what does each new tree attempt to do?

Replicate the previous tree

Predict residuals from previous trees

Reduce model complexity

Increase feature importance equally

Submit

18. What does AdaBoost stand for?

Adaptive Boosting

Advanced Bagging

Algorithmic Decision Boosting

Adaptive Bootstrap

19. Which ensemble method is most effective at reducing variance?

Boosting

Bagging

Stacking

Voting

20. In boosting, how are subsequent models weighted?

Equally across all iterations

Based on misclassified examples from previous models

Randomly assigned

Inversely to their accuracy

DataX Ensemble Methods Bagging and Boosting Quiz

1. Boosting primarily reduces ______ by focusing on difficult examples.

2.

What first name or nickname would you like us to use?

2. Voting ensembles combine predictions from diverse models using:

3. In boosting, misclassified samples receive ______ weight in the next iteration.

4. LightGBM and CatBoost are modern variants of ______ boosting algorithms.

5. What is out-of-bag (OOB) error in bagging?

6. Gradient Boosting Machines (GBM) build trees to predict ______ of the loss function.

7. Which statement about bagging and boosting is true?

8. Stacking is an ensemble method that uses a ______ model to combine base learner predictions.

9. In bagging, does each base model use the same training data?

10. XGBoost improves upon standard gradient boosting by incorporating:

11. What is the primary goal of bagging in ensemble learning?

12. What is the final prediction in bagging for classification?

13. In bagging, are the base learners trained in parallel or sequentially?

14. Random Forest is an example of a ______ ensemble method.

15. Which of the following is a disadvantage of boosting?

16. In gradient boosting, what does each new tree attempt to do?

17. Bagging uses ______ sampling to create multiple datasets.

18. What does AdaBoost stand for?

19. Which ensemble method is most effective at reducing variance?

20. In boosting, how are subsequent models weighted?