DataX Cross Validation Techniques Quiz

Submit

2. Cross-validation estimates are typically more stable and reliable than single train-test split estimates. True or False?

True

False

3. Which scenario would benefit most from nested cross-validation?

Simple linear regression with no hyperparameters

Hyperparameter tuning combined with model evaluation

Datasets with fewer than 100 samples

Time series forecasting only

4. When using cross-validation for feature selection, the selection process should occur within each fold to avoid data leakage. True or False?

True

False

5. What is the primary advantage of k-fold cross-validation over a single train-test split?

It trains faster

It uses all data for both training and validation

It eliminates the need for hyperparameter tuning

It guarantees better model accuracy

Submit

7. Which cross-validation technique requires the fewest model training iterations?

Leave-one-out cross-validation

Train-test split

5-fold cross-validation

10-fold cross-validation

8. Bootstrap cross-validation samples data with replacement. True or False?

True

False

9. In 5-fold cross-validation, what percentage of data is used for testing in each fold?

20%

50%

80%

10%

10. Which of the following is a limitation of simple train-test split validation?

It requires more computational resources than k-fold

Results depend heavily on how data is randomly split

It cannot evaluate regression models

It always produces overoptimistic estimates

11. What is the primary purpose of cross-validation in machine learning?

To increase the size of the training dataset

To assess how well a model generalizes to unseen data

To reduce the number of features in the model

To automatically select the best algorithm

12. In nested cross-validation, which loop is used for hyperparameter tuning?

The outer loop only

The inner loop only

Both loops equally

Neither loop is involved

13. A model achieves 95% accuracy on training data but only 70% on cross-validation folds. What does this suggest?

The model is underfitting

The model is overfitting

The dataset is too large

The cross-validation method is incorrect

14. What does stratified sampling ensure in stratified k-fold cross-validation?

Equal feature distributions across folds

Class distribution is preserved in each fold

Training time is reduced significantly

Hyperparameters are optimized automatically

Submit

16. Which metric is commonly used to evaluate cross-validation results for classification problems?

Mean absolute error

Cross-entropy loss

Mean squared error

F1-score or accuracy

17. In cross-validation, overfitting occurs when a model performs well on training data but poorly on validation data. True or False?

True

False

18. What is a key disadvantage of leave-one-out cross-validation (LOOCV)?

It requires splitting data into only two parts

It is computationally expensive for large datasets

It cannot be used for regression problems

It always produces biased performance estimates

19. Which cross-validation technique is most suitable for imbalanced classification datasets?

Random k-fold cross-validation

Stratified k-fold cross-validation

Time series cross-validation

Leave-one-out cross-validation

20. In k-fold cross-validation, what does k represent?

The number of features selected

The number of equal partitions the data is divided into

The number of hyperparameters to tune

The maximum number of iterations allowed

DataX Cross Validation Techniques Quiz

1. Cross-validation helps estimate the ____ error of a model on new, unseen data.

2.

What first name or nickname would you like us to use?

2. Cross-validation estimates are typically more stable and reliable than single train-test split estimates. True or False?

3. Which scenario would benefit most from nested cross-validation?

4. When using cross-validation for feature selection, the selection process should occur within each fold to avoid data leakage. True or False?

5. What is the primary advantage of k-fold cross-validation over a single train-test split?

6. The ____ is the difference between a model's performance on training data and validation data.

7. Which cross-validation technique requires the fewest model training iterations?

8. Bootstrap cross-validation samples data with replacement. True or False?

9. In 5-fold cross-validation, what percentage of data is used for testing in each fold?

10. Which of the following is a limitation of simple train-test split validation?

11. What is the primary purpose of cross-validation in machine learning?

12. In nested cross-validation, which loop is used for hyperparameter tuning?

13. A model achieves 95% accuracy on training data but only 70% on cross-validation folds. What does this suggest?

14. What does stratified sampling ensure in stratified k-fold cross-validation?

15. Time series data should use ____ cross-validation to respect temporal order.

16. Which metric is commonly used to evaluate cross-validation results for classification problems?

17. In cross-validation, overfitting occurs when a model performs well on training data but poorly on validation data. True or False?

18. What is a key disadvantage of leave-one-out cross-validation (LOOCV)?

19. Which cross-validation technique is most suitable for imbalanced classification datasets?

20. In k-fold cross-validation, what does k represent?