Tag: cross-validation

181 Is there any reason to prefer the AIC or BIC over the other? 2010-07-23T20:49:12.340

101 Choice of K in K-fold cross-validation 2012-05-04T03:52:09.103

99 Training with the full dataset after cross-validation? 2011-06-05T16:50:50.747

86 Differences between cross validation and bootstrapping to estimate the prediction error 2011-11-14T14:57:47.103

82 How to choose a predictive model after k-fold cross-validation? 2013-03-15T02:21:38.103

66 Cross-Validation in plain english? 2010-08-18T13:11:19.190

61 Feature selection for "final" model when performing cross-validation in machine learning 2010-09-02T10:25:42.330

58 Nested cross validation for model selection 2013-07-22T15:53:24.047

58 How to split the dataset for cross validation, learning curve, and final evaluation? 2014-04-30T10:44:06.227

54 Feature selection and cross-validation 2012-05-04T10:09:12.020

53 How to tune hyperparameters of xgboost trees? 2015-09-04T02:23:37.617

46 How can I help ensure testing data does not leak into training data? 2011-12-19T22:49:14.553

42 Is ridge regression useless in high dimensions ($n \ll p$)? How can OLS fail to overfit? 2018-02-14T16:31:47.080

39 Compendium of cross-validation techniques 2011-08-18T15:53:08.557

37 Using k-fold cross-validation for time-series model selection 2011-08-10T17:20:12.543

37 Variance and bias in cross-validation: why does leave-one-out CV have higher variance? 2013-06-14T20:14:49.827

36 Can cross validation be used for causal inference? 2010-10-22T15:12:03.423

36 Optimal number of folds in $K$-fold cross-validation: is leave-one-out CV always the best choice? 2013-06-12T13:24:23.250

35 Bootstrap vs. Jackknife 2012-01-13T03:09:07.963

34 How do I know which method of cross validation is best? 2014-06-15T15:25:14.840

33 Hold-out validation vs. cross-validation 2014-06-25T13:41:15.927

32 Cross-validating time-series analysis 2011-03-26T20:50:33.563

31 Can you overfit by training machine learning algorithms using CV/Bootstrap? 2012-05-29T03:04:46.313

29 Empirical justification for the one standard error rule when using cross-validation 2013-12-20T19:54:12.817

28 Model selection and cross-validation: The right way 2013-07-21T01:08:19.417

28 Cross-validation misuse (reporting performance for the best hyperparameter value) 2016-07-18T10:48:49.527

27 On the importance of the i.i.d. assumption in statistical learning 2016-05-19T13:28:36.407

26 Why is there an asymmetry between the training step and evaluation step? 2012-02-07T20:45:51.470

26 When is nested cross-validation really needed and can make a practical difference? 2015-10-22T14:11:46.143

26 Does $K$-fold CV with $K=N$ (LOO) provide the MOST or LEAST variable estimates, and what is the role of "stability"? 2017-05-20T01:11:46.233

25 How does cross-validation overcome the overfitting problem? 2011-04-01T16:26:57.173

25 Cross-validation including training, validation, and testing. Why do we need three subsets? 2013-12-17T10:59:07.437

24 How can one empirically demonstrate in R which cross-validation methods the AIC and BIC are equivalent to? 2010-07-25T05:08:20.333

24 Understanding stratified cross-validation 2013-02-07T20:58:31.927

22 Who invented k-fold cross-validation? 2012-04-18T16:48:05.327

22 Variance estimates in k-fold cross-validation 2012-06-27T03:40:42.750

22 ROC curve for discrete classifiers like SVM: Why do we still call it a "curve"?, Isn't it just a "point"? 2012-09-22T12:35:57.243

22 K-fold vs. Monte Carlo cross-validation 2013-03-05T21:53:11.020

21 Is cross validation a proper substitute for validation set? 2011-11-23T23:33:35.550

21 How does leave-one-out cross-validation work? How to select the final model out of $n$ different models? 2012-05-01T10:51:58.320

21 Cross-validation or bootstrapping to evaluate classification performance? 2013-09-26T19:54:34.270

21 Error metrics for cross-validating Poisson models 2013-10-02T18:56:09.310

21 Why use stratified cross validation? Why does this not damage variance related benefit? 2014-10-02T16:45:00.410

20 How should mixed effects models be compared and or validated? 2012-02-28T03:33:59.977

20 What common forecasting models can be seen as special cases of ARIMA models? 2012-02-29T12:03:00.907

20 Model stability when dealing with large $p$, small $n$ problem 2012-05-31T15:46:09.490

20 Why do researchers use 10-fold cross validation instead of testing on a validation set? 2013-02-10T16:36:53.663

20 PCA and the train/test split 2013-04-10T14:06:16.037

20 Overfitting: No silver bullet? 2016-06-19T12:56:45.980

19 Cross Validation (error generalization) after model selection 2011-01-03T15:08:29.897

19 Best approach for model selection Bayesian or cross-validation? 2012-01-07T22:03:16.283

19 Internal vs external cross-validation and model selection 2013-07-12T13:31:31.367

18 Significance testing or cross validation? 2011-10-26T16:33:42.500

18 Stability of cross-validation in Bayesian models 2012-05-24T03:27:51.947

18 libsvm "reaching max number of iterations" warning and cross-validation 2012-09-20T13:12:48.547

18 Does caret train function for glmnet cross-validate for both alpha and lambda? 2013-09-10T07:59:42.293

18 Prediction interval based on cross-validation (CV) 2014-12-31T10:37:57.633

17 When are Shao's results on leave-one-out cross-validation applicable? 2010-09-03T16:15:14.543

17 Fast method for finding best metaparameters of SVM (that is faster than grid search) 2012-02-07T21:51:18.577

17 Cross-validation vs empirical Bayes for estimating hyperparameters 2012-03-17T07:53:19.467

17 Choosing optimal alpha in elastic net logistic regression 2014-01-31T17:03:17.237

17 Why splitting the data into the training and testing set is not enough 2015-08-26T02:25:42.650

16 What is the definition of "best" as used in the term "best fit" and cross validation? 2010-09-22T14:11:12.697

16 The cross validation (CV) and the generalized cross validation (GCV) statistics 2013-11-24T17:38:20.540

16 Should I make decisions based on micro-averaged or macro-averaged evaluation measures? 2015-06-14T14:10:39.880

15 How to use scikit-learn's cross validation functions on multi-label classifiers 2013-07-28T15:34:21.080

15 How bad is hyperparameter tuning outside cross-validation? 2015-02-12T21:22:33.327

15 Can regularization be helpful if we are interested only in modeling, not in forecasting? 2016-03-29T16:44:01.900

14 Grid search on k-fold cross validation 2012-08-19T23:17:36.657

14 How to split a data set to do 10-fold cross validation 2013-06-06T19:31:29.543

14 What are the case studies in public health policy research where unreliable/confounded/invalid studies or models were misused? 2013-08-12T05:31:01.343

14 Training, testing, validating in a survival analysis problem 2014-04-02T17:17:28.630

14 k-fold Cross validation of ensemble learning 2014-06-09T03:44:50.537

14 How to split dataset for time-series prediction? 2014-09-30T16:23:39.380

14 How do you use test data set after Cross-validation 2015-05-18T21:02:26.110

14 Validation Error less than training error? 2015-12-17T22:04:32.980

13 Ordering of time series for machine learning 2010-10-05T10:47:46.470

13 How to do cross-validation with a Cox proportional hazards model? 2012-02-02T16:39:13.637

13 When/where to use functional data analysis? 2012-04-07T21:46:27.737

13 PCA and k-fold cross-validation in caret package in R 2012-12-19T04:16:46.080

13 Optimization: The root of all evil in statistics? 2013-07-11T00:53:05.583

13 Can we use leave one out mean and standard deviation to reveal the outliers? 2014-10-22T15:34:57.277

13 Why is lambda "within one standard error from the minimum" is a recommended value for lambda in an elastic net regression? 2015-02-20T20:56:50.790

12 Why use Platt's scaling? 2010-12-07T01:31:14.380

12 Interpretation and validation of a Cox proportional hazards regression model using R in plain English 2012-02-17T14:06:44.337

12 What is the procedure for "bootstrap validation" (a.k.a. "resampling cross-validation")? 2012-04-16T14:16:23.627

12 Mean(scores) vs Score(concatenation) in cross validation 2012-08-19T05:21:40.470

12 How many times should we repeat a K-fold CV? 2014-01-17T02:45:56.083

12 Use of nested cross-validation 2014-06-18T11:51:05.653

12 AIC, BIC and GCV: what is best for making decision in penalized regression methods? 2014-07-20T03:44:52.977

12 Is cross-validation enough to prevent overfitting? 2016-02-02T15:12:20.213

11 Cross validation and ordinal logistic regression 2012-02-21T15:48:57.883

11 Averaging precision and recall when using cross validation 2013-08-08T17:17:23.383

11 Can you compare different clustering methods on a dataset with no ground truth by cross-validation? 2014-02-19T00:59:02.597

11 Variablity in cv.glmnet results 2014-05-15T00:46:29.630

11 How is cross validation different from data snooping? 2014-07-11T15:37:10.717

11 Reporting variance of the repeated k-fold cross-validation 2015-01-11T16:36:41.790

11 Should repeated cross-validation be used to assess predictive models? 2015-12-04T16:49:38.497

11 Caret - Repeated K-fold cross-validation vs Nested K-fold cross validation, repeated n-times 2016-01-05T14:14:15.993