Tag: boosting

53 How to tune hyperparameters of xgboost trees? 2015-09-04T02:23:37.617

40 Random Forest, is it a boosting algorithm? 2013-11-19T16:34:47.087

31 Intuitive explanations of differences between Gradient Boosting Trees (GBM) & Adaboost 2015-08-01T07:50:35.237

30 What are some useful guidelines for GBM parameters? 2012-04-03T03:27:15.120

28 Is this the state of art regression methodology? 2015-12-10T15:21:02.460

27 What does interaction depth mean in GBM? 2011-10-04T21:13:01.133

21 Gradient Boosting for Linear Regression - why does it not work? 2015-12-16T00:41:15.700

20 How does boosting work? 2010-07-20T09:34:22.213

20 Relative variable importance for Boosting 2015-07-19T13:29:17.233

19 In boosting, why are the learners "weak"? 2012-02-16T13:37:08.857

18 Prediction interval based on cross-validation (CV) 2014-12-31T10:37:57.633

18 Loss function Approximation With Taylor Expansion 2016-03-21T19:04:51.863

18 Mathematical differences between GBM, XGBoost, LightGBM, CatBoost? 2017-10-12T11:43:11.330

16 On the "strength" of weak learners 2011-07-28T19:42:49.293

16 Under which conditions do gradient boosting machines outperform random forests? 2013-07-23T15:08:59.490

16 When should I not use an ensemble classifier? 2015-06-24T00:08:05.220

16 "Semi supervised learning" - is this overfitting? 2015-12-24T09:55:34.620

16 Is a decision stump a linear model? 2016-08-23T14:33:02.167

15 Does GBM classification suffer from imbalanced class sizes? 2012-07-26T10:05:41.070

14 How does gentle boosting differ from AdaBoost? 2010-07-20T16:01:25.590

14 Is AdaBoost less or more prone to overfitting? 2012-01-05T12:44:08.263

13 Calibrating a multi-class boosted classifier 2011-01-26T23:48:06.297

13 Why not always use ensemble learning? 2014-07-29T13:25:29.850

13 Boosting: why is the learning rate called a regularization parameter? 2015-08-25T10:39:16.160

12 R: What do I see in partial dependence plots of gbm and RandomForest? 2014-04-01T15:51:08.703

12 Is automated machine learning a dream? 2015-07-06T14:59:43.520

12 Boosting neural networks 2015-12-08T04:17:58.143

11 Gradient boosting machine accuracy decreases as number of iterations increases 2016-06-01T16:50:45.123

10 Boosted decision trees in python? 2010-09-06T19:00:03.070

10 When would one want to use AdaBoost? 2011-03-29T16:14:24.407

10 Tree size in gradient tree boosting 2011-12-21T12:02:18.920

9 Using Adaboost with SVM for classification 2012-05-04T14:21:09.040

9 How to find optimal values for the tuning parameters in boosting trees ? 2014-06-15T22:45:20.373

9 Are Random Forest and Boosting parametric or non-parametric? 2015-04-21T18:52:06.720

8 Why Adaboost with Decision Trees? 2014-11-19T04:00:01.853

8 How to use decision stump as weak learner in Adaboost? 2015-06-16T14:44:26.043

8 Scikit Binomial Deviance Loss Function 2015-06-20T08:44:31.137

8 How does linear base learner works in boosting? And how does it works in the xgboost library? 2016-08-17T22:14:16.487

7 Is there a theoretical basis for the shrinkage used in Boosted Regression Trees? 2013-03-05T00:05:18.743

7 Reconciling boosted regression trees (BRT), generalized boosted models (GBM), and gradient boosting machine (GBM) 2015-05-04T17:15:50.837

7 Best practices for coding categorical features for Decision Trees? 2015-10-20T17:27:32.220

7 Definition of complexity of a tree in xgboost 2015-10-21T14:49:01.213

7 Classification with Gradient Boosting : How to keep the prediction in [0,1] 2016-03-28T17:32:25.267

7 Discussion about overfit in xgboost 2016-03-30T08:02:41.870

7 Additive bias in xgboost (and its correction?) 2016-04-06T15:41:59.310

7 Gradient for logistic loss function 2016-06-16T18:10:58.447

7 Do boosting techniques use voting like any other ensemble method? 2017-03-08T18:59:38.537

6 When is the shrinkage applied in Friedman's stochastic gradient boosting machine? 2011-01-17T15:44:45.267

6 Adjusting sample weights in AdaBoost 2011-03-02T18:06:19.327

6 Understanding similarity sensitive hashing algorithm in AdaBoost 2011-12-05T04:10:09.200

6 Base classifiers for boosting 2012-03-23T04:07:01.473

6 Common weak learners for Adaboost 2012-08-28T13:11:13.803

6 Random forests vs boosting 2013-03-14T23:09:50.620

6 why boosting method is sensitive to outliers 2015-03-03T23:24:50.700

6 Out-of-bag error estimate for boosting? 2015-04-25T18:10:10.993

6 How to use XGboost.cv with hyperparameters optimization? 2015-11-28T10:42:17.760

6 XG Boost vs Random Forest for Time Series Regression Forecasting 2016-01-09T00:56:07.930

6 How can a smaller learning rate hurt the performance of a gbm? 2016-08-15T03:29:18.363

5 Normalized sigmoid loss function for boosting? 2011-02-15T14:22:27.763

5 Does ensembling (boosting) cause overfitting? 2012-01-07T13:14:00.227

5 What is the difference between AdaBoost.M2, AdaBoost.M1, Gentle AdaBoost, RealAdaboost and the Original Adaboost? 2012-10-14T04:57:34.860

5 Regarding the sampling procedure in Adaboost algorithm 2012-12-05T23:23:48.723

5 Using Adaboost for feature selection? 2013-03-08T06:02:38.527

5 How to choose a regression tree (base learner) at each iteration of Gradient Tree Boosting? 2015-03-20T08:02:05.040

5 Random forest vs Adaboost 2015-05-01T05:49:14.603

5 Where must we use Bagging or Boosting? 2015-05-17T05:43:25.843

5 Which data are used at each step of Stochastic Gradient Boosting? Subsample of the original training set or gradient of the loss function? 2015-09-16T11:11:58.150

5 When do we use gblinear versus gbtree? 2015-11-25T03:53:22.143

5 Why is boosting less likely to overfit? 2017-01-20T17:31:05.673

5 Gradient boosting - extreme predictions vs predictions close to 0.5 2017-05-09T08:15:16.450

4 Is additive logistic regression equivalent to boosted decision stumps? 2012-01-17T05:32:39.903

4 Continuous Multistate Ada-boost method? 2012-02-19T02:06:39.593

4 Selecting features using Adaboost 2012-04-09T12:44:37.340

4 Event classification in Higgs' Boson discovery 2012-07-05T14:47:56.037

4 How to use CART for AdaBoost? 2012-11-20T10:32:56.940

4 Tutorials / examples for multiclass boosting 2012-11-24T14:20:39.130

4 Why is boosting effective? 2013-06-28T00:31:05.550

4 What does it mean to "fit a regression function" and then use it to update other functions? 2014-04-14T11:34:57.293

4 Why should all Cross-Validation results be higher than the result on the test dataset? 2014-07-27T13:42:25.563

4 Is multicollinearity a problem with gradient boosted trees (i.e. GBM)? 2014-09-27T07:57:18.510

4 What is "fitted function" in the context of boosted regression tree? 2014-12-08T00:24:17.127

4 How are individual trees added together in boosted regression tree? 2015-01-28T19:22:12.693

4 GradientBoostClassifier(sklearn) takes very long time to train 2015-04-05T09:43:02.993

4 When does it makes sense to use Cross Validation? 2015-05-31T06:39:16.913

4 A question about Dynamic Random Forest 2015-07-08T22:30:20.480

4 Gradient boosting decision tree implementation 2015-09-10T14:08:23.530

4 Reference for xgboost 2015-10-21T10:26:03.527

4 Conducting pairwise ranking with XGBoost 2015-11-28T12:42:45.300

4 Can a decision tree automatically detect the effect on the dependent variable from the product/quotient of two independent variables? 2016-01-23T21:00:17.847

4 Stepwise regression predicts as well as Bayesian model averaging and boosting, why? 2016-08-20T00:38:59.230

4 Do multiple rounds of tree (GBR) param tuning lead to overoptimistic CV scores? 2016-12-31T13:25:52.493

4 Using Bayes for combining forecasts with different accuracies (Interview question) 2017-04-15T10:21:00.067

4 XGBoost vs Python Sklearn gradient boosted trees 2017-05-30T05:21:37.663

4 Final layer of neural network responsible for overfitting 2017-10-22T18:16:35.620

4 Differences in variable importance in predictive models, R 2018-02-08T02:04:32.410

3 How to choose the 1st threshold/classifier/ weak learner in Adaboost? 2011-05-09T02:58:40.720

3 AdaBoost on a continuum of base classifiers 2011-07-13T22:12:00.347

3 What to do when weak classifiers are almost identical in AdaBoost? 2011-11-22T14:33:23.023

3 Regarding boosting, bagging and bootstrapping 2012-04-24T17:51:09.840