Tag: boosting

18 Adaboost vs Gradient Boosting 2018-10-04T14:25:48.957

10 What is a good interpretation of this 'learning curve' plot? 2020-06-27T09:36:32.220

9 What is meant by Distributed for a gradient boosting library? 2018-11-15T14:24:52.373

9 Can Boosted Trees predict below the minimum value of the training label? 2020-07-06T11:39:00.160

7 AdaBoost implementation and tuning for high dimensional feature space in R 2017-08-04T14:25:26.683

6 How can I prevent this model to learn more(less) :))) 2018-08-03T18:15:37.417

6 How to extract trees in XGBoost? 2019-08-20T20:05:07.363

6 Boosting with highly correlated features 2020-03-29T16:44:19.973

5 Bagging vs Boosting, Bias vs Variance, Depth of trees 2019-10-15T13:19:59.797

5 Is the way to combine weak learners in AdaBoost for regression arbitrary? 2020-09-30T19:49:28.243

4 How are boosted decision stumps different from a decision tree? 2018-04-12T17:59:31.640

4 Does Gradient Boosting detect non-linear relationships? 2019-02-11T10:49:46.917

4 sklearn's cross_validate does not work with catboost 2019-08-25T21:37:02.010

4 GridSearch without CV 2020-01-09T19:20:08.497

3 Gradient Tree Boosting 2018-06-11T14:09:14.090

3 how does XGBoost's exact greedy split finding algorithm determine candidate split values for different feature types? 2018-08-02T18:17:24.507

3 why do we need row sampling in random forests? 2019-03-25T18:55:06.677

3 What does "exaggeration" mean in the context of Boosting? 2019-05-09T04:00:26.600

3 XGBoost validation for number of trees 2019-10-02T10:40:15.477

3 weighted quantile sketch in xgboost 2019-12-06T11:33:12.693

3 On gradient boosting and types of encodings 2020-07-21T16:22:43.643

3 What is the concept behind the categorical-encoding used in the CatBoost benchmark problems? 2020-09-04T03:51:36.893

3 What's the difference between hessian regularisation (min_child_weight) and loss regularisation (gamma)? When to use one over another? 2020-09-14T18:46:25.240

2 Python SkLearn Gradient Boost Classifier Sample_Weight Clarification 2018-08-31T11:55:35.573

2 boosting an xgboost classifier with another xgboost classifier using different sets of features 2018-09-18T16:43:42.613

2 To which category does this algorithm belongs? 2018-10-05T15:51:48.190

2 Gradient Boosting RandomSearchCV or GridSearchCV 2019-02-24T03:35:16.400

2 Updating weights in Adaboost 2019-03-04T06:42:41.017

2 Is the number of iterations in gradient tree boosting just the number of trees? 2019-05-29T16:19:05.420

2 How to make LightGBM to suppress output? 2019-06-17T15:06:21.197

2 difference between model-based boosting and gradient boosting 2019-07-05T09:23:38.230

2 Lowering learning rate makes my accuracy on the validation set go down 2019-07-24T04:51:35.043

2 Gradient Boosted Decision Trees How to Find Prediction of Each Tree? 2019-08-20T11:17:40.433

2 different outcome of feature importance and coefficient from same data 2019-09-01T04:12:38.080

2 Extremely high gain with LightGBM 2019-12-31T09:27:17.007

2 Extracting encoded features after CatBoost 2020-02-05T15:41:23.123

2 Decreasing n_estimators is increasing accuracy in AdaBoost? 2020-03-26T07:36:13.377

2 Random Forest Stacking Experiment for Imbalanced Data-set Problem 2020-04-13T18:02:48.580

2 Can i use other regression types that arent based in decision trees to use it like a weak learners in gradient boosting? 2020-05-26T03:37:38.127

2 Understanding additive function approximation or Understanding matching pursuit 2020-07-10T17:09:27.267

2 How to improve model performace when model shows a systemic pattern in residues 2020-10-03T23:25:59.210

2 Forecasting using Boosting methods on Non-stationary Time Series data 2021-01-25T09:57:35.583

2 How to handle highly Imabalanced classification? 2021-02-19T07:30:47.903

1 Comparing XGBR with CatBoost performance 2018-09-25T20:09:35.843

1 What would be the equivalent of R's mboost in Python? 2018-09-30T18:23:21.160

1 Why Catboost is giving error with MultiClass 2018-12-08T18:20:39.810

1 SmoteBoost: Should SMOTE be ran individually for each iteration/tree in the boosting? 2018-12-26T12:53:25.643

1 What are the limitations while using XGboost algorithm? 2019-01-18T01:13:24.967

1 Adaboost - Show that adjusting weights brings error of current iteration to 0.5 2019-02-01T21:54:18.157

1 Is there any formal explanation for the sensitivity of AdaBoost to outliers? 2019-02-19T13:20:00.960

1 which metric is better for boosting methods 2019-04-16T13:56:07.153

1 Combine AdaBoost and Support Vector Regression? 2019-04-21T02:05:27.560

1 How can I make ROC and compute AUC? 2019-04-29T02:35:48.490

1 Is there a term for measuring error on a second prediction based on the first's? 2019-05-19T03:29:16.443

1 Gradient boosting, where did the constant go? 2019-07-20T01:09:48.130

1 Can we use boosting algorithms like Adaboost and gradient boosting with only one classifier 2019-07-21T12:16:36.523

1 How to save a lightGBM model that updates predictions after each fold? 2019-07-26T10:56:26.257

1 Bagging with Neural Networks Best practices 2019-08-28T12:53:21.623

1 Use LightGBM or FFM - imbalanced dataset 2019-09-10T11:03:19.067

1 Purpose of gamma multiplier in gradient boosting 2019-09-28T19:22:40.233

1 How to control the amount of positives in classification? 2019-10-01T20:57:27.130

1 Error rate of AdaBoost weak learner always bigger than 0.5? 2019-10-14T12:39:14.160

1 best way to regularize gradient boosting regressor? 2019-11-18T00:01:40.167

1 Time series with additional information 2019-12-26T13:05:44.733

1 Do you need to perform variables reduction for tree-based models? 2020-02-07T16:58:31.217

1 Tuning parameters for gradient boosting/xgboost 2020-05-19T19:26:32.410

1 is it possible get a overfit underfit comparation between models, with this chart? (homework) 2020-06-27T17:06:08.980

1 Explanation on some steps of AdaBoost.R2 2020-07-15T17:40:10.083

1 AdaBoost.R2 learning rate from scikit learn 2020-08-04T10:12:55.913

1 splitting mechanism with one hot encoded variables (tree based/boosting) 2020-08-11T11:29:48.913

1 Does gradient boosting algorithm error always decrease faster and lower on training data? 2020-08-19T18:28:56.127

1 Solving the dual problem of boosting using column generation 2020-08-20T17:41:15.893

1 Counting the number of trainable parameters in a gradient boosted tree 2020-10-12T17:20:49.447

1 Tree-based algorithms and ordinal features 2020-10-15T19:36:11.930

1 Output of evaluation metric for XGBoost - is it cumulative? 2020-12-27T21:51:54.857

1 XGBoost: Typical gamma and min_child_weight range 2021-01-16T03:54:39.337

0 Is ensemble learning using different classifier combination another name for Boosting? 2018-06-19T19:04:48.990

0 What Does the Normalization Factor Mean in the AdaBoost Algorithm? 2018-09-09T01:06:50.417

0 Methods for augmenting binary datasets 2018-11-22T12:55:15.743

0 Can parallel computing be utilized for boosting? 2019-01-16T21:26:54.123

0 How to ensure same encoding pattern? 2019-02-25T02:28:39.457

0 How can the Adaboost technique be called an ensemble learning technique? 2019-07-20T13:09:44.173

0 If There is a case where decision trees are getting overfitted so by using gradient boost method do we solve that problem? 2019-07-22T12:08:52.860

0 How does one decide when to use boosting over bagging algorithm? 2019-08-27T13:55:08.353

0 How to tell a boosting model that 2 features are related and should not be interpreted stand-alone? 2019-10-02T04:13:33.937

0 Similarity of XGBoost models? 2019-10-04T08:50:58.370

0 Ensemble Techniques - Boosting 2019-10-06T13:20:52.010

0 Handling Categorical Features on NGBoost 2020-01-17T09:39:38.457

0 Getting feature vectors from CatBoost pool 2020-02-05T02:38:14.027

0 Building Uplift Tree using boosting 2020-06-06T13:39:40.930

0 XGBOOST/lLightgbm over-fitting despite no indication in cross-validation test scores? 2020-06-09T22:19:43.923

0 RMSE in NGBoost example appears to be unreasonably high 2020-06-22T11:41:50.197

0 Confidence score over xgboost logistic regression 2020-06-23T21:47:01.970

0 Getting unexpected keyword error in CatBoostRegressor while using GridSearchCV 2020-07-27T01:21:55.633

0 Which other algorithms fit residuals like XGBoost? 2020-07-27T19:49:49.083

0 How does reweighting samples actually affect each new weak learner in adaboost? 2020-08-01T00:39:36.370

0 Why do you need to update the number of boosting rounds each time you update a parameter in xgboost? 2020-08-13T16:39:19.447

0 A question about SAMME algorithm (Adaboost) 2020-09-10T20:53:51.323

0 Understanding interplay between eval_metric, metric and first_metric_only parameters in LGBMClassifier 2020-09-20T20:01:13.280