2024-03-09 13:20:21 | INFO | ####################################################################################################
2024-03-09 13:20:21 | INFO | Cross validation
2024-03-09 13:20:21 | INFO | MODEL: default_dart
2024-03-09 13:20:21 | INFO | parameters:
2024-03-09 13:20:21 | INFO | {'random_state': 42, 'objective': 'regression', 'metric': ['l1', 'rmse'], 'boosting': 'dart', 'num_iterations': 10000, 'early_stopping_round': None}
2024-03-09 13:20:21 | INFO | best iteration: 0
2024-03-09 13:20:21 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:21 | INFO | default_dart processed in 533.8359 seconds
2024-03-09 13:20:21 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:21 | INFO | METRICS for default_dart model
2024-03-09 13:20:21 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:21 | INFO | TRAIN
2024-03-09 13:20:21 | INFO | Train MAE mean: 0.0587, +- 0.0017
2024-03-09 13:20:21 | INFO | Train RMSE mean: 0.1045 +- 0.0073
2024-03-09 13:20:21 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:21 | INFO | VALID
2024-03-09 13:20:21 | INFO | Valid MAE mean: 1.1295 +- 0.1166
2024-03-09 13:20:21 | INFO | Valid RMSE mean: 2.0426 +- 0.3047
2024-03-09 13:20:21 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:21 | INFO | ####################################################################################################
2024-03-09 13:20:35 | INFO | ####################################################################################################
2024-03-09 13:20:35 | INFO | Cross validation
2024-03-09 13:20:35 | INFO | MODEL: default_gbdt
2024-03-09 13:20:35 | INFO | parameters:
2024-03-09 13:20:35 | INFO | {'random_state': 42, 'objective': 'regression', 'metric': ['l1', 'rmse'], 'boosting': 'gbdt', 'num_iterations': 10000, 'early_stopping_round': None}
2024-03-09 13:20:35 | INFO | best iteration: 604
2024-03-09 13:20:35 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:35 | INFO | default_gbdt processed in 13.8990 seconds
2024-03-09 13:20:35 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:35 | INFO | METRICS for default_gbdt model
2024-03-09 13:20:35 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:35 | INFO | TRAIN
2024-03-09 13:20:35 | INFO | Train MAE mean: 0.1648, +- 0.0798
2024-03-09 13:20:35 | INFO | Train RMSE mean: 0.2501 +- 0.1054
2024-03-09 13:20:35 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:35 | INFO | VALID
2024-03-09 13:20:35 | INFO | Valid MAE mean: 1.2400 +- 0.1358
2024-03-09 13:20:35 | INFO | Valid RMSE mean: 2.1785 +- 0.3132
2024-03-09 13:20:35 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:20:35 | INFO | ####################################################################################################
2024-03-09 13:28:11 | INFO | ####################################################################################################
2024-03-09 13:28:11 | INFO | Cross validation
2024-03-09 13:28:11 | INFO | MODEL: dart
2024-03-09 13:28:11 | INFO | parameters:
2024-03-09 13:28:11 | INFO | {'random_state': 42, 'objective': 'regression', 'metric': ['l1', 'rmse'], 'boosting': 'dart', 'num_leaves': 868, 'max_depth': 8, 'learning_rate': 0.16828978995869545, 'min_data_in_leaf': 52, 'min_child_weight': 0.10655060527281945, 'feature_fraction': 0.5476650496652392, 'bagging_fraction': 0.7559717604107233, 'bagging_freq': 5, 'max_bin': 476, 'lambda_l1': 0.010675548270132645, 'lambda_l2': 6.070899616958714e-06, 'num_iterations': 10000, 'early_stopping_round': None}
2024-03-09 13:28:11 | INFO | best iteration: 0
2024-03-09 13:28:11 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:11 | INFO | dart processed in 456.1519 seconds
2024-03-09 13:28:11 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:11 | INFO | METRICS for dart model
2024-03-09 13:28:11 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:11 | INFO | TRAIN
2024-03-09 13:28:11 | INFO | Train MAE mean: 0.0833, +- 0.0014
2024-03-09 13:28:11 | INFO | Train RMSE mean: 0.1388 +- 0.0053
2024-03-09 13:28:11 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:11 | INFO | VALID
2024-03-09 13:28:11 | INFO | Valid MAE mean: 1.1279 +- 0.1081
2024-03-09 13:28:11 | INFO | Valid RMSE mean: 2.0080 +- 0.3239
2024-03-09 13:28:11 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:11 | INFO | ####################################################################################################
2024-03-09 13:28:24 | INFO | ####################################################################################################
2024-03-09 13:28:24 | INFO | Cross validation
2024-03-09 13:28:24 | INFO | MODEL: gbdt
2024-03-09 13:28:24 | INFO | parameters:
2024-03-09 13:28:24 | INFO | {'random_state': 42, 'objective': 'regression', 'metric': ['l1', 'rmse'], 'boosting': 'gbdt', 'num_leaves': 1614, 'max_depth': 11, 'learning_rate': 0.1428469405296416, 'min_data_in_leaf': 55, 'min_child_weight': 3.5904663311802807, 'feature_fraction': 0.6104905268033398, 'bagging_fraction': 0.7985897592427431, 'bagging_freq': 1, 'max_bin': 130, 'lambda_l1': 6.246811090725011, 'lambda_l2': 0.001312408318116919, 'num_iterations': 10000, 'early_stopping_round': None}
2024-03-09 13:28:24 | INFO | best iteration: 929
2024-03-09 13:28:24 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:24 | INFO | gbdt processed in 13.3933 seconds
2024-03-09 13:28:24 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:24 | INFO | METRICS for gbdt model
2024-03-09 13:28:24 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:24 | INFO | TRAIN
2024-03-09 13:28:24 | INFO | Train MAE mean: 0.3710, +- 0.0577
2024-03-09 13:28:24 | INFO | Train RMSE mean: 0.5652 +- 0.0906
2024-03-09 13:28:24 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:24 | INFO | VALID
2024-03-09 13:28:24 | INFO | Valid MAE mean: 1.2475 +- 0.1218
2024-03-09 13:28:24 | INFO | Valid RMSE mean: 2.1714 +- 0.3021
2024-03-09 13:28:24 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:28:24 | INFO | ####################################################################################################
2024-03-09 13:28:24 | INFO | ####################################################################################################
2024-03-09 13:28:24 | INFO | TEST
2024-03-09 13:28:24 | INFO | Train on 80 % of the data and test on 20 % of the data. No validation set
2024-03-09 13:28:24 | INFO | ####################################################################################################
2024-03-09 13:30:00 | INFO | MODEL: default_dart
2024-03-09 13:30:00 | INFO | MAE: 1.2
2024-03-09 13:30:00 | INFO | RMSE: 2.24
2024-03-09 13:30:00 | INFO | Spearman: 0.94
2024-03-09 13:30:00 | INFO | Pearson: 0.98
2024-03-09 13:30:00 | INFO | R2: 0.95
2024-03-09 13:30:00 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:30:32 | INFO | MODEL: default_gbdt
2024-03-09 13:30:32 | INFO | MAE: 1.4
2024-03-09 13:30:32 | INFO | RMSE: 2.46
2024-03-09 13:30:32 | INFO | Spearman: 0.94
2024-03-09 13:30:32 | INFO | Pearson: 0.97
2024-03-09 13:30:32 | INFO | R2: 0.95
2024-03-09 13:30:32 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:31:53 | INFO | MODEL: dart
2024-03-09 13:31:53 | INFO | MAE: 1.2
2024-03-09 13:31:53 | INFO | RMSE: 2.15
2024-03-09 13:31:53 | INFO | Spearman: 0.94
2024-03-09 13:31:53 | INFO | Pearson: 0.98
2024-03-09 13:31:53 | INFO | R2: 0.96
2024-03-09 13:31:53 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:32:12 | INFO | MODEL: gbdt
2024-03-09 13:32:12 | INFO | MAE: 1.3
2024-03-09 13:32:12 | INFO | RMSE: 2.20
2024-03-09 13:32:12 | INFO | Spearman: 0.93
2024-03-09 13:32:12 | INFO | Pearson: 0.98
2024-03-09 13:32:12 | INFO | R2: 0.96
2024-03-09 13:32:12 | INFO | ----------------------------------------------------------------------------------------------------
2024-03-09 13:32:13 | INFO | Total time: 1245.9951 seconds
2024-03-09 13:32:13 | INFO | total time in minutes: 20.7666 minutes