I wanted to know what the n.minobsinnode parameter means in the GBM package. I read the manual, but it is not clear what it does.
Should that number be small or large to improve the results?
Solved – Role of n.minobsinnode parameter of GBM in R
boostingr
Related Question
- Solved – What parameter of GBM does gradient descent update after calculating gradient of loss function
- Solved – R gbm – handling of missing values
- Solved – Scale of variable importance in randomForest, party & gbm
- Solved – Boosting: In the function gbm() from library gbm and understanding the cv.folds implementation
Best Answer
At each step of the GBM algorithm, a new decision tree is constructed. The question when growing a decision tree is 'when to stop?'. The furthest you can go is to split each node until there is only 1 observation in each terminal node. This would correspond to n.minobsinnode=1. Alternatively, the splitting of nodes can cease when a certain number of observations are in each node. The default for the R GBM package is 10.
What is the best value to use? It depends on the data set and whether you are doing classification or regression. Since each trees' prediction is taken as the average of the dependant variable of all inputs in the terminal node, a value of 1 probably won't work so well for regression(!) but may be suitable for classification.
Higher values mean smaller trees so make the algorithm run faster and use less memory, which may be a consideration.
Generally, results are not very sensitive to this parameter and given the stochastic nature of GBM performance it might actually be difficult to determine exactly what value is 'the best'. The interaction depth, shrinkage and number of trees will all be much more significant in general.