Using Random Forest to Learn Imbalanced Data

Using Random Forest to Learn Imbalanced DataChao of Statistics,UC BerkeleyAndy Research,Merck Research LabsLeo of Statistics,UC BerkeleyAbstractIn this paper we propose two ways to deal with the Imbalanced data classification problem usingrandom Forest . One is based on cost sensitive learning, and the other is based on a sampling metrics such as precision and recall, false positive rate and false negative rate,F-measureand weighted accuracy are computed. Both methods are shown to improve the prediction accuracy ofthe minority class, and have favorable performance compared to the existing IntroductionMany practical classification problems areimbalanced; , at least one of the classes constitutes only avery small minority of the data.

2.1 Random Forest Random forest (Breiman, 2001) is an ensemble of unpruned classification or regression trees, induced from bootstrap samples of the training data, using random feature selection in the tree induction process. Predic-tion is made by aggregating (majority vote for classification or averaging for regression) the predictions of

Loading..

Tags:

  Forest, Random, Random forests, Random forest random forest

Information

Related search queries