Open Access Repository

Machine learning for mining imbalanced data

Downloads

Downloads per month over past year

Arafat, MY, Hoque, S, Xu, S ORCID: 0000-0003-0597-7040 and Farid, DM 2019 , 'Machine learning for mining imbalanced data' , IAENG International Journal of Computer Science, vol. 46, no. 2 , pp. 332-348 .

[img]
Preview
PDF
136017 - Machin...pdf | Download (6MB)

| Preview

Abstract

© International Association of Engineers. Mining imbalanced data, which is also known as a class imbalanced problem is one of the most enormously challenging tasks in machine learning for data mining applications. To achieve overall accurate performance in imbalanced classification employing machine learning techniques is difficult as the majority class instances always overpower the minority class instances by a huge difference. An unequal distribution is very common in real-world high dimensional datasets, where binary classification is more frequent than multi-class classification task. Most existing machine learning algorithms are more focused on classifying majority class instances while ignoring or misclassifying minority class instances. Several techniques have been introduced in the last decades for imbalanced data classification, where each of this techniques has their own advantages and disadvantages. In this paper, we have studied and compared 12 extensively imbalanced data classification methods: SMOTE, AdaBoost, RUSBoost, EUSBoost, SMOTEBoost, MSMOTEBoost, DataBoost, Easy Ensemble, BalanceCascade, OverBagging, UnderBagging, SMOTEBagging to extract their characteristics and performance on 27 imbalanced datasets. In general, the combination of both over-sampling and undersampling techniques with ensemble classifiers such as bagging and boosting achieve the highest accuracy for classifying both majority and minority class instances. Additionally, an extensive and critical review of the existing algorithms of imbalanced learning is provided with detailed discussion. According to our findings, we advise some practical suggestions based on the reviewed papers to offer further research directions for imbalanced learning.

Item Type: Article
Authors/Creators:Arafat, MY and Hoque, S and Xu, S and Farid, DM
Keywords: imbalanced data, machine learning, data sampling, ensemble learning, random sampling
Journal or Publication Title: IAENG International Journal of Computer Science
Publisher: Newswood Ltd.
ISSN: 1819-656X
Copyright Information:

Copyright 2019 The Author(s)Licensed under Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)https://creativecommons.org/licenses/by-nc-nd/4.0/

Related URLs:
Item Statistics: View statistics for this item

Actions (login required)

Item Control Page Item Control Page
TOP