We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
High-Performance Machine Learning for Large-Scale Data Classification considering Class Imbalance.
- Authors
Liu, Yang; Li, Xiang; Chen, Xianbang; Wang, Xi; Li, Huaqiang
- Abstract
Currently, data classification is one of the most important ways to analysis data. However, along with the development of data collection, transmission, and storage technologies, the scale of the data has been sharply increased. Additionally, due to multiple classes and imbalanced data distribution in the dataset, the class imbalance issue is also gradually highlighted. The traditional machine learning algorithms lack of abilities for handling the aforementioned issues so that the classification efficiency and precision may be significantly impacted. Therefore, this paper presents an improved artificial neural network in enabling the high-performance classification for the imbalanced large volume data. Firstly, the Borderline-SMOTE (synthetic minority oversampling technique) algorithm is employed to balance the training dataset, which potentially aims at improving the training of the back propagation neural network (BPNN), and then, zero-mean, batch-normalization, and rectified linear unit (ReLU) are further employed to optimize the input layer and hidden layers of BPNN. At last, the ensemble learning-based parallelization of the improved BPNN is implemented using the Hadoop framework. Positive conclusions can be summarized according to the experimental results. Benefitting from Borderline-SMOTE, the imbalanced training dataset can be balanced, which improves the training performance and the classification accuracy. The improvements for the input layer and hidden layer also enhance the training performances in terms of convergence. The parallelization and the ensemble learning techniques enable BPNN to implement the high-performance large-scale data classification. The experimental results show the effectiveness of the presented classification algorithm.
- Subjects
ARTIFICIAL neural networks; BACK propagation; DATA distribution; MACHINE learning; CLASSIFICATION algorithms; CLASSIFICATION; HIGH performance computing; DATA collection platforms
- Publication
Scientific Programming, 2020, p1
- ISSN
1058-9244
- Publication type
Article
- DOI
10.1155/2020/1953461