JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2012, Vol. 42 ›› Issue (4): 19-23.

• Articles • Previous Articles     Next Articles

Study on the cost-sensitive ensemble learning algorithm based on the cloud computing platform

ZHANG Ling-wei, WAN Wen-qiang   

  1. College of Computer, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
  • Received:2012-05-15 Online:2012-08-20 Published:2012-05-15

PDF (PC)

1248

Abstract:

With respect to the classification of large scale imbalanced data, a distributed cost-sensitive ensemble learning algorithm based on cloud computing platform was proposed. The large scale data was divided on Hadoop cloud computing platform and was used  in parallel learning. Based on the idea of cost-sensitive, a weighted ensemble classifier was achieved, and a distributed cost-sensitive ensemble learning model based on cloud computing platform was developed. Experiment results showed that the recall rate of the minority class was improved significantly and the computational time was shortened by the ensemble learning on cloud computing platform due to the Hadoop parallel mechanism. In additron,  the classification efficiency of the large-scale imbalanced problem was largely improved.

Key words: cost sensitive learning, ensemble learning, cloud computing platform, imbalanced pattern classification, distribution

[1] AN Haiyun, ZHOU Qian, LIU Yufang, HUANG Cheng, CHEN Zhe, WU Qiuwei. A hybrid data-mechanism driven approach to active distribution network line loss calculation [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 51-61.
[2] YAN Renwu, LIN Jianxiong, LI Peiqiang, WU Guoyao, KUANG Yu. Bi-level optimization strategy for active distribution networks considering carbon emission factors and dynamic reconfiguration [J]. Journal of Shandong University(Engineering Science), 2025, 55(2): 16-27.
[3] Haigen MIN,Yukun FANG,Xia WU,Wuqi WANG. Fault diagnosis of vehicle-to-vehicle communication in networked traffic environment [J]. Journal of Shandong University(Engineering Science), 2021, 51(6): 84-92.
[4] GONG Weiping, GUAN Hongjun, LI Hongwei, LIU Jieben, SHI Yuetao. Optimization of heating load distribution of combined unit based on EBSILON simulation software [J]. Journal of Shandong University(Engineering Science), 2021, 51(4): 77-83.
[5] Xinxin FANG,Shiwen ZHANG,Yuting ZHU,Wei JIANG,Zhaoyuan ZHANG,Nan ZHAO. Pollution characteristics and intake risk assessment of short and medium-chain chlorinated paraffins in foods in Jinan [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 119-128.
[6] LI Zhi, YU Shaofeng, SU Yifang, WANG Wei, JIANG Hongtu, ZHANG Wei. Primary and secondary integration simulation technology of distribution network based on RTDS [J]. Journal of Shandong University(Engineering Science), 2020, 50(6): 112-117.
[7] LIN Chao, ZHANG Chenglin, WANG Yong. Design and mechanical properties of prestressed hollow bar [J]. Journal of Shandong University(Engineering Science), 2020, 50(5): 26-32.
[8] Yibin WANG,Tianli LI,Yusheng CHENG,Kun QIAN. Label distribution learning based on kernel extreme learning machine auto-encoder [J]. Journal of Shandong University(Engineering Science), 2020, 50(3): 58-65.
[9] Shizhan SONG,Haoyu CHEN,Jian ZHANG,Kun WANG,Qingshui HAO. Voltage control method of urban distribution network considering street light charging pile access [J]. Journal of Shandong University(Engineering Science), 2020, 50(3): 104-110.
[10] Dapeng ZHANG,Yajun LIU,Wei ZHANG,Fen SHEN,Jiansheng YANG. Fake comment detection based on heterogeneous ensemble learning [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 1-9.
[11] Liyan WANG, Fei WANG, Yongji CAO, Tao ZHANG, Yaxin ZHANG, Yi LU, Zihan LIU. Bi-level optimal configuration of energy storage system in an active distribution network [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 37-43.
[12] Zongtang ZHANG,Sen WANG,Shilin SUN. An ensemble learning algorithm for unbalanced data classification [J]. Journal of Shandong University(Engineering Science), 2019, 49(4): 8-13.
[13] Xiandong LI,Fei WANG,Yongji CAO,Lilong WANG,Lin WANG,Yi LU,Zihan LIU. Analytic hierarchy process based quantitative performance evaluation of second-use battery energy storage system [J]. Journal of Shandong University(Engineering Science), 2019, 49(4): 123-129.
[14] Run XIANG,Sufen CHEN,Xueqiang ZENG. Facial age estimation based on multivariate multiple regression [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 54-60.
[15] Dongdong SHEN,Fengyu ZHOU,Mengyuan LI,Shuqian WANG,Renhe GUO. Indoor wireless positioning based on ensemble deep neural network [J]. Journal of Shandong University(Engineering Science), 2018, 48(5): 95-102.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] YU Jia yuan1, TIAN Jin ting1, ZHU Qiang zhong2. Computational intelligence and its application in psychology[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 1 -5 .
[2] JI Tao,GAO Xu/sup>,SUN Tong-jing,XUE Yong-duan/sup>,XU Bing-yin/sup> . Characteristic analysis of fault generated traveling waves in 10 Kv automatic blocking and continuous power transmission lines[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 111 -116 .
[3] WANG Pei,ZHANG Yanning,SHEN Jiazhen,LIU Juncheng, . Application of information measure and support vector machine in image edge detection[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(3): 95 -99 .
[4] LIANG Jing-yun,WANG Ming-gang,CHAI Jia-qian,LIU yong-qing . Synthesis and in vitro antibacterial activity of 1,6-Di-(N5-phenyl-N1-diguanido) hexane dihydrochloride[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(3): 104 -107 .
[5] XU Xiaodan, DUAN Zhengjie, CHEN Zhongyu. The sentiment mining method based on extended sentiment dictionary and integrated features[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(6): 15 -18 .
[6] LONG Zhi-Jian, ZHANG Chang-Qiao. Synthesis and properties of associating DRA by binary copolymerization based on lauryl methacrylate[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(5): 128 -132 .
[7] XUE Hongtao,TIAN Guohui,LI Xiaolei,LU Fei . Application of the QR Code for various object identificationand manipulation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(6): 25 -30 .
[8] SUN Huai-Feng, LI Shu-Cai, CUI Wei, QIU Dao-Hong, LIU Qin. Application of comprehensive geological predictionin open-cut tunnel detection[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 69 -73 .
[9] HAN Xue. Example analysis for landslide hazard remote monitoring at  the Pingzhuang west open-pit mine[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 116 -120 .
[10] DENG Xiu-cheng,SHEN Yan-jun,FANG Sheng-le .

An approach to design the finite-time observer for MIMO-linear systems

[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 17 -21 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd