JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2011, Vol. 41 ›› Issue (4): 79-84.

• Articles • Previous Articles     Next Articles

Algorithm based on communication system for constructing decision tree

ZHANG Xiao-feng, ZHANG Zhi-wang, PANG Shan   

  1. School of Information Science and Engineering, Ludong University, Yantai 264025, China
  • Received:2011-04-15 Online:2011-08-16 Published:2011-04-15

PDF (PC)

1276

Abstract:

Attribute selection criterion in constructing decision trees is always the focus in the area of data mining. Based on the analysis of ID3 and C4.5, this paper proposes two algorithms based on average self-information and average mutual-information in communication system. In this research, we prove that the two proposed algorithms are equivalent to ID3 and C4.5. That is, information gain is equivalent to average mutual information in communication system, and information gain ratio is the same as the ratio of average mutual information to the entropy. Experiments on AllElectrionics illustrate that compared with information gain and information gain ratio, attribute selection criteria proposed in this paper are easy to compute and understand.

Key words:  decision tree, information gain, information gain ratio, average mutualinformation, entropy

[1] QIU Lu, YE Yinzhong, JIANG Chundi. Fault diagnostic method for micro-grid based on wavelet singularity entropy and SOM neural network [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 118-122.
[2] WU Jianping, JIANG Bin, LIU Jianwei. Fault diagnosis of asynchronous motor based on wavelet packet entropy and wavelet neural network [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 223-228.
[3] LIN Yaojin, ZHANG Jia, LIN Menglei, WANG Juan. A method of collaborative filtering recommendation based on fuzzy information entropy [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(5): 13-20.
[4] ZHANG Jia, LIN Yaojin, LIN Menglei, LIU Jinghua, LI Huizong. Entropy-based collaborative filtering algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(2): 43-50.
[5] GUO Yu, ZHANG Erhua, LIU Chi. An endpoint detection algorithm based on frequency-domain characteristics and transition fragment judgment [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(2): 57-63.
[6] SONG Dongmei, LIU Chunxiao, SHEN Chen, SHI Xuefa, ZANG Lin, FENG Wenqiang. Multiple objective and attribute decision making based on the subjective and objective weighting [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(4): 1-9.
[7] XIN Liling, HE Wei, YU Jian, JIA Caiyan. An outlier detection algorithm based on density difference [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 7-14.
[8] ZHOU Yongmei1, YANG Aimin1, LIN Jianghao2. A method of building Chinese microblog sentiment lexicon [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(3): 36-40.
[9] PAN Pan1, WANG Xi-zhao2, ZHAI Jun-hai2. An improved induction algorithm based on ordinal decision tree [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(1): 41-44.
[10] HE Si-yan1, LI Peng2, LIU Cheng-yu2, WU Xue-qian2, CHEN Qi-jun3. Refining of the membership function in cross fuzzy entropy and its influence [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(1): 63-68.
[11] LI Hui1,2, HU Yun1,3, LI Cun-hua1. The technique of gas disaster information feature extraction based on rough set theory [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(5): 91-95.
[12] LAI Yan-hua, WEI Lu-lu, Lü Ming-xin, ZHAO Lin-yan, YUE Hong, LIU Cun-fang. Stucture optimization of high power LED heat sinks based on the method of minimum entropy generation [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(5): 118-122.
[13] YU Jiang-de1, ZHOU Hong-yu1, YU Zheng-tao2. Feature engineering for Chinese part-of-speech tagging [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(6): 12-17.
[14] HU Yun1,2, LI Hui1, SHI Jun1, CAI Hong1. An outlier detection algorithm based on attribute reduction and relative entropy [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(6): 31-36.
[15] GUO Jian-yi1,2, LEI Chun-ya1, YU Zheng-tao1,2, SU Lei1,2, ZHAO Jun1, TIAN Wei1. A semi-supervised learning method based on information entropy to extract the domain entity relation [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(4): 7-12.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd