JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2011, Vol. 41 ›› Issue (6): 31-36.

• Articles • Previous Articles     Next Articles

An outlier detection algorithm based on attribute reduction and relative entropy

HU Yun1,2, LI Hui1, SHI Jun1, CAI Hong1   

  1. 1. School of Computer Engineering, Huaihai Institute of Technology, Lianyungang 222000, China;
    2. Department of Computer Science and Technology, Nanjing University, Nanjing 210000, China
  • Received:2011-04-15 Online:2011-12-16 Published:2011-04-15

PDF (PC)

1156

Abstract:

A new outlier detection algorithm combining a  rough set and information entropy technology was proposed. This approach could obtain similar outlier sets by means of searching in an attributes subspace, which  could lead the analysis of outlier detection to focus better on narrow and specific object fields. This algorithm divided the original attribute space into several segments, which filtered out those subjects with largest relative entropy negative relative cardinality as the outliers. To prove this algorithm’s effectiveness,  experiments on a  real world dataset were conducted. Theoretical analysis and experimental results showed that this method of outlier detection was efficient and effective.

Key words: attribute deduction, relative entropy, outlier detection

CLC Number: 

  • TP391
[1] YAO Yu, FENG Jian, ZHANG Huaguang, HAN Kezhen. Weighted hyper-ellipsoidal support vector data description with negative samples for outlier detection [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 195-202.
[2] XIN Liling, HE Wei, YU Jian, JIA Caiyan. An outlier detection algorithm based on density difference [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 7-14.
[3] YANG Jin-wei, WANG Li-zhen*, CHEN Hong-mei, ZHAO Li-hong. Distance-based outlier detection over uncertain data [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(4): 34-37.
[4] HUANG Tian-qiang1,2, CHEN Zhi-wen1. Digital video forgeries detection based on bidirectional motion vectors [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(4): 13-19.
[5] SUN Jing-yu, YU Xue-li, CHEN Jun-jie, LI Xian-hua. Sampled peculiarity factor and its application in anomaly detection [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(5): 56-59.
[6] CHEN Bin, CHEN Song-Can, PAN Zhi-Song, LI Bin. Survey of outlier detection technologies [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(6): 13-23.
[7] LUO Yu-Pan, SHANG Lin. Detect outliers in time series data with multi-granule periodic patterns [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(3): 11-15.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LAI Xiang . The global domain of attraction for a kind of MKdV equations[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 87 -92 .
[2] QU Yan-peng,CHEN Song-ying,LI Chun-feng,WANG Xiao-peng,TENG Shu-ge . [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 16 -20 .
[3] LI Shijin, WANG Shengte, HUANG Leping. Change detection with remote sensing images based on forward-backward heterogenicity[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 1 -9 .
[4] REN Jing-xi,GENG Jin-hua,GAO Qi-sheng . Quality optimization of the multifactor and multi-index product[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 114 -117 .
[5] DING Wan-Tao, LI Shu-Cai, ZHANG Qing-Song. Discussion on interface error regularity of inclined  stratum predicted by TSP[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 57 -60 .
[6] WANG Bai-wei,CAO Sheng-le . A mult-objective assessment method of the effects of industrial waste-water management[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 89 -92 .
[7] WANG Kai,SUN Feng-zhong,ZHAO Yuan-bin,GAO Ming,GAO Shan . Mathematical model and numerical simulation of the air inlet flowfield of a natural-draft cooling tower[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(1): 13 -17 .
[8] GAO Yang, ZHANG Qing-Song, YUAN Xiao-Shuai, XU Zhen-Hao, LIU Bin. Application of geological radar to geological forecast in karst tunnel[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 82 -86 .
[9] CHOU Wu-Sheng, WANG Shuo. Study on the adaptive algorithm of the force reflection robotic master under large stiffness of the environment[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(1): 1 -5 .
[10] LI Shu-cai,WANG Zhao-qing,LI Shu-chen . A polygonal finite element method based on irrational function interpolation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(2): 66 -70 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd