JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2018, Vol. 48 ›› Issue (3): 127-133.doi: 10.6040/j.issn.1672-3961.0.2017.423

Previous Articles     Next Articles

An radial basis function neural network model based on monotonic constraints

CAO Ya, DENG Zhaohong*, WANG Shitong   

  1. School of Digital Media, Jiangnan University, Wuxi 214122, Jiangsu, China
  • Received:2017-05-05 Online:2018-06-20 Published:2017-05-05

Abstract: Radial basis function(RBF)neural network was a type of efficient feedforward neural network, which had simple structure and good generalization ability. It had been widely used in data classification. However, for some special classification scenarios, such as the scenarios of dealing with the monotonic data, RBF neural network could not fully realize its potential. For this challenge, monotonic radial basis function neural network(MC-RBF)was proposed. The model added a prior knowledge about monotonicity which was expressed in terms of inequality based on partial order of training data. The Tikhonov regularization was introduced to MC-RBF to ensure the uniqueness and boundedness of the solution of the optimization problem. The experimental results showed that MC-RBF had better classification performance than the classical RBF neural network when dealing with monotonic datasets.

Key words: monotonic constraint, data classification, Tikhonov regularization, radial basis function neural network, classification performance

CLC Number: 

  • TP391
[1] 罗小波,王云安,肖春宝,等. RBF神经网络在遥感影像分类中的应用研究[J]. 遥感技术与应用, 2004, 16(2): 119-123. LUO Xiaobo, WANG Yunan, XIAO Chunbao, et al. The application of RBF neural network in remote sensing image classification[J]. Remote Sensing Technology and Application, 2004, 16(2): 119-123.
[2] 那文波,何宁,刘巍,等. 基于遗传算法优化的RBF神经网络的压力传感器故障诊断[J]. 煤矿机械, 2016(7): 180-183. NA Wenbo, HE Ning, LIU Wei, et al. Fault diagnosis of pressure sensor based on RBF neural network optimized by genetic algorithm[J]. Coal Mine Machinery, 2016(7):180-183.
[3] BEN-David A, STERLING L, PAO Y H. Learning and classification of monotonic ordinal concepts[J]. Computational Intelligence, 1989, 5(1): 45-49.
[4] BEN-DAVID A. Monotonicity maintenance in information-theoretic machine learning algorithms[J]. Machine Learning, 1995, 19(1): 29-43.
[5] LI S T, CHEN C C. A regularized monotonic fuzzy support vector machine model for data mining with prior knowledge[J]. IEEE Transactions on Fuzzy Systems, 2015, 23(5):1713-1727.
[6] MAES C M. A regularized active-set method for sparse convex quadratic programming[D]. Palo Alto, USA: Stanford University, 2010.
[7] VAUHKONEN M, VADASZ D, KARJALAINEN P A, et al. Tikhonov regularization and prior information in electrical impedance tomography[J]. IEEE Transactions on Medical Imaging, 1998, 17(2):285-293.
[8] TIKHONOV A N, ARSENIN V Y. Solutions of Ill-posed problems[J]. Mathematics of Computation, 1977, 32(144):491-491.
[9] ABU-MOSTAFA Y S. Hints[J]. Neural Computation, 1995, 7(4):639-671.
[10] ABU-MOSTAFA Y S. Learning from hints[J]. Complexity, 1994, 10: 165-178.
[11] WISMER D, CHATTERGY R. Introduction to nonlinear optimization[M]. Amsterdam, Netherland: North Holland, 1978:227-313.
[12] WANG J J, ZHANG C F, JING Y Y. Self-adaptive RBF neural network PID control in exhaust temperature of micro gas turbine[C] //International Conference on Machine Learning and Cybernetics. Kunming: IEEE, 2008:2131-2136.
[13] 黄涛. 基于RBF神经网络的非线性回归模型[EB/OL].(2011-3-29)[2017-3-18]. http://www.paper.edu.cn. HUANG Tao. An nonlinear regression model based on RBF neural network [EB/OL].(2011-3-29)[2017-3-18]. http://www.paper.edu.cn.
[14] 田俊峰, 张晶, 毕志明. 基于改进的 RBF神经网络的入侵检测研究[J]. 计算机工程与应用, 2008, 44(31): 135-138. TIAN Junfeng, ZHANG Jing, BI Zhiming. Research of intrusion detection based on improved RBF neural network[J]. Computer Engineering and Applications, 2008, 44(31): 135-138.
[15] NIROS A D, TSEKOURAS G E, TSOLAKIS D, et al. Hierarchical fuzzy clustering in conjunction with particle swarm optimization to efficiently design RBF neural networks[J]. Journal of Intelligent & Robotic Systems, 2015, 78(1): 105-125.
[16] NIROS A D, TSEKOURAS G E. A novel training algorithm for RBF neural network using a hybrid fuzzy clustering approach[J]. Fuzzy Sets and Systems, 2012, 193: 62-84.
[17] YUN Z, QUAN Z, CAIXIN S, et al. RBF neural network and ANFIS-based short-term load forecasting approach in real-time price environment[J]. IEEE Transactions on Power Systems, 2008, 23(3): 853-858.
[18] 唐启义, 冯明光. DPS数据处理系统: 实验设计、统计分析及模型优化[M]. 北京: 科学出版社, 2006. TANG Qiyi, FENG Mingguang. DPS data processing system: experimental design: Statistical Analysis and Modeling[M]. Beijing: Science Press, 2006.
[19] LI Y, QIANG S, ZHUANG X, et al. Robust and adaptive backstepping control for nonlinear systems using RBF neural networks[J]. IEEE Transactions on Neural Networks, 2004, 15(3): 693-701.
[20] LIN C L, WANG J F, CHEN C Y, et al. Improving the generalization performance of RBF neural networks using a linear regression technique[J]. Expert Systems with Applications, 2009, 36(10): 12049-12053.
[21] BURGES C J C. A tutorial on support vector machines for pattern recognition[J]. Data Mining & Knowledge Discovery, 1998, 2(2):121-167.
[1] XIONG Bingyan, WANG Guoyin, DENG Weibin. Hierarchical cost sensitive decision tree and its application in the prediction of the mobile phone replacement [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(5): 36-42.
[2] WANG Xiaochu, WANG Shitong, BAO Fang. Image classification algorithm based on minimax probability machine with regularized probability density concensus [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(5): 13-21.
[3] ZHANG Dongbo, KOU Tao, XU Haixia. Fast scene recognition based on LDB descriptor and local spatial structure matching [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 16-23.
[4] CHEN Haiyong, YU Li, LIU Hui, YANG Jiabo, HU Qidi. Solar cell defect images fusion based on empirical wavelet [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 24-31.
[5] MOU Lianming. Weighted k sub-convex-hull classifier based on adaptive feature selection [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 32-37.
[6] SHEN Dongdong, ZHOU Fengyu, LI Mengyuan, WANG Shuqian, GUO Renhe. Indoor wireless positioning based on ensemble deep neural network [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 95-102.
[7] ZHANG Pu, LIU Chang, WANG Yong. Suggestion sentence classification model based on feature fusion and ensemble learning [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 47-54.
[8] WANG Guoxin, CHEN Fengdong, LIU Guodong. Feature extraction method of color pseudo-random coded structured light [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 55-60.
[9] HU Jianping, LI Xin, XIE Qi, LI Ling, ZHANG Daochang. An unconstrained optimization EMD approach in 2D based on Delaunay triangulation [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 9-15.
[10] LI Guangli, LIU Bin, ZHU Tao, YIN Yi, ZHANG Hongbin. Cross-media retrieval model based on choosing key canonical correlated vectors [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 38-46.
[11] WU Chenmou, FANG Zhijun, HWANG Jenqneng. Active driving behavior analysis algorithm based on monocular camera [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(5): 69-76.
[12] ZHANG Xianhong, ZHANG Chunrui. Image enhancement algorithm based on six dimensional feedforward neural network model [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 10-19.
[13] JIANG Shanshan, YANG Jing, FAN Liya. An image feature extraction method based on PDEs [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 27-36.
[14] DOU Tingting, YAO Yuanxi, CHEN Peng, LU Deng. Arc modeling and practical simulation application based on ATP-EMTP [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 102-108.
[15] HUANG Jinchao. A new method for muti-objects image segmentation based on faster region proposal networks [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 20-26.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!