JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2017, Vol. 47 ›› Issue (3): 56-62.doi: 10.6040/j.issn.1672-3961.0.2016.305

Previous Articles     Next Articles

An image saliency object detection algorithm based on adaptive manifold similarity

REN Yongfeng, DONG Xueyu   

  1. Electrical Power Simulation and Control Engineering Center, Nanjing Institute of Technology, Nanjing 210013, Jiangsu, China
  • Received:2016-07-22 Online:2017-06-20 Published:2016-07-22

PDF (PC)

914

Abstract: In order to improve the adaptability and precision in extracting salient regions in images, an image salient region detection algorithm was proposed based on adaptive manifold similarity. An input image was segmented into super-pixels which were represented as the nodes in a graph. The node with high frequency was generated by the characteristics of the salient regions. Convex hull computation was used to generate the saliency seeds of the salient object area according to high-frequency nodes. The proposed algorithm was used to complete information reconstruction of the current image by adaptively assessing the salient weights on the edges between the nodes. In addition, based on local characteristics information reconstruction, the proposed algorithm utilized similarity extraction function to self-adaptively obtain the similarity characteristics and manifold structures in order to spread salient characteristics information. The experimental results showed that the quadratic programming solution exploited to compute the weights between the nodes could effectively avoid threshold selection and enhance robustness accordingly, and the proposed method performed better than the other state-of-the-art methods.

Key words: saliency detection, manifold similarity, convex hull computation, spread salient characteristics, adaptive

CLC Number: 

  • TP301.6
[1] WANG Tiantian, XIU Chunbo, CHENG Yi. Vehicle recognition based on saliency detection and color histogram[C] //Proceedings of the 27th Chinese Control and Decision Conference(2015CCDC). Qingdao, China:IEEE, 2015:2532-2535.
[2] LINDEBERG T. Scale-Space Theory in Computer Vision[M].New York, USA:Springer International, 1994:349-382.
[3] THIMBLEBY H. Press on-principles of interaction programming[M].Massachusetts, USA:The MIT Press, 2007:224-271.
[4] QIN C, ZHANG G, ZHOU Y, et al. Integration of the saliency-based seed extraction and random walks for image segmentation[J]. Neurocomputing, 2014, 129(4):378-391.
[5] CHANG K Y, LIU T L, CHEN H T, et al. Fusing generic objectness and visual saliency for salient object detection[C] //Proceedings of the 2011 International Conference on Computer Vision(ICCV). Barcelona, Spain:IEEE, 2011:914-921.
[6] 任永峰, 周静波, 王志坚. 基于光线变化的显著性区域提取[J]. 南京大学学报(自然科学版), 2015, 51(1):125-131. REN Yongfeng, ZHOU Jingbo, WANG Zhijian. A saliency detection base on the change of light[J]. Journal of Nanjing University(Natural Sciences), 2015, 51(1):125-131.
[7] LIU T, YUAN Z, SUN J, et al. Learning to detect a salient object[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2011, 33(2):353-367.
[8] ROTHER C, KOLMOGOROV V, BLAKE A. Grab cut interactive foreground extraction using iterated graph cuts[C] //Proceedings of the ACM Transactions on Graphics. New York, USA:ACM, 2004, 23(3):309-314.
[9] 任永峰, 周静波. 基于信息弥散机制的图像显著性区域提取算法[J]. 山东大学学报(工学版), 2015(6):1-6. REN Yongfeng, ZHOU Jingbo. An image saliency object detection algorithm based on information diffusion[J]. Journal of Shandong University(Engineering Science), 2015(6):1-6.
[10] 李春雷, 张兆翔, 刘洲峰. 基于纹理差异视觉显著性的织物疵点检测算法[J]. 山东大学学报(工学版),2014,44(4):1-8. LI Chunlei, ZHANG Zhaoxiang, LIU Zhoufeng. A novel fabric defect detection algorithm based on textural differential visual saliency model[J]. Journal of Shandong University(Engineering Science), 2014, 44(4):1-8.
[11] 王秀芬, 王汇源, 王松. 基于背景差分法和显著性图的海底目标检测方法[J]. 山东大学学报(工学版), 2011, 41(1):12-16. WANG Xiufen, WANG Huiyuan, WANG Song. Underwater object detection based on background subtraction and a saliency map[J]. Journal of Shandong University(Engineering Science), 2011, 41(1):12-16.
[12] ACHANTA R, SHAJI A, SMITH K, et al. SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11):2274-2282.
[13] ZHU X J, GHAHRAMANI Z, LAFFERTY J D. Semi-supervised learning using Gaussian fields and harmonic functions [C] //Proceedings of the 20th International Conference on Machine Learning(ICML).Washington DC, USA:IEEE, 2003(2):912-919.
[14] GRETTON A, BORGWARD K M, RASCH M J, et al. A kernel method for the two-sample-problem[C] //Proceedings of the Advances in Neural Information Processing Systems. Vancouver, Canada:NIPS, 2007:513-520.
[15] XIE Y, LU H, YANG M. Bayesian saliency via low and mid-level cues[J]. IEEE Transactions on Image Processing, 2013, 22(5):1689-1698.
[16] VAN D W J, GEVERS T, BAGDANOV A D. Boosting color saliency in image feature detection[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2006, 28(1):150-156.
[17] LAAR Van De P, HESKES T, GIELEN S. Task-dependent learning of attention[J]. Neural Networks, 1997, 10(6):981-992.
[18] LI Y, MA Y F, ZHANG H J. Salient region detection and tracking in video[C] //Proceedings of the 2003 International Conference on Multimedia and Expo. Baltimore, USA:IEEE Computer Society, 2003(2):269-272.
[19] JIANG H, WANG J, YUAN Z, et al. Salient object detection:a discriminative regional feature integration approach[C] //Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR). Portland, USA: IEEE, 2013:2083-2090.
[20] SEO H J, MILANFAR P. Nonparametric bottom-up saliency detection by self-resemblance[C] //Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. Miami, USA:IEEE, 2009:45-52.
[21] ZHU J Y, WU J, XU Y, et al. Unsupervised object class discovery via saliency-guided multiple class learning[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2015, 37(4):862-875.
[22] JUNG C, KIM C. A unified spectral-domain approach for saliency detection and its application to automatic object segmentation[J]. IEEE Transactions on Image Processing, 2012, 21(3):1272-1283.
[23] MARGOLIN R, TAL A, ZELNIK-MANOR L. What makes a patch distinct? [C] // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Sydney, Australia:IEEE, 2013:1139-1146.
[24] WANG L, XUE J, ZHENG N, et al. Automatic salient object extraction with contextual cue[C] //Proceedings of the 2011 International Conference on Computer Vision(ICCV). Barcelona, Spain:IEEE, 2011:105-112.
[25] SUN J, LU H, LIU X. Saliency region detection based on markov absorption probabilities[J]. IEEE Transactions on Image Processing, 2015, 24(5):1639-1649.
[26] LI X, LU H, ZHANG L, et al. Saliency detection via dense and sparse reconstruction [C] //Proceedings of the 2013 IEEE International Conference on Computer Vision(ICCV). Sydney, Australia:IEEE, 2013:2976-2983.
[27] YAN Q, XU L, SHI J, et al. Hierarchical saliency detection[C] // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR). Portland, USA:IEEE, 2013:1155-1162.
[28] SHEN X, WU Y. A unified approach to salient object detection via low rank matrix recovery[C] //Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Providence, USA:IEEE, 2012:853-860.
[29] SANG Nong, WEI Longsheng, WANG Yuehuan. A biologically-inspired top-down learning model based on visual attention[C] //Proceedings of the International Conference on Pattern Recognition(ICPR)Istanbul. Turkey:IEEE, 2010:3736-3739.
[30] LYU Jiayong, TANG Zhenmin, XU Wei. Improved bayesian saliency detection based on bing and graph model[J]. Open Cybernetics & Systemics Journal, 2015, 9(1):648-656.
[1] ZHOU Qian, LI Qun, ZHU Dandan, LI Yibo. Coordinated inertia response control for offshore low frequency wind power system based on adaptive virtual inertia of M3C [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 30-39.
[2] LI Xiaohui, LIU Xiaofei, SUN Weitong, ZHAO Yi, DONG Yuan, JIN Yinli. An inspection task assignment and path planning algorithm based on vehicles-UAVs collaboration [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 101-109.
[3] ZHENG Xiao, CHEN He, ZHOU Dongao, GONG Yongshun. Video anomaly detection method based on video caption augmentation and dual-stream feature fusion [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 110-119.
[4] GAO Junjian, LIAO Zhuhua, LIU Yizhi, ZHAO Yijiang. Hierarchical multi-agent reinforcement learning based route guidance method combining personalization and signal control [J]. Journal of Shandong University(Engineering Science), 2025, 55(3): 34-45.
[5] Haigen MIN,Yukun FANG,Xia WU,Wuqi WANG. Fault diagnosis of vehicle-to-vehicle communication in networked traffic environment [J]. Journal of Shandong University(Engineering Science), 2021, 51(6): 84-92.
[6] Ye LIANG,Nan MA,Hongzhe LIU. Image-dependent fusion method for saliency maps [J]. Journal of Shandong University(Engineering Science), 2021, 51(4): 1-7.
[7] YANG Xiuyuan, PENG Tao, YANG Liang, LIN Hongfei. Adaptive multi-domain sentiment analysis based on knowledge distillation [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 15-21.
[8] LIANG Qixing, LI Bin, LI Zhi, ZHANG Hui, RONG Xuewen, FAN Yong. Algorithm of adaptive slope adjustment of quadruped robot based on model predictive control and its application [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 37-44.
[9] ZHOU Kaiqing, LI Hangcheng, MO Liping. Adaptive harmony search algorithm based on global optimization [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 47-56.
[10] Chunrui CHENG,Beixing MAO. Adaptive sliding mode synchronization of a class of nonlinear chaotic systems [J]. Journal of Shandong University(Engineering Science), 2020, 50(5): 1-6.
[11] WANG Chunyan, DI Jinhong, MAO Beixing. Sliding mode synchronization of fractional-order Rucklidge systems with unknown parameters based on a new type of reaching law [J]. Journal of Shandong University(Engineering Science), 2020, 50(4): 40-45.
[12] Baocheng LIU,Yan PIAO,Xuemei SONG. Adaptive fusion target tracking based on joint detection [J]. Journal of Shandong University(Engineering Science), 2020, 50(3): 51-57.
[13] Wei YAN,Damin ZHANG,Huijuan ZHANG,Ziyun XI,Zhongyun CHEN. Improved bird swarm algorithms based on mixed decision making [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 34-43.
[14] Shengnan ZHANG,Lei WANG,Chunhong CHANG,Benli HAO. Image denoising based on 3D shearlet transform and BM4D [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 83-90.
[15] Jialin SU,Yuanzhuo WANG,Xiaolong JIN,Xueqi CHENG. Entity alignment method based on adaptive attribute selection [J]. Journal of Shandong University(Engineering Science), 2020, 50(1): 14-20.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LI Kan . Empolder and implement of the embedded weld control system[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 37 -41 .
[2] LAI Xiang . The global domain of attraction for a kind of MKdV equations[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 87 -92 .
[3] YU Jia yuan1, TIAN Jin ting1, ZHU Qiang zhong2. Computational intelligence and its application in psychology[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 1 -5 .
[4] CHEN Rui, LI Hongwei, TIAN Jing. The relationship between the number of magnetic poles and the bearing capacity of radial magnetic bearing[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(2): 81 -85 .
[5] WANG Bo,WANG Ning-sheng . Automatic generation and combinatory optimization of disassembly sequence for mechanical-electric assembly[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 52 -57 .
[6] ZHANG Ying,LANG Yongmei,ZHAO Yuxiao,ZHANG Jianda,QIAO Peng,LI Shanping . Research on technique of aerobic granular sludge cultivationby seeding EGSB anaerobic granular sludge[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 56 -59 .
[7] Yue Khing Toh1， XIAO Wendong2， XIE Lihua1. Wireless sensor network for distributed target tracking: practices via real test bed development[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 50 -56 .
[8] SUN Weiwei， WANG Yuzhen. Finite gain stabilization of singlemachine infinite bus system subject to saturation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 69 -76 .
[9] SUN Yu-li,LI De-fa,ZUO Dun-wen,QI mei . [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(6): 19 -23 .
[10] WANG Yong, XIE Yudong. Gas control technology of largeflow pipe[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(2): 70 -74 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd