JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2017, Vol. 47 ›› Issue (2): 80-85.doi: 10.6040/j.issn.1672-3961.0.2016.221

Previous Articles     Next Articles

A visual saliency detection based on background and foreground interaction

ZHAI Jiyou1,2, ZHOU Jingbo1, REN Yongfeng2, WANG Zhijian2   

  1. 1. School of Computer Engineering, Nanjing Institute of Technology, Nanjing 211167, Jiangsu, China;
    2. College of Computer and Information, Hohai University, Nanjing 211100, Jiangsu, China
  • Received:2016-06-21 Online:2017-04-20 Published:2016-06-21

Abstract: In order to extract the salient region of image efficiently, a new algorithm model of image saliency detection based on background and foreground interaction was proposed. To find the significant elements in the image, a new model using an interactive feature propagation method to diffuse the significant features was built. The image was segmented into superpixels with different parameters. The salient value of each superpixel was obtained by background and foreground interaction according to a single scale. The final saliency map was obtained by the weighted average fusion of multiple salient values in different scale, and the optimization using the smoothing mechanism. Experimental results showed that the proposed method performed better than the other state-of-the-art methods, which improved the adaptability to the size of salient regions. In addition, our method was proved better not only in restraining the noise, but also in making the salient objects more uniform.

Key words: background, foreground, interactive propagation, saliency detection

CLC Number: 

  • TP301.6
[1] ZHANG H, XU M, ZHUO L, et al. A novel optimization framework for salient object detection[J]. Visual Computer, 2016, 32(1):31-41.
[2] 李春雷, 张兆翔, 刘洲峰. 基于纹理差异视觉显著性的织物疵点检测算法[J].山东大学学报(工学版),2014,44(4):1-8. LI Chunlei, ZHANG Zhaoxiang, LIU Zhoufeng. A novel fabric defect detection algorithm based on textural differential visual saliency model[J]. Journal of Shandong University(Engineering Science), 2014, 44(4):1-8.
[3] 钱生,陈宗海,林名强,等.基于条件随机场和图像分割的显著性检测[J].自动化学报,2015,41(4):711-724. QIAN Sheng, CHEN Zonghai, LIN Mingqiang, et al. Saliency detection based on conditional random field and image segmentation[J]. Acta Automatica Sinica, 2015, 41(4):711-724.
[4] 任永峰,周静波.基于信息弥散机制的图像显著性区域提取算法[J]. 山东大学学报(工学版), 2015, 45(6):1-6. REN Yongfeng, ZHOU Jingbo. An image saliency object detection algorithm based on information diffusion[J]. Journal of Shandong University(Engineering Science), 2015, 45(6):1-6.
[5] JIANG H, WANG J, YUAN Z, et al. Salient object detection: a discriminative regional feature integration approach[C] //IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA: IEEE Press, 2014:2083-2090.
[6] ZHU W, LIANG S, WEI Y, et al. Saliency optimization from robust background detection[C] //IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA:IEEE Press, 2014:2814-2821.
[7] GOPALAKRISHNAN V, HU Y Q, RAJAN D. Random walks on graphs for salient object detection in images[J]. IEEE Transactions on Image Processing, 2010, 19(12):3232-3242.
[8] ACHANTA R, HEMAMI S, ESTRADA F, et al. Frequency-tuned salient region detection[C] //IEEE Conference on Computer Vision and Pattern Recognition. Miami,Florida, USA: IEEE Press, 2009:1597-1604.
[9] Kim J S, Kim H, Sim J Y, et al. Video saliency detection based on random walk with restart[C] //IEEE International Conference on Image Processing, 2013:2465-2469.
[10] YANG C, ZHANG L, LU H, et al. Saliency detection via graph-based manifold ranking[C] //IEEE Conference on Computer Vision and Pattern Recognition.Portland, USA: IEEE Press, 2013:3166-3173.
[11] MOSCHENI F, BHATTACHARJEE S, KUNT M. Spatio-temporal segmentation based on region merging[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(9):897-915.
[12] ZHAI J, ZHOU J, REN Y, et al. Salient object detection via multiple random walks[J].KSII Transactions on Internet and Information Systems, 2016, 10(4):1712-1731.
[13] 徐少平,刘小平, 李春泉,等.基于稠密局部自相似特征流的图像配准算法[J].光电子·激光,2013,24(8):1619-1628. XU Shaoping, LIU Xiaoping, LI Chunquan, et al. An image registration algorithm based on dense local self-similarity feature flow[J].Journal of Optoelectronics.Laser, 2013, 24(8):1619-1628.
[14] HOU X, ZHANG L. Saliency detection: a spectral residual approach[C] //IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, Minnesota, USA: IEEE Press, 2007:1-8.
[15] XIA C, QI F, SHI G, et al. Nonlocal center—surround reconstruction-based bottom-up saliency estimation[J]. Pattern Recognition, 2015, 48(4):1337-1348.
[16] MARGOLIN R, TAL A, ZELNIK-MANOR L. What makes a patch distinction[C] //IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA:IEEE Press, 2013:1139-1146.
[17] CHANG K Y, LIU T L, CHEN H T, et al. Fusing generic objectness and visual saliency for salient object detection[C] //IEEE International Conference on Computer Vision. Barcelona, Spain:IEEE Press, 2011:914-921.
[18] YAN Q, XU L, SHI J, et al. Hierarchical saliency detection[C] //IEEE International Conference on Computer Vision. Portland, USA: IEEE Press, 2013:1155-1162.
[19] WANG L, XUE J, ZHENG N, et al. Automatic salient object extraction with contextual cue[C] //IEEE International Conference on Computer Vision. Barcelona, Spain: IEEE Press, 2011:105-112.
[20] ZHOU J, REN Y, YAN Y, et al. Salient object detection: manifold-based similarity adaptation approach[J]. Journal of Electronic Imaging, 2014, 23(6):704-714.
[21] JIANG H, WANG J, YUAN Z, et al. Salient object detection: a discriminative regional feature integration approach[C] //IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA:IEEE Press, 2013:2083-2090.
[22] ACHANTA R, HEMAMI S, ESTRADA F, et al. Frequency-tuned salient region detection[C] //IEEE Conference on Computer Vision and Pattern Recognition. Miami,USA: IEEE Press, 2009:1597-1604.
[23] ZHOU D, BOUSQUET O, LAL T N, et al. Learning with local and global consistency[J]. Advances in Neural Information Processing Systems, 2004, 17(4):321-328.
[1] HUI Kaifa, CHENG Keyang, ZHAN Yongzhao. The video synopsis based on the enhanced ViBe algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 43-48.
[2] REN Yongfeng, DONG Xueyu. An image saliency object detection algorithm based on adaptive manifold similarity [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 56-62.
[3] LIU Yingxia, WANG Xichang, TANG Xiaoli, CHANG Faliang. Object detection algorithm based on Bayesian probability estimation in wavelet domain [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(2): 63-70.
[4] REN Yongfeng, ZHOU Jingbo. An image saliency object detection algorithm based on information diffusion [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(6): 1-6.
[5] GUO Zhibo, DONG Jian, PANG Cheng. A Mean-Shift target tracking algorithm fused multi technology [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(2): 10-16.
[6] GONG Yuehong, LUO Min*, YU Mingyan, JIN Jie. Transfer function modeling algorithm  for digital background calibration in Pipeline ADC [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(3): 41-47.
[7] QIU Xiaoxin1,2, ZHANG Wenqiang1,2*, QIN Jinxian1,2, DU Zhengyang1,2, ZHANG Defeng1,2. Multi-target real-time tracking method under harsh environment [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(2): 21-27.
[8] SI Junshu, ZHU Wenxing*, SHA Yonghe. A comprehensive method for traffic lights detection in complex background [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(2): 64-68.
[9] WANG Xiu-fen, WANG Hui-yuan, WANG Song. Underwater object detection based on background subtraction and a saliency map [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(1): 12-16.
[10] CUI Ying,CHEN Wen-kai,LEI Fei . Swimmer detection based on background subtraction [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(1): 39-42 .
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!