JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2018, Vol. 48 ›› Issue (4): 20-26.doi: 10.6040/j.issn.1672-3961.0.2017.592

Previous Articles     Next Articles

A new method for muti-objects image segmentation based on faster region proposal networks

HUANG Jinchao   

  1. College of Information and Engineering, Longyan University, Longyan 364000, Fujian, China
  • Received:2017-11-23 Online:2018-08-20 Published:2017-11-23

PDF (PC)

1307

Abstract: Aim at the shortage of a large amount of redundancy and overlaps of conventional semantic segmentation algorithm, these shortages caused the image segmentation results getting lower accuracy and robust. A new algorithm of multi-objects image segmentation based on faster region proposal networks was proposed. A selective search algorithm was used to get the initial proposal boxes; a faster region proposal network was used to get initial image segmentation boxes. In order to validate our proposed algorithm, the VGG16 models that pre-trained on ImageNet was used on this problem. By using COCO dataset and Cityscapes dataset, the model was well fine-tuned. The test dataset was used for testing semantic segmentation and image segmentation. Compared with YOLO algorithm, the experimental results showed that our proposed algorithm increased mAP of 2.16% and 1.55%. The initial image segmentation boxes by faster region proposal networks were best fitted by GrabCut, multi-objects segmentation results were more accurate and robust. Our proposed algorithm got higher accuracy by sacrifice little time consumption, which got more application scenes in multi-object patterns recognition.

Key words: GrabCut algorithm, faster region proposal network(Faster RPN), selective search algorithm, muti-objects segmentation, image segmentation

CLC Number: 

  • TP391
[1] 姜枫,顾庆,郝慧珍,等.基于内容的图像分割方法综述[J].软件学报,2017,28(1):160-183. JIANG Feng, GU Qing, HAO Huizhen, et al. An overview of content-based image segmentation methods[J]. Journal of Software, 2017, 28(1):160-183.
[2] 刘金平,陈青,张进,等.基于集成学习的交互式图像分割[J].电子学报,2016,44(7):1649-1655. LIU Jinping, CHEN Qing, ZHANG Jin, et al. Interactive image segmentation based on integrated learning[J]. Journal of Electronics, 2016, 44(7):1649-1655.
[3] 陈海鹏,申铉京,龙建武,等.采用高斯拟合的全局阈值算法阈值优化框架[J].计算机研究与发展, 2016, 53(4): 892-903. CHEN Haipeng, SHEN Xuanjing, LONG Jianwu, et al. The global threshold optimization framework of gaussian fitting is adopted[J]. Journal of Computer Research and Development, 2016, 53(4):892-903.
[4] 申铉京,张赫,陈海鹏,等.快速递归多阈值分割算法[J].吉林大学学报(工学版),2016,46(2):528-534. SHEN Xuanjing, ZHANG He, CHEN Haipeng, et al. Fast recursive multi-threshold segmentation algorithm[J]. Journal of Jilin University(Engineering and Technology Edition), 2016, 46(2):528-534.
[5] 钱超,张晓林.基于稳定特征点和SLIC超像素分割的快速立体匹配[J].电子设计工程,2016,24(23):146-148,152. QIAN Chao, ZHANG Xiaolin. Fast stereo matching based on stable feature point and SLIC hyperpixel segmentation[J]. Electronic Design Engineering, 2016, 24(23):146-148,152.
[6] 王春波,董红斌,印桂生,等.基于Hadoop的超像素分割算法[J].计算机应用,2016,36(11):2985-2992. WANG Chunbo, DONG Hongbin, YIN Guisheng, et al. Hyperpixel segmentation algorithm based on Hadoop[J]. Journal of Computer Applications, 2016, 36(11):2985-2992.
[7] WANG X, LI H, BICHOT C E, et al. A graph-cut approach to image segmentation using an affinity graph based on l 0-sparse representation of features[C] //2013 20th IEEE International Conference on Image Processing(ICIP). Melbourne, Australia: IEEE, 2013: 4019-4023.
[8] REGO Liviane, SUMAILI Jean, MIRANDA Vladimiro, et al. Mean shift densification of scarce data sets in short-term electric power load forecasting for special days[J]. Electrical Engineering, 2017, 99(3):881-898.
[9] REDMON Joseph, DIVVALA Santosh, GIRSHICK Ross, et al. You only look once: unified, real-time object detection[C] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE, 2016:3213-3219.
[10] REN Shaoqing, HE Kaiming, ROSS Girshick, et al. Object detection networks on convolutional feature maps[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(7): 1476-1481.
[11] LI Z, TANG J. Weakly supervised deep metric learning for community-contributed image retrieval[J]. IEEE Transactions on Multimedia, 2015, 17(11): 1989-1999.
[12] CROMMELINCK S, BENNETT R, GERKE M, et al. SLIC superpixels for object delineation from UAV data[C] //ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Lund, Sweden: Directory of Open Access Journals, 2017(4): 9-16.
[13] LECUN Y, BENGIO Y, HINTON G. Deep learning[J]. Nature, 2015, 521(7553): 436-444.
[14] ZOPH Barret,VASUDEVAN Vijay, SHLENS Jonathon, et al. Learning transferable architectures for scalable image recognition[J]. arXiv preprint arXiv:1707.07012(2017).
[15] SCHMIDHUBER J. Deep learning in neural networks: An overview[J]. Neural networks, 2015, 61: 85-117.
[16] YU, SHAODE. Efficient segmentation of a breast in B-mode ultrasound tomography using three-dimensional GrabCut(GC3D)[J]. Sensors,2017,17(8): 1827.
[17] LIN T Y, MAIRE M, BELONGIE S,et al. Microsoft coco: common objects in context[C] //European Conference on Computer Vision. Zurich: Springer International Publishing, 2014: 740-755.
[18] CORDTS M, OMRAN M, RANMOS S. The cityscapes dataset for semantic urban scene understanding[C] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE, 2016: 3213-3223.
[19] NOWOZIN S. Optimal decisions from probabilistic models: the intersection-over-union case[C] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA: IEEE, 2014: 548-555.
[20] REDMON Joseph, FARHADI Ali. YOLO9000: better, faster, stronger[C] //Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE, 2017:1384-1392.
[1] Xinyu DONG,Hanyue CHEN,Jiaguo LI,Qingyan MENG,Shihe XING,Liming ZHANG. An unsupervised color image segmentation method based on fusion of multiple methods [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 96-101.
[2] LI Lu, FAN Wentao, DU Jixiang. Brain MR image segmentation based on student's t mixture model with Markov random field [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 49-55.
[3] HU Jinge, TANG Yan. Visual saliency detection based on visual center shift [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 27-33.
[4] FAN Shuyan, DING Shifei. An improved multi-scale Graph cut algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(1): 28-33.
[5] YU Hai-jing1,2, LI Gui-ju1*. Color smoke image recognition based on differential box-counting fractal dimension algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(1): 35-40.
[6] QI Shile, WANG Meiqing. Adaptive active contour model for weak boundary extractio [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2013, 43(6): 17-20.
[7] GUAN Yan, LI Cun-hua*, ZHONG Zhao-man, SUN Lan-lan. Segmentation algorithm of chemical molecular structure images [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(5): 65-70.
[8] ZHANG Xin-ming, MAO Wen-tao, LI Zhen-yun. Two-dimensional Otsu image thresholding based on second order generalized probability [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(1): 25-33.
[9] WANG Liya, PAN Zhenkuan, WEI Weibo*, LIU Cunliang, ZHANG Zhimei, WANG Yu. Alternating convex relaxation minimization of the multiphase image
segmentation model and its Split Bregman algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(2): 40-45.
[10] WANG Xin-pei1, LIU Chang-chun1*, BAI Tong2. An image segmentation method based on mean divergence [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(4): 36-41.
[11] , . An approach to detecting faces in color images [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(4): 0-0 .
[12] MA Zhi-qiang,CHANG Fa-liang,TIAN Wei,ZHAO Yao . An approach to face detection in color images [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(4): 19-22 .
[13] YANG Li-cai,ZHAO Li-na,WU Xiao-qing . Medical image segmentation of fuzzy Cmeans clustering based on the ant colony algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 51-54 .
[14] REN Chunxiao,YIN Yilong, . Fingerprint image segmentation based on label box [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(5): 54-57 .
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] ZHANG Yong-hua,WANG An-ling,LIU Fu-ping . The reflected phase angle of low frequent inhomogeneous[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 22 -25 .
[2] LI Kan . Empolder and implement of the embedded weld control system[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 37 -41 .
[3] KONG Xiang-zhen,LIU Yan-jun,WANG Yong,ZHAO Xiu-hua . Compensation and simulation for the deadband of the pneumatic proportional valve[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 99 -102 .
[4] LAI Xiang . The global domain of attraction for a kind of MKdV equations[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 87 -92 .
[5] YU Jia yuan1, TIAN Jin ting1, ZHU Qiang zhong2. Computational intelligence and its application in psychology[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 1 -5 .
[6] CHEN Rui, LI Hongwei, TIAN Jing. The relationship between the number of magnetic poles and the bearing capacity of radial magnetic bearing[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(2): 81 -85 .
[7] WANG Bo,WANG Ning-sheng . Automatic generation and combinatory optimization of disassembly sequence for mechanical-electric assembly[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 52 -57 .
[8] JI Tao,GAO Xu/sup>,SUN Tong-jing,XUE Yong-duan/sup>,XU Bing-yin/sup> . Characteristic analysis of fault generated traveling waves in 10 Kv automatic blocking and continuous power transmission lines[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 111 -116 .
[9] QIN Tong, SUN Fengrong*, WANG Limei, WANG Qinghao, LI Xincai. 3D surface reconstruction using the shape based interpolation guided by maximal discs[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 1 -5 .
[10] ZHANG Ying,LANG Yongmei,ZHAO Yuxiao,ZHANG Jianda,QIAO Peng,LI Shanping . Research on technique of aerobic granular sludge cultivationby seeding EGSB anaerobic granular sludge[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 56 -59 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd