Journal of Shandong University(Engineering Science) ›› 2021, Vol. 51 ›› Issue (3): 22-29.doi: 10.6040/j.issn.1672-3961.0.2020.232

Previous Articles     Next Articles

Small sample person re-identification combining Gabor features and convolution features

FU Guixia, ZOU Guofeng*, MAO Shuai, PAN Jinfeng, YIN Liju   

  1. College of Electrical &
    Electronic Engineering, Shandong University of Technology, Zibo 255049, Shandong, China
  • Online:2021-06-20 Published:2021-06-24

Abstract: In the video surveillance, the limited available person images and unreliable data annotation led to the performance degradation of supervised person re-identification. To solve these problems, we proposed an unsupervised small sample person re-identification method that integrated Gabor features and convolution features. Gabor transform was used to extract multi-scale and multi-direction person texture and edge information, so as to realize the data augmentation of small sample person images in feature level. The redundant information was eliminated by feature encoding to improve the efficiency of feature similarity calculation. The convolutional auto-encoder network was adopted to extract the nonlinear deep convolution feature of pedestrian, which avoided the dependence of supervised learning algorithm on data annotation. The fusion of two heterogeneous features was applied to person similarity comparison, which implemented the feature augmentation of small samples and the improvement of person feature discrimination ability. Experiments were implemented based on Market-1501 and DukeMTMC-reID datasets, the rank-1 accuracy reached 74% and 67.1% respectively. The experimental results showed that the proposed network framework effectively improved the performance of small sample person re-identification.

Key words: Gabor transform, feature encoding, convolutional auto-encoder network, unsupervised learning, small sample person re-identification

CLC Number: 

  • TP391
[1] BEDAGKAR G A, SHAH S K. A survey of approaches and trends in person re-identification[J]. Image and Vision Computing, 2014, 32(4):270-286.
[2] 李幼蛟,卓力,张菁,等. 行人再识别技术综述[J]. 自动化学报, 2018, 44(9): 1554-1568. LI Y J, ZHUO L, ZHANG J, et al. A survey of person re-identification[J]. Acta Automatica Sinica, 2018, 44(9): 1554-1568.
[3] LV J M, CHEN W H, LI Q, et al. Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns[C] //Proceeding of the 2018 IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE, 2018: 7948-7956.
[4] ZHONG Z, ZHENG L, ZHENG Z D, et al. CamStyle: a novel data augmentation method for person re-identi-fication[J]. IEEE Transaction on Image Processing, 2019, 28(3): 1176-1190.
[5] 金翠,王洪元,陈首兵. 基于随机擦除行人对齐网络的行人重识别方法[J]. 山东大学学报(工学版),2018,48(6): 67-73. JIN Cui, WANG Hongyuan, CHEN Shoubing. Person re-identification based on random erasing pedestrian alignment network method[J]. Journal of Shandong University(Engineering Science), 2018, 48(6): 67-73.
[6] CHEN Y C, ZHU X T, ZHENG W S, et al. Person re-identification by camera correlation aware feature augmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(2): 392-408.
[7] ZHAO C R, WANG X K, MIAO D Q, et al. Maximal granularity structure and generalized multi-view discri-minant analysis for person re-identification[J]. Pattern Recognition, 2018, 79: 79-96.
[8] VINYALS O, BLUNDELL C, LILLICRAP T, et al. Matching networks for one shot learning[C] //Proceeding of the 2016 Conference on Neural Information Processing Systems. Barcelona, Spain: NIPS, 2016: 3630-3638.
[9] LIAO S, HU Y, ZHU X, et al. Person re-identification by local maximal occurrence representation and metric learning[C] //Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE, 2015: 2197-2206.
[10] WANG H, GONG S, XIANG T. Unsupervised learning of generative topic saliency for person re-identification[C] //Proceedings of the 2014 British Machine Vision Conference. Nottingham, UK: Springer, 2014.
[11] YAN C, LUO M, LIU W, et al. Robust dictionary learning with graph regularization for unsupervised person re-identification[J]. Multimedia Tools and Applications, 2018, 77(3): 3553-3577.
[12] DAUGMAN J. Uncertainty relation for resolution in space, spatial, frequency, and orientation optimized by two-dimensional visual cortical filters[J]. Journal of the Optical Society of America, 1985, 2(7): 1160-1169.
[13] RUMELHART D E, HINTON G E, WILLIAMS R J. Learning representations by back-propagating errors[M]. Cambridge, Massachusetts, USA: MIT Press, 1986:533-536.
[14] MASCI J, MEIER U, CIRESAN D, et al. Stacked convolutional auto-encoders for hierarchical feature extraction [C] //Proceedings of the 2011 International Conference on Artificial Neural Networks. Espoo, Finland: Springer, 2011: 52-59.
[15] ZHENG L, SHEN L Y, TIAN L, et al. Scalable person re-identification: a benchmark[C] //Proceedings of the 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015:1116-1124.
[16] RISTANI E, SOLERA F, ZOU R, et al. Performance measures and a data set for multi-target, multi camera tracking[C] //Proceedings of the 2016 European Conference on Computer Vision. Cham, Switzerland: Spr-inger, 2016: 17-35.
[17] LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
[18] NG A. Sparse auto-encoder[R]. Stanford University, USA: CS294A Lecture Notes, 2011, 72: 1-19.
[19] BENGIO Y, LAMBLIM P, POPPVIVI D, et al. Greedy layer-wise training of deep networks[C] //Proceedings of the 2007 Conference on Neural Information Processing Systems. Vancouver, Canada: NIPS, 2007: 153-160.
[20] RADFORD A, METZ, CHINTALA S. Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks[C] //Proceedings of the 4th International Conference on Learning Representations. San Juan, Puerto Rico: ICLR, 2016: 1-16.
[1] Jun QIN,Yuanpeng ZHANG,Yizhang JIANG,Wenlong HANG. Transfer fuzzy clustering based on self-constraint of multiple medoids [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 107-115.
[2] SHEN Ji, MA Zhiqiang, LI Tuya, ZHANG Li. A word extend LDA model for short text sentiment [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 120-126.
[3] CHEN Bin, CHEN Song-Can, PAN Zhi-Song, LI Bin. Survey of outlier detection technologies [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(6): 13-23.
Full text



[1] ZHANG Yong-hua,WANG An-ling,LIU Fu-ping . The reflected phase angle of low frequent inhomogeneous[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 22 -25 .
[2] SHI Lai-shun,WAN Zhong-yi . Synthesis and performance evaluation of a novel betaine-type asphalt emulsifier[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 112 -115 .
[3] LI Liang, LUO Qiming, CHEN Enhong. Graph-based ranking model for object-level search
[4] CHEN Rui, LI Hongwei, TIAN Jing. The relationship between the number of magnetic poles and the bearing capacity of radial magnetic bearing[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(2): 81 -85 .
[5] LI Ke,LIU Chang-chun,LI Tong-lei . Medical registration approach using improved maximization of mutual information[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 107 -110 .
[7] QIN Tong, SUN Fengrong*, WANG Limei, WANG Qinghao, LI Xincai. 3D surface reconstruction using the shape based interpolation guided by maximal discs[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 1 -5 .
[8] ZHANG Ying,LANG Yongmei,ZHAO Yuxiao,ZHANG Jianda,QIAO Peng,LI Shanping . Research on technique of aerobic granular sludge cultivationby seeding EGSB anaerobic granular sludge[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 56 -59 .
[9] WANG Li-ju,HUANG Qi-cheng,WANG Zhao-xu . [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(6): 51 -56 .
[10] Yue Khing Toh1, XIAO Wendong2, XIE Lihua1. Wireless sensor network for distributed target tracking: practices via real test bed development[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 50 -56 .