JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2016, Vol. 46 ›› Issue (5): 1-6.doi: 10.6040/j.issn.1672-3961.1.2015.316

    Next Articles

Image annotation refinement based on contextual graph diffusion

TIAN Feng1, LIU Zhuoxuan1, SHANG Fuhua1*, SHEN Xukun2, WANG Mei1, WANG Haochang1   

  1. 1. School of Computer and Information Technology, Northeast Petroleum University, Daqing 163318, Heilongjiang, China;
    2. State Key Laboratory of Virtual Reality Technology and Systems, BeiHang University, Beijing 100191, China
  • Received:2015-03-01 Online:2016-10-20 Published:2015-03-01

PDF (PC)

747

Abstract: A new image annotation refinement method was proposed. The initial labels were firstly obtained by annotation methods. Then label relevant graph and visual relevant graph were constructed and mutually reinforced. The semantic optimization problem was formulated into a regularized framework on above undirected weighted graphs. With strategies like data partitioning, successive optimization and constraint relaxation, an approximate optimized solution was got. The refined result could be more related to the content of images by incorporating both visual content and contextual information. Moreover, the proposed method was robust with the partition granularity, and the complexity was approximately linear. Experimental results on large scale web image dataset showed that the proposed method outperformed others, and could achieve both efficiency and capability.

Key words: contextual information diffusion, large scale data set, contextual graph, image annotation, annotation refinement

CLC Number: 

  • TP391
[1] JIN Y H, KHAN L, WANG L. Image annotations by combining multiple evidence & Wordnet[C] //13th Annual ACM International Conference on Multimedia. Singapore: ACM Press, 2005:706-715.
[2] JIN Y H, KHAN L, PRABHAKARAN B. Knowledge based image annotation refinement[J]. Journal of Signal Processing Systems, 2010, 58(3):387-406.
[3] WANG C H, FENG J, ZHANG L, et al. Image annotation refinement using random walk with restarts[C] //14th ACM International Conference on Multimedia. Santa Barbara, USA: ACM Press, 2006:647-650.
[4] WANG C H, FENG J, ZHANG L, et al. Content-based image annotation refinement[C] //IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, USA: IEEE Press, 2007:1-8.
[5] LI X R, SNOEK C G M, WORRING M. Learning social tag relevance by neighbor voting[J]. IEEE Transactions on Multimedia, 2009:1310-1322
[6] LIU D, HUA X C, YANG L J, et al. Tag ranking[C] //18th Proceedings of the Intenational World Wide Web Conference. Madrid, Spain: ACM Press, 2009:351-360.
[7] CHEN L, XU D, TSANG I W. Tag-based web photo retrieval improved by batch mode re-tagging[C] //23th IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE Press, 2010:3440-3446.
[8] FAN J P, SHEN Y, ZHOU N. Harvesting large-scale weakly-tagged image databases from the web[C] //23th IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE Press, 2010:802-809.
[9] RABINOVICH A, VEDALDI A, GALLEGUILLOS C, et al. Objects in context[C] //11th IEEE International Conference on Computer Vision. Rio de Janeiro,Brazil: Institute of Electrical and Electronics Engineers, 2007:1-8.
[10] MALISIEWICZ T, EFROS A A. Beyond categories: the visual memex model for reasoning about object relationships[C] //23th Conference on Advances in Neural Information Processing Systems. Vancouver, Canada: Curran Associates, 2009:1222-1230.
[11] CHOI M J, LIM J J, TORRALBA A. Exploiting hierarchical context on a large database of object categories[C] //23th IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE Press, 2010:129-136.
[12] LEE Y J, GRAUMAN K. Object-graphs for context-aware category discovery[C] //23th IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE Press, 2010:1-8.
[13] WANG H, HUANG H, DING C. Image annotation using multi-label correlated Greens function[C] //12th IEEE International Conference on Computer Vision. Kyoto, Japan: IEEE Press, 2009:1-8.
[14] WANG H, HUANG H, DING C. Multi-label feature transform for image classifications[C] //11th European Conference on Computer Vision. Crete, Greece: Springer Press, 2010:793-806.
[15] WANG H, HUANG H, DING C. Image annotation using bi-relational graph of images and semantic labels[C] //24th IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE Press, 2011:793-800.
[16] JIANG Y G, QI D, WANG J, et al. Fast semantic diffusion for large-scale context-based image and video annotation[J]. IEEE Transactions on Image Processing, 2012, 21(6):3080-3091.
[17] HUANG S J, ZHOU Z H. Multi-label learning by exploiting label correlations locally[C] //26th National Conference on Artificial Intelligence. Toronto, Canada: AI Access Foundation, 2012:949-955.
[18] YANG Y, WU F, NIE F P. Web and personal image annotation by mining label correlation with relaxed visual graph embedding[J]. IEEE Transactions on Image Processing, 2012, 21(3): 1339-1351.
[19] XIANG Y, ZHOU X D, LIU Z T, et al. Semantic context modeling with maximal margin conditional random fields for automatic image annotation[C] //28th IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE Press, 2010:3368-3375.
[20] CHUA T S, TANG J H, HONG R H. NUS-WIDE: a real-world web image database from national university of singapore[C] //8th ACM Conference on Image and Video Retrieval. Santorini Island, Greece: ACM Press, 2009:1-9.
[21] HUISKES M J, LEW M S. The MIR flickr retrieval evaluation[C] //1st ACM International Conference on Multimedia Information Retrieval. Vancouver, Canada: ACM, 2008:39-43.
[1] ZHU Na-na1, 2, ZHANG Hua-xiang1, 2*, LIU Li1, 2. Automatic image annotation based on approved FCM algorithm and Bayesian classification [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2013, 43(6): 12-16.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] LI Ke,LIU Chang-chun,LI Tong-lei . Medical registration approach using improved maximization of mutual information[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 107 -110 .
[2] YUE Yuan-Zheng. Relaxation in glasses far from equilibrium[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(5): 1 -20 .
[3] WANG Yong, XIE Yudong. Gas control technology of largeflow pipe[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(2): 70 -74 .
[4] LIU Xin 1, SONG Sili 1, WANG Xinhong 2. [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(2): 98 -100 .
[5] MENG Jian, LI Yibin, LI Bin. Bound gait controlling method of quadruped robot[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 28 -34 .
[6] HANG Guang-qing,KONG Fan-yu,LI Da-xing, . Efficient algorithm with resistance to simple power analysis on Koblitz curves[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 78 -80 .
[7] XU Yan-sheng,LIU Xing-fang . Application of the fuzzy clustering iterative model to the evalution of water resource carrying capacity[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 100 -104 .
[8] LI Shan-ping,HU Zhen,SUN Yi-ming*,ZHEN Bo-ru,ZHANG Qi-lei,CAO Han-lin . Preparation and evaluation of the electro-catalytic characteristics of novel lead Ti-based dioxide electrodes[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 109 -113 .
[9] LI Xin-Ping, DAI Yi-Fei, HU Jing. Fluid-solid coupling analysis of surrounding rock mass stability and water inflow forecast of a tunnel in a karst zone[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 1 -6 .
[10] HE Dongzhi, ZHANG Jifeng, ZHAO Pengfei. Parallel implementing probabilistic spreading algorithm using MapReduce programming mode[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 0, (): 22 -28 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd