Journal of Shandong University(Engineering Science) ›› 2019, Vol. 49 ›› Issue (6): 1-10.doi: 10.6040/j.issn.1672-3961.0.2019.312

• The Invited Paper of the Editorial Board •     Next Articles

Review of capsule network

Jucheng YANG(),Shujie HAN,Lei MAO,Xiangzi DAI,Yarui CHEN   

  1. College of Artificial Intelligence, Tianjin University of Science and Technology, Tianjin 300457, China
  • Received:2019-06-13 Online:2019-12-20 Published:2019-12-17

RichHTML

143

PDF (PC)

2102

Abstract:

Recently capsule network with dynamic routing was the new neural network model which was considered a significant model in next generation. In recent years, much research evidenced capsule network exceptional ability to fit features. But the high computational overhead made it unable to fit complex and large datasets. Consequently, reducing computational became a research hotspot. There were two methods, including optimized capsule and optimized routing, to solve the issue. Optimized capsule was usually driven by application purpose which was designed as a model of specific classification tasks. And optimized routing was the way to improve the performance of the model from an algorithmic perspective.

Key words: capsule network, neural network, dynamic routing, optimized capsule, optimized routing

CLC Number: 

  • TP301.6

Fig.1

The structure of capsule network"

Fig.2

The structure of capsule network"

Fig.3

The orthogonal component of the feature inthe capsule subspace"

Fig.4

The structure of DCNet++"

Fig.5

The structure of PathCapsNet"

Fig.6

The structure of HitNet"

Table 1

Comparison of two capsule networks"

模型 胶囊类型 路由方法 鲁棒性 参数数量 改良方法 应用
向量胶囊网络 向量 非线性函数 弱 较少 多与卷积神经网络结合改进网络结构 多用于简单数据集
矩阵胶囊网络 矩阵 EM算法 强 较多 多改进路由算法 可用于复杂数据集

Table 2

Comparison of optimization methods"

优化方法 优化模型 优化对象 模型类型
更高特征 DCNet++[11] 胶囊 向量胶囊网络
PathCapsNet[12] 胶囊 向量胶囊网络
更精胶囊 HitNet[13] 胶囊 向量胶囊网络
CapProNet[10] 胶囊 向量胶囊网络
更少数量 SPARSECAPS[17] 胶囊 向量胶囊网络
SCNet[14] 胶囊 矩阵胶囊网络
VideoCapsuleNet[15] 胶囊 矩阵胶囊网络
S-Capsules[16] 胶囊 矩阵胶囊网络
加速路由 ICRP协议[18] 路由 向量胶囊网络
改变方法 转化为最优化问题[19] 路由 向量胶囊网络
利用KDE方法[20] 路由 矩阵胶囊网络
1 HINTON G E, KRIZHEVSKY A, WANG S D. Transforming auto-encoders[C]//International Conference on Artificial Neural Networks. Berlin, Germany: Springer, 2011: 44-51.
2 SABOUR S, FROSST N, HINTON G E. Dynamic routing between capsules[C]//Neural Information Processing Systems. California, USA: NIPS Proceeding, 2017: 3856-3866.
3 HINTON G E, SABOUR S, FROSST N. Matrix capsules with EM routing[EB/OL].(2018-04)[2019-06-13]. https://openreview.net/pdf?id=HJWLfGWRb.
4 ZHANG L, EDRAKI M, QI G J. CapProNet: deep feature learning via orthogonal projections onto capsule subspaces[C]//Neural Information Processing Systems. Montréal, Canada: NIPS Proceeding, 2018: 5814-5823.
5 PHAYE S S R, SIKKA A, DHALL A, et al. Dense and diverse capsule networks: making the capsules learn better[EB/OL].(2018-05)[2019-06-13]. https://arxiv.org/pdf/1805.04001.pdf.
6 SHAHROUDNEJAD A, AFSHAR P, PLATANIOTIS K N, et al. Improved explainability of capsule networks: Relevance path by agreement[C]//2018 IEEE Global Conference on Signal and Information Processing. California, USA: IEEE, 2018: 549-553.
7 DELIÈKGE A, CIOPPA A, VAN DROOGENBROECK M. HitNet: a neural network with capsules embedded in a Hit-or-Miss layer, extended with hybrid data augmentation and ghost capsules[EB/OL].(2018-06)[2019-06-13]. https://arxiv.org/pdf/1806.06519.pdf.
8 NEILL J O. Siamese capsule networks[EB/OL].(2018-05)[2019-06-13]. https://arxiv.org/pdf/1805.07242.pdf.
9 DUARTE K, RAWAT Y, SHAH M. Videocapsulenet: a simplified network for action detection[C]//Neural Information Processing Systems. Montréal, Canada: NIPS Proceeding, 2018: 7610-7619.
10 BAHADORI M T. Spectral capsule networks[EB/OL].(2018-02)[2019-06-13]. https://openreview.net/pdf?id=HJuMvYPaM.
11 RAWLINSON D, AHMED A, KOWADLO G. Sparse unsupervised capsules generalize better[EB/OL].(2018-04)[2019-06-13]. https://arxiv.org/pdf/1804.06094.pdf.
12 SAHU S K, KUMAR P, SINGH A P. Dynamic routing using inter capsule routing protocol between capsules[C]//2018 UKSim-AMSS 20th International Conference on Computer Modelling and Simulation. Cambridge, UK: IEEE, 2018: 1-5.
13 WANG D, LIU Q. An optimization view on dynamic routing between capsules[EB/OL].(2018-02)[2019-06-13]. https://openreview.net/pdf?id=HJjtFYJDf.
14 ZHANG S, ZHOU Q, WU X. Fast dynamic routing based on weighted kernel density estimation[C]//International Symposium on Artificial Intelligence and Robotics. Nanjing, China: Springer, 2018: 301-309.
15 MOBINY A, VAN NGUYEN H.Fast capsnet for lung cancer screening[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Granada, Spain: Springer, 2018: 741-749.
16 KIM Y, WANG P, ZHU Y, et al. A capsule network for traffic speed prediction in complex road networks[C]//2018 Sensor Data Fusion: Trends, Solutions, Applications. Nordrhein-Westfalen, Germany: IEEE, 2018: 1-6.
17 JIMÉINEZ-SÁBNCHEZ A, ALBARQOUNI S, MATEUS D. Capsule networks against medical imaging data challenges[EB/OL]. (2018-07)[2019-06-13]. https://arxiv.org/pdf/1807.07559.pdf.
18 KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]// Neural Information Processing Systems. Lake Tahoe, USA: NIPS Proceeding, 2012: 1097-1105.
19 NGUYEN D Q, VU T, NGUYEN T D, et al. A capsule network-based embedding model for knowledge graph completion and search personalization [EB/OL].(2018-04)[2019-06-13]. https://arxiv.org/pdf/1808.04122.pdf.
20 AFSHAR P, MOHAMMADI A, PLATANIOTIS K N. Brain tumor type classification via capsule networks[C]//2018 25th IEEE International Conference on Image Processing. Athens, Greece: IEEE, 2018: 3129-3133.
21 DE JESUS D R, CUEVAS J, RIVERA W, et al. Capsule networks for protein structure classification and prediction[EB/OL].(2018-08)[2019-06-13]. https://arxiv.org/pdf/1808.07475.pdf.
22 DENG F , PU S , CHEN X , et al. Hyperspectral image classification with capsule network using limited training samples[J]. Sensors, 2018, 18 (9): 3153.
doi: 10.3390/s18093153
23 UPADHYAY Y, SCHRATER P. Generative adversarial network architectures for image synthesis using capsule networks[EB/OL].(2018-06)[2019-06-13]. https://arxiv.org/pdf/1806.03796.pdf.
24 JAISWAL A, ABDALMAGEED W, WU Y, et al. Capsulegan: generative adversarial capsule network[C]//European Conference on Computer Vision. Munich, Germany: Springer, 2018: 526-535.
25 ZHAO W, YE J, YANG M, et al. Investigating capsule networks with dynamic routing for text classification[EB/OL].(2018-05)[2019-06-13]. https://arxiv.org/pdf/1804.00538.pdf.
[1] HUANG Fang, WANG Xin, GAO Guohai, SHEN Lingzhen, FU Xun, FANG Yu. Mining Top-k frequent patterns for graphs based on subjective and objective metrics [J]. Journal of Shandong University(Engineering Science), 2025, 55(6): 1-12.
[2] WANG Yuou, YUAN Yingchun, HE Zhenxue, HE Chen. University academic named entity recognition based on the fusion of multi-feature and multi-head self-attention mechanism [J]. Journal of Shandong University(Engineering Science), 2025, 55(6): 35-44.
[3] SHAO Mengwei, YUAN Shifei, ZHOU Hongzhi, WANG Naihua. Optimisation of finned tube structure based on BP neural network and genetic algorithm [J]. Journal of Shandong University(Engineering Science), 2025, 55(6): 76-82.
[4] DENG Bin, ZHANG Zongbao, ZHAO Wenmeng, LUO Xinhang, WU Qiuwei. Cloud-edge collaborative and graph neural network based load forecasting method for electric vehicle charging stations [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 62-69.
[5] DONG Mingshu, CHEN Liqi, MA Chuanyi, ZHANG Zhuhao, SUN Renjuan, GUAN Yanhua, ZHUANG Peizhi. Deep learning-based intelligent judgment for radar detection of pavement cracks [J]. Journal of Shandong University(Engineering Science), 2025, 55(3): 72-79.
[6] JIA Xuan, XU Jikai, REN Yijing, LIU Decai, XU Qiang, ZHANG Li. Calculation method of theoretical line loss in transformer districts based on sample expansion and data-driven [J]. Journal of Shandong University(Engineering Science), 2025, 55(3): 158-164.
[7] ZHU Ming, SHI Chenglong, LÜ Pan, LIU Xianrong, SUN Chi, CHEN Jiancheng, FAN Hongyun. Deformation prediction method and engineering application of deep foundation pit based on optimized LSTM method [J]. Journal of Shandong University(Engineering Science), 2025, 55(3): 141-148.
[8] Hong YU,Juan DU,Lin WEI,Li ZHANG. Data fitting method for electricity consumption of power market users considering behavioral characteristics [J]. Journal of Shandong University(Engineering Science), 2023, 53(4): 113-119.
[9] Haoyuan LI,Jingming YU,Guilin ZHANG,Bin ZHANG. Optimization of manufacturing parameters for optical fiber preform core based on intelligent algorithm [J]. Journal of Shandong University(Engineering Science), 2023, 53(4): 149-156.
[10] Yue YUAN,Yanli WANG,Kan LIU. Named entity recognition model based on dilated convolutional block architecture [J]. Journal of Shandong University(Engineering Science), 2022, 52(6): 105-114.
[11] DING Fei, JIANG Mingyan. Housing price prediction based on improved lion swarm algorithm and BP neural network model [J]. Journal of Shandong University(Engineering Science), 2021, 51(4): 8-16.
[12] YIN Xiaomin, MENG Xiangjian, HOU Kunming, CHEN Yaxiao, GAO Feng. Correction method for historical output data of photovoltaic power plant considering spatial correlation based on artificial neural network [J]. Journal of Shandong University(Engineering Science), 2021, 51(4): 118-123.
[13] LIAO Jinping, MO Yuchang, YAN Ke. Model and application of short-term electricity consumption forecast based on C-LSTM [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 90-97.
[14] HUO Bingqiang, ZHOU Tao, LU Huiling, DONG Yali, LIU Shan. Lung tumor benign-malignant classification based on multi-modal residual neural network and NRC algorithm [J]. Journal of Shandong University(Engineering Science), 2020, 50(6): 59-67.
[15] Zhiwei WANG,Nan GE,Chunwei LI. Fuzzy control of structure vibration mode based on BP neural network algorithm [J]. Journal of Shandong University(Engineering Science), 2020, 50(5): 13-19.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] ZOU Feifei,GUAN Xiaojun,HAN Zhenqiang,SHEN Xiaomin,MA Xiaofei ,LIU Yunteng . hermal simulating experiment and FEM simulation of dynamic recrystallization of 09CuPTiRE steel[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(5): 17 -20 .
[2] LIANG Jing-yun,WANG Ming-gang,CHAI Jia-qian,LIU yong-qing . Synthesis and in vitro antibacterial activity of 1,6-Di-(N5-phenyl-N1-diguanido) hexane dihydrochloride[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(3): 104 -107 .
[3] WANG Wei,MAO Hua-yong,LI Guo-xiang,PAN Shi-yan,GONG Ting-fang,JIN Shi-qiang,HAO Sheng-bing . Numerical simulation of the flow in a fuel burned vehicle heater[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(3): 64 -68 .
[4] CHEN Peng, HU Wen-Rong, FEI Hai-Yan. Screening of a denitrifying bacterium strain LZ-14 and its nitrogen removal characteristics[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(5): 133 -138 .
[5] LI Xin-Ping, DAI Yi-Fei, HU Jing. Fluid-solid coupling analysis of surrounding rock mass stability and water inflow forecast of a tunnel in a karst zone[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 1 -6 .
[6] ZHANG Ning, LI Shu-Cai, LI Ming-Tian, YANG Lei. Development of a new rock similar material[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 149 -154 .
[7] ZHANG Hong-bo, MIAO Hai-tao, SONG Xiu-guang. Constitutive  model  of  silty  sands  for  cumulative  deformation  under  long-term  traffic  loading  and  numerical  integration[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(2): 59 -65 .
[8] ZHANG Hui，WANG Meng-xia, HAN Xue-shan. The advanced thermal rating of power system and its application[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(6): 25 -29 .
[9] WANG En-dong, . Strength characteristic analysis of box girder bridge pavement[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(2): 71 -76 .
[10] ZHANG Cheng-hui,PEI Rong-hui,SHI Qing-sheng,MA Yong-qing . Optimal configuration of urban water supply pump stations with variable frequency speed control[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(2): 97 -102 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd