Journal of Shandong University(Engineering Science) ›› 2019, Vol. 49 ›› Issue (2): 67-73.doi: 10.6040/j.issn.1672-3961.0.2018.155

• Machine Learning & Data Mining • Previous Articles     Next Articles

Automatic landmarks identification and tracking of bat flight

Xu YANG1a(),Hui CHEN1,a*(),Yousi LIN2,Changhe TU1b   

  1. 1a. School of Information Science and Engineering, Shandong University, Qingdao 266237, Shandong, China
    1b. School of Computer Science and Technology, Shandong University, Qingdao 266237, Shandong, China
    2. Bradley Department of Electrical and Computer Engineering, Virginia Tech, Blacksburg 24060, USA
  • Received:2018-04-18 Online:2019-04-20 Published:2019-04-19
  • Contact: Hui CHEN E-mail:yxpeiyang@gmail.com;huichen@sdu.edu.cn
  • Supported by:
    国家自然科学基金重点项目(61332015);国家自然科学基金重点项目(11574183);山东省自然科学基金项目(ZR2017MF057)

RichHTML

11

PDF (PC)

535

Abstract:

Bats could serve as an inspiration for flapping-wing air vehicles. Understanding bats flight with computer vision techniques required a large copious of fiducial landmarks. Thus, accuracy of landmark identification and tracking was critical to bat flight research. General low-level feature extraction methods based on local extrema often resulted in high false positives. A landmark identification method based on image segmentation was proposed. An initial bat silhouette was first obtained using frame difference and then refined by compensating camouflage parts. The landmarks were enhanced by LoG operation. Finally, the coordinates of landmarks were computed from the centroids of connected components. Furthermore, a landmark tracking method based on ICP (Iterative Closet Points) was proposed. Bat region was divided into several parts, in which landmarks were aligned by ICP. The correspondences were determined by the nearest neighbor search. The method reached an identification accuracy up to 96%, and could track the landmark correctly when occlusion wasn′ occurred, which was better than SIFT, BRISK, and optical flow tracking methods.

Key words: flight bat, feature identification, camouflage, landmark tracking, points registration

CLC Number: 

  • TP391

Fig.1

Flowchart of landmark identification algorithm"

Fig.2

Comparison between ViBe(a) and the proposed method(b)"

Fig.3

Comparison of intensity of image before and after square operation"

Fig.4

Landmark layouts and wing region partitions"

Fig.5

Flight tunnel diagram"

Fig.6

Comparison of SIFT, BRISK and the proposed algorithm on landmark identification"

Table 1

Comparison of SIFT, BRISK, Optical flowand our method"

算法 P R ACC 匹配准确率
SIFT 0.30 0.61 0.45 0.15
BRISK 0.54 0.98 0.76 0.20
光流法 - - - 0.55
本研究算法 0.98 0.94 0.96 0.93

Fig.7

Comparison among SIFT, optical flow andthe proposed method"

1 HEDENSTROM A , JOHANSSON L C , WOLF M , et al. Bat flight generates complex aerodynamic tracks[J]. Science, 2007, 316 (5826): 894- 897.
doi: 10.1126/science.1142281
2 RAMEZANI A, SHI X, CHUNG S J, et al. Bat Bot (B2), a biologically inspired flying machine[C]//IEEE International Conference on Robotics & Automation. Stockholm, Sweden. IEEE, 2016: 3219-3226.
3 CHENEY JA , KONOW N , BEARNOT A , et al. 2015 A wrinkle in flight: the role of elastin fibres in the mechanical behavior of bat wing membranes[J]. J. R. Soc. Interface, 2014, 12 (106): 1- 9.
4 VON M T , PONS M G , ROSENHAHN B . Human pose estimation from video and IMUs[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2016, 38 (8): 1533- 1547.
5 SIGAL L , BALAN A O , BLACK M J . HumanEva: synchronized video and motion capture dataset for evaluation of articulated human motion[J]. International Journal of Computer Vision, 2010, 87 (1-2): 4.
doi: 10.1007/s11263-009-0273-6
6 PLAGEMANN C, GANAPATHI V, KOLLER D, et al. Real time motion capture using a single Time-Of-Flight camera[C]//Computer Vision & Pattern Recognition. San Francisco, USA. IEEE, 2010: 1-8.
7 JU E , WON J , LEE J , et al. Data-driven control of flapping flight[J]. ACM Transactions on Graphics, 2013, 32 (5): 151.
8 WALDMAN R M, SONG A J, RISKIN D K, et al. Aerodynamic behavior of compliant membranes as related to bat flight[C]//38th AIAA Fluid Dynamic Conference and Exhibit. Seattle, USA. 2008: 1-13.
9 BERGOU A J, SWARTZ S, BREUER K, et al. 3D reconstruction of bat flight kinematics from sparse multiple views[C]//IEEE International Conference on Computer Vision Workshops. Barcelona, Spain. IEEE, 2011: 1618-1625.
10 BENDER M J, MCCLELLAND H M, KURDILA A, et al. Recursive Bayesian estimation of bat flapping flight using kinematic trees[C]//AIAA Modeling and Simulation Technologies Conference. San Diego, USA. 2016: 1-12.
11 LEUTENEGGER S, CHLI M, SIEGWART R Y. BRISK: binary robust invariant scalable keypoints[C]//International Conference on Computer Vision. Barcelona, Spain. IEEE Computer Society, 2011: 2548-2555.
12 Lin Y, YANG X, Chen H, et al. Optimal threshold and LoG based feature identification and tracking of bat flapping flight[C]//Applications of Computer Vision. California, USA. IEEE, 2017: 418-426.
13 OLIVIER B , MARC V D . ViBe: a universal background subtraction algorithm for video sequences[J]. IEEE Transactions on Image Processing, 2011, 20 (6): 1709- 1724.
doi: 10.1109/TIP.2010.2101613
14 BRUTZER S, HOFERLIN B, HEIDEMANN G. Evaluation of background subtraction techniques for video surveillance[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA. 2011: 1937-1944.
15 CONTE D, FOGGIA P, PERCANNELLA G, et al. An algorithm for detection of partially camouflaged people[C]//6th IEEE International Conference on Advanced Video and Signal Based Surveillance. Genova, Italy. 2009: 340-345.
16 MONDAL A , GHOSH S , GHOSH A . Partially camouflaged object tracking using modified probabilistic neural network and fuzzy energy based active contour[J]. International Journal of Computer Vision, 2017, 122 (1): 116- 148.
doi: 10.1007/s11263-016-0959-5
17 GUNN S R . On the discrete representation of the Laplacian of Gaussian[J]. Pattern Recognition, 1999, 32 (8): 1463- 1472.
doi: 10.1016/S0031-3203(98)00163-0
18 MUJA M. Fast approximate nearest neighbors with automatic algorithm configuration[C]//International Conference on Computer Vision Theory and Application. Lisboa, Portugal. 2009: 331-340.
[1] Jiachen WANG,Xianghong TANG,Jianguang LU. Research onfeature selection technology in bearing fault diagnosis [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 80-87, 95.
[2] Hongbin ZHANG,Diedie QIU,Renzhong WU,Tao ZHU,Jin HUA,Donghong JI. Image attribute annotation based on extreme gradient boosting algorithm [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 8-16.
[3] Xiaoxiong HOU,Xinzheng XU,Jiong ZHU,Yanyan GUO. Computer aided diagnosis method for breast cancer based on AlexNet and ensemble classifiers [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 74-79.
[4] Run XIANG,Sufen CHEN,Xueqiang ZENG. Facial age estimation based on multivariate multiple regression [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 54-60.
[5] Yun HU,Shu ZHANG,Hui LI,Kankan SHE,Jun SHI. Recommendation algorithm based on trust network reconfiguration [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 42-46.
[6] Mingxia GAO,Jingwei LI. Chinese short text classification method based on word2vec embedding [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 34-41.
[7] Tong LI,Ran MA,Honghe ZHENG,Ping AN,Xiangyu HU. An error sensitivity model based on video statistical features [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 116-121.
[8] Jun QIN,Yuanpeng ZHANG,Yizhang JIANG,Wenlong HANG. Transfer fuzzy clustering based on self-constraint of multiple medoids [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 107-115.
[9] Lizhao LI,Guoyong CAI,Jiao PAN. A microblog rumor events detection method based on C-GRU [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 102-106, 115.
[10] Shiguang LIU,Hairong WANG,Jin LIU. Fast 4-points congruent sets for coarse registration of 3D point cloud [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 1-7.
[11] Chunlin QIAN,Xingfang ZHANG,Lihua SUN. Advanced collaborative filtering recommendation model based on sentiment analysis of online review [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 47-54.
[12] Rongxiang ZHOU,Xiuyi JIA. Features analysis for Chinese irony detection [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 41-46.
[13] Si YANG,Sitong LI,Jindong ZHANG,Yu BAI. Improvement of bandwidth model for high speed optical communicationlaser and its optimization by parallel computing [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 17-22, 29.
[14] Jun FAN,Qiaolin YE,Ning YE. Face recognition based on improved prameter-free supervised localitypreserving projections [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 10-16.
[15] Yunyang YAN,Huizhen ZHANG,Yi′an LIU,Shangbing GAO. Video flame detection based on GMM and 3D-LBP feature [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 1-9.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] WANG Su-yu,<\sup>,AI Xing<\sup>,ZHAO Jun<\sup>,LI Zuo-li<\sup>,LIU Zeng-wen<\sup> . Milling force prediction model for highspeed end milling 3Cr2Mo steel[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 1 -5 .
[2] KONG Xiang-zhen,LIU Yan-jun,WANG Yong,ZHAO Xiu-hua . Compensation and simulation for the deadband of the pneumatic proportional valve[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 99 -102 .
[3] LAI Xiang . The global domain of attraction for a kind of MKdV equations[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 87 -92 .
[4] LI Liang, LUO Qiming, CHEN Enhong. Graph-based ranking model for object-level search
[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 15 -21 .
[5] LI Ke,LIU Chang-chun,LI Tong-lei . Medical registration approach using improved maximization of mutual information[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 107 -110 .
[6] JI Tao,GAO Xu/sup>,SUN Tong-jing,XUE Yong-duan/sup>,XU Bing-yin/sup> . Characteristic analysis of fault generated traveling waves in 10 Kv automatic blocking and continuous power transmission lines[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 111 -116 .
[7] QIN Tong, SUN Fengrong*, WANG Limei, WANG Qinghao, LI Xincai. 3D surface reconstruction using the shape based interpolation guided by maximal discs[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 1 -5 .
[8] Yue Khing Toh1， XIAO Wendong2， XIE Lihua1. Wireless sensor network for distributed target tracking: practices via real test bed development[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 50 -56 .
[9] SUN Guohua, WU Yaohua, LI Wei. The effect of excise tax control strategy on the supply chain system performance[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 63 -68 .
[10] SUN Weiwei， WANG Yuzhen. Finite gain stabilization of singlemachine infinite bus system subject to saturation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 69 -76 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd