JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2017, Vol. 47 ›› Issue (3): 63-68.doi: 10.6040/j.issn.1672-3961.0.2017.007

Previous Articles     Next Articles

Surgical navigation system based on anartificialmarker

MA Shuaiyifan, ZHAO Zijian*   

  1. School of Control Science and Engineering, Shandong University, Jinan 250061, Shandong, China
  • Received:2017-01-05 Online:2017-06-20 Published:2017-01-05

Abstract: In order to solve the shortcomings of the current surgical navigation systems including weak anti-interference ability, complex system and non-multi-target tracking, an implement of surgical navigation system based on the detecting of artificial markers was proposed. Based on the Bumblebee2 binocular vision system, a detection algorithm based on edge detection was proposed to realize the precise and fast detection of ARTag artificial marks by line detection, marker construction and marker decode. Then with the Binocular stereo vision theory, accurately and reliably calculatedspatial location of the surgical instruments. Also, the system was able to tracking multiple targets in real-time because these artificial markers were set number sequences inside which enable the system to detect, decode and match multiple artificial marker targets. Experimental results showed that the proposed algorithm was of high accuracy and strong anti-interference ability, and the navigation system solution was fast, stable and economical, advantages multiple targets tracking at the same time, had broad prospects in actual use.

Key words: surgery navigator, binocular stereo vision, spatial localization, multitarget tracking, artificial marker

CLC Number: 

  • TP242
[1] 沈轶. 高精度手术导航的研究与应[D].上海:上海交通大学, 2012. SHEN Yi. High precision surgical navigation and its application [D].Shanghai: Shanghai Jiao Tong University, 2012.
[2] 黄敏,鲍苏苏, 邱文超. 基于可见光下双目视觉的手术导航研究与仿真[J].机器人, 2014, 36(4):461-468,476. HUANG Min, BAO Susu, QIU Wenchao. Study and simulation of surgical navigation based on binocularvision under visible light [J].Robot, 2014, 36(4):461-468,476.
[3] 姚晖. 手术导航系统中手术器械的视觉跟踪研究[D].吉林:吉林大学, 2014. YAO Hui. Research on visual tracking of surgical instruments in surgical navigation system [D].Jilin: Jilin University, 2014.
[4] GALLOWAY, ROBERT L. The process and development of image-guided procedures[J].Annual Review of Biomedical Engineering, 2001, 3(1): 83-108.
[5] 苏文魁, 张毓笠, 李冬梅,等. 手术导航系统及其应用概述[J]. 中国医疗器械杂志, 2010, 34(4):284-288. SU Wenkui, ZHANG Liuli, LI Dongmei, et al. Application and overview of image guided surgery system[J].Chinese Journal of Medical Instrumentation, 2010, 34(4):284-288.
[6] 赵岩. 计算机辅助手术导航中的跟踪定位方法研究[D].吉林:吉林大学, 2015. ZHAO Yan. Research on tracking and positioning method in computer-aided surgical navigation[D].Jilin: Jilin University, 2015.
[7] PETERST M.Image-guidance for surgical procedures [J].Physics in medicine and biology, 2006, 51(14): R505.
[8] KASSAB G S, AN G, SANDER E A, et al. Augmenting surgery via multi-scale modeling and translational systems biology in the era of precision medicine: a multidisciplinary perspective[J].Annals of Biomedical Engineering, 2016, 44(9): 2611-2625.
[9] 刘素娟. 手术导航中近红外光学定位系统的标定[D]. 广州:华南理工大学, 2012. LIU Sujuan. Calibration of near infrared optical positioning system in surgical navigation[D].Guangzhou: South China University of Technology, 2012.
[10] YANG R Q, GUAN P F, CAI K, et al. A novel approach to synchronous image acquisition from near infrared camera in optical-surgery navigation system[J]. Journal of Engineering Science and Technology Review, 2015, 8(3): 14-20.
[11] 张庆泉,王强,张华,等. 影像导航内镜手术中常见问题以及对策[J].中国医学文摘:耳鼻咽喉科学, 2015, 30(5):252-254. ZHANG Qinquan, WANG Qiang, ZHANG Hua, et al. Common problems in endoscopic sinus surgery with image-guided navigationand their countermeasures[J].Chinese Medical Abstracts: Journal of Otorhinolaryngology, 2015, 30(5):252-254.
[12] LIU W, REN H, ZHANG W, et al. Cognitive tracking of surgical instruments based on stereo vision and depth sensing[C] // Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics(ROBIO).Shenzhen,China:IEEE Press, 2013: 316-321.
[13] 赵鹏. 手术导航系统中光学和惯性组合定位方法的研究[D]. 北京:清华大学, 2015. ZHAO Peng. Study on the method of optimum combination of optics and inertia in surgical navigation system[D].Beijing: Tsinghua University, 2015.
[14] WILLIAMSON T, CAVERSACCIO M, WEBER S, et al. Image-guided microsurgery[M]. Telehealth and Mobile Health. CRC Press, 2015: 91-115.
[15] 马文娟. 红外手术导航仪关键技术研究[D]. 上海:上海交通大学, 2010. MA Wenjuan. Key technologies of infrared surgical navigation instrument[D]. Shanghai: Shanghai Jiao tong University, 2010.
[16] 郑银强. 红外手术导航仪的高精度定位理论与方法[D]. 上海:上海交通大学, 2009. ZHEN Yinqiang. Theory and method for high-accuracy infrared-basedsurgical navigation system[D]. Shanghai:Shanghai Jiao tong University, 2010.
[17] LENZE C, CHAUDHRI N, VOLLING P, et al. Concept for a navigated micro surgical assistant system for middle ear surgery[J]. CURAC, München, Germany, 2004, 1281:559-564.
[18] FIALA M. ARTag, a fiducial marker system using digital techniques[C] //Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR'05). New York, USA:IEEE Press, 2005, 2: 590-596.
[19] KHAN D, ULLAH S, RABBI I. Factors affecting the design and tracking of ARToolKitmarkers[J]. Computer Standards & Interfaces, 2015, 41: 56-66.
[20] FIALA M. Comparing artag and artoolkit plus fiducial marker systems[C] //Proceedings of the 2005 IEEE International Workshop on Haptic Audio Visual Environments and their Applications(HAVE 2005). Ottawa, Canada:IEEE Press, 2005:6-153.
[1] XIN Yaxian, LI Yibin, LI Bin, RONG Xuewen. Smooth walk-to-trot gait transition algorithm for quadruped robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 42-49.
[2] LIU Zhe, SONG Rui, ZOU Tao. End force tracking control algorithm of grinding robot based on model predictive control [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(1): 42-49.
[3] TANG Leshuang, TIAN Guohui, HUANG Bin. An object fusion recognition algorithm based on DSmT [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(1): 50-56.
[4] WANG Xiuqing, ZENG Hui, XIE Fei, LYU Feng. Fault diagnosis for manipulators based on Spiking neural networks [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 15-21.
[5] ZHAO Zijian, WANG Fang, CHANG Faliang. Survey on medical robot in computer-aided surgery [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 69-78.
[6] LIU Bin, SONG Rui, CHAI Hui. Buffering strategy for articulated legged robot based on virtual model control and acceleration planning [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(6): 69-75.
[7] ZHAO Zijian, CHEN Zhaorui, LI Bingqing. A new method for hand-eye calibration based on non-minimization optimization [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(4): 28-33.
[8] MENG Jian, LI Yibin, LI Bin. Bound gait controlling method of quadruped robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 28-34.
[9] DING Na-na, TIAN Guo-hui*, LI Guo-dong, ZHANG Qing-bin. Visual self-localization of biped robot based on artificial landmark [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2013, 43(4): 51-56.
[10] LI Yi-bin ,RUAN Jiu-hong ,LIU Lu-yuan,SONG Rui,RONG Xue-wen . Vehicle longitudinal acceleration control based on ADRC [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 1-04 .
[11] RUAN Jiu-hong ,LI Yi-bin,RONG Xue-wen,QIU Xu-yun . Study on the lateral locomotion control of ADRC-based high-speed
mobile platform

TIAN Guo-hui,LI Xiao-lei,ZHAO Shou-peng,LU Fei

. Research and development of intelligent space technology for a home service robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(5): 53-59 .
[13] LI Cai-hong,LI Yi-bin,FAN Chen . Dynamic obstacle avoidance Algorithm for the mobile robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(5): 60-64 .
[14] SONG Hong-jun,MA Xin,LI Yi-bin,JIA Lei . The design and realization of a 3D software system for an educational robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(4): 34-38 .
[15] NIU Jun,LI Yi-bin,SONG Rui . A two-step self-localization method for mobile robots based on laser information [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 46-50 .
Full text



No Suggested Reading articles found!