JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE) ›› 2017, Vol. 47 ›› Issue (3): 63-68.doi: 10.6040/j.issn.1672-3961.0.2017.007

Previous Articles     Next Articles

Surgical navigation system based on anartificialmarker

MA Shuaiyifan, ZHAO Zijian*   

  1. School of Control Science and Engineering, Shandong University, Jinan 250061, Shandong, China
  • Received:2017-01-05 Online:2017-06-20 Published:2017-01-05

PDF (PC)

833

Abstract: In order to solve the shortcomings of the current surgical navigation systems including weak anti-interference ability, complex system and non-multi-target tracking, an implement of surgical navigation system based on the detecting of artificial markers was proposed. Based on the Bumblebee2 binocular vision system, a detection algorithm based on edge detection was proposed to realize the precise and fast detection of ARTag artificial marks by line detection, marker construction and marker decode. Then with the Binocular stereo vision theory, accurately and reliably calculatedspatial location of the surgical instruments. Also, the system was able to tracking multiple targets in real-time because these artificial markers were set number sequences inside which enable the system to detect, decode and match multiple artificial marker targets. Experimental results showed that the proposed algorithm was of high accuracy and strong anti-interference ability, and the navigation system solution was fast, stable and economical, advantages multiple targets tracking at the same time, had broad prospects in actual use.

Key words: surgery navigator, binocular stereo vision, spatial localization, multitarget tracking, artificial marker

CLC Number: 

  • TP242
[1] 沈轶. 高精度手术导航的研究与应[D].上海:上海交通大学, 2012. SHEN Yi. High precision surgical navigation and its application [D].Shanghai: Shanghai Jiao Tong University, 2012.
[2] 黄敏,鲍苏苏, 邱文超. 基于可见光下双目视觉的手术导航研究与仿真[J].机器人, 2014, 36(4):461-468,476. HUANG Min, BAO Susu, QIU Wenchao. Study and simulation of surgical navigation based on binocularvision under visible light [J].Robot, 2014, 36(4):461-468,476.
[3] 姚晖. 手术导航系统中手术器械的视觉跟踪研究[D].吉林:吉林大学, 2014. YAO Hui. Research on visual tracking of surgical instruments in surgical navigation system [D].Jilin: Jilin University, 2014.
[4] GALLOWAY, ROBERT L. The process and development of image-guided procedures[J].Annual Review of Biomedical Engineering, 2001, 3(1): 83-108.
[5] 苏文魁, 张毓笠, 李冬梅,等. 手术导航系统及其应用概述[J]. 中国医疗器械杂志, 2010, 34(4):284-288. SU Wenkui, ZHANG Liuli, LI Dongmei, et al. Application and overview of image guided surgery system[J].Chinese Journal of Medical Instrumentation, 2010, 34(4):284-288.
[6] 赵岩. 计算机辅助手术导航中的跟踪定位方法研究[D].吉林:吉林大学, 2015. ZHAO Yan. Research on tracking and positioning method in computer-aided surgical navigation[D].Jilin: Jilin University, 2015.
[7] PETERST M.Image-guidance for surgical procedures [J].Physics in medicine and biology, 2006, 51(14): R505.
[8] KASSAB G S, AN G, SANDER E A, et al. Augmenting surgery via multi-scale modeling and translational systems biology in the era of precision medicine: a multidisciplinary perspective[J].Annals of Biomedical Engineering, 2016, 44(9): 2611-2625.
[9] 刘素娟. 手术导航中近红外光学定位系统的标定[D]. 广州:华南理工大学, 2012. LIU Sujuan. Calibration of near infrared optical positioning system in surgical navigation[D].Guangzhou: South China University of Technology, 2012.
[10] YANG R Q, GUAN P F, CAI K, et al. A novel approach to synchronous image acquisition from near infrared camera in optical-surgery navigation system[J]. Journal of Engineering Science and Technology Review, 2015, 8(3): 14-20.
[11] 张庆泉,王强,张华,等. 影像导航内镜手术中常见问题以及对策[J].中国医学文摘:耳鼻咽喉科学, 2015, 30(5):252-254. ZHANG Qinquan, WANG Qiang, ZHANG Hua, et al. Common problems in endoscopic sinus surgery with image-guided navigationand their countermeasures[J].Chinese Medical Abstracts: Journal of Otorhinolaryngology, 2015, 30(5):252-254.
[12] LIU W, REN H, ZHANG W, et al. Cognitive tracking of surgical instruments based on stereo vision and depth sensing[C] // Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics(ROBIO).Shenzhen,China:IEEE Press, 2013: 316-321.
[13] 赵鹏. 手术导航系统中光学和惯性组合定位方法的研究[D]. 北京:清华大学, 2015. ZHAO Peng. Study on the method of optimum combination of optics and inertia in surgical navigation system[D].Beijing: Tsinghua University, 2015.
[14] WILLIAMSON T, CAVERSACCIO M, WEBER S, et al. Image-guided microsurgery[M]. Telehealth and Mobile Health. CRC Press, 2015: 91-115.
[15] 马文娟. 红外手术导航仪关键技术研究[D]. 上海:上海交通大学, 2010. MA Wenjuan. Key technologies of infrared surgical navigation instrument[D]. Shanghai: Shanghai Jiao tong University, 2010.
[16] 郑银强. 红外手术导航仪的高精度定位理论与方法[D]. 上海:上海交通大学, 2009. ZHEN Yinqiang. Theory and method for high-accuracy infrared-basedsurgical navigation system[D]. Shanghai:Shanghai Jiao tong University, 2010.
[17] LENZE C, CHAUDHRI N, VOLLING P, et al. Concept for a navigated micro surgical assistant system for middle ear surgery[J]. CURAC, München, Germany, 2004, 1281:559-564.
[18] FIALA M. ARTag, a fiducial marker system using digital techniques[C] //Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR'05). New York, USA:IEEE Press, 2005, 2: 590-596.
[19] KHAN D, ULLAH S, RABBI I. Factors affecting the design and tracking of ARToolKitmarkers[J]. Computer Standards & Interfaces, 2015, 41: 56-66.
[20] FIALA M. Comparing artag and artoolkit plus fiducial marker systems[C] //Proceedings of the 2005 IEEE International Workshop on Haptic Audio Visual Environments and their Applications(HAVE 2005). Ottawa, Canada:IEEE Press, 2005:6-153.
[1] ZHANG Di, XU De. The hierarchical map building of outdoor environment for mobile robot [J]. Journal of Shandong University(Engineering Science), 2023, 53(2): 34-41.
[2] DENG Wentao, ZHANG Mengyi, HE Peng, ZENG Zhangfan, LI Bing. Software system evolution analysis based on network representation learning [J]. Journal of Shandong University(Engineering Science), 2023, 53(2): 77-86.
[3] SHI Zhenjie, LIU Yanjun, XUE Gang, JIA Hua, WANG Yu. Design and kinematics analysis of hybrid drive anthropomorphic manipulator [J]. Journal of Shandong University(Engineering Science), 2022, 52(4): 76-82.
[4] LIANG Qixing, LI Bin, LI Zhi, ZHANG Hui, RONG Xuewen, FAN Yong. Algorithm of adaptive slope adjustment of quadruped robot based on model predictive control and its application [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 37-44.
[5] Honghua ZHAO,Jian ZHAO,Xingguang DUAN,Zhitong HU,Qianqian TIAN,Yaohua ZHAO. Configuration design and interference analysis of multi-arm robot for mandible reconstruction [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 73-80.
[6] Caihong LI,Chun FANG,Zhiqiang WANG,Bin XIA,Fengying WANG. Complete coverage path planning for mobile robots based on hyperchaotic synchronization control [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 63-72.
[7] Linglong KONG,Guohui TIAN. A robot service recognition mechanism based on ontology in smart home [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 45-54.
[8] Wei WANG,Feng WU,Fengyu ZHOU. Research status and development trend of autonomous cognition and learning of robot manipulation skills [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 11-24.
[9] Fangyun HAN, Liang QIAO, Bincheng ZHAO, Li ZHANG. Weighted value of solar tariff based on time-of-use electricity price [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 93-97.
[10] Qiang ZHANG. Motion control system design of multi-joint snake-like manipulator for nuclear environment [J]. Journal of Shandong University(Engineering Science), 2018, 48(6): 122-131.
[11] XIN Yaxian, LI Yibin, LI Bin, RONG Xuewen. Smooth walk-to-trot gait transition algorithm for quadruped robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(4): 42-49.
[12] LIU Zhe, SONG Rui, ZOU Tao. End force tracking control algorithm of grinding robot based on model predictive control [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(1): 42-49.
[13] TANG Leshuang, TIAN Guohui, HUANG Bin. An object fusion recognition algorithm based on DSmT [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(1): 50-56.
[14] WANG Xiuqing, ZENG Hui, XIE Fei, LYU Feng. Fault diagnosis for manipulators based on Spiking neural networks [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(5): 15-21.
[15] ZHAO Zijian, WANG Fang, CHANG Faliang. Survey on medical robot in computer-aided surgery [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 69-78.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] WANG Su-yu,<\sup>,AI Xing<\sup>,ZHAO Jun<\sup>,LI Zuo-li<\sup>,LIU Zeng-wen<\sup> . Milling force prediction model for highspeed end milling 3Cr2Mo steel[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 1 -5 .
[2] LI Kan . Empolder and implement of the embedded weld control system[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 37 -41 .
[3] KONG Xiang-zhen,LIU Yan-jun,WANG Yong,ZHAO Xiu-hua . Compensation and simulation for the deadband of the pneumatic proportional valve[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 99 -102 .
[4] CHEN Rui, LI Hongwei, TIAN Jing. The relationship between the number of magnetic poles and the bearing capacity of radial magnetic bearing[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(2): 81 -85 .
[5] LI Ke,LIU Chang-chun,LI Tong-lei . Medical registration approach using improved maximization of mutual information[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 107 -110 .
[6] JI Tao,GAO Xu/sup>,SUN Tong-jing,XUE Yong-duan/sup>,XU Bing-yin/sup> . Characteristic analysis of fault generated traveling waves in 10 Kv automatic blocking and continuous power transmission lines[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 111 -116 .
[7] . [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 27 -32 .
[8] ZHANG Ying,LANG Yongmei,ZHAO Yuxiao,ZHANG Jianda,QIAO Peng,LI Shanping . Research on technique of aerobic granular sludge cultivationby seeding EGSB anaerobic granular sludge[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 56 -59 .
[9] WANG Li-ju,HUANG Qi-cheng,WANG Zhao-xu . [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(6): 51 -56 .
[10] SUN Dianzhu, ZHU Changzhi, LI Yanrui. [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 84 -86 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd