Journal of Shandong University(Engineering Science) ›› 2018, Vol. 48 ›› Issue (5): 55-60.doi: 10.6040/j.issn.1672-3961.0.2018.246

• Machine Learning & Data Mining • Previous Articles     Next Articles

Feature extraction method of color pseudo-random coded structured light

Guoxin WANG1,2(),Fengdong CHEN1,Guodong LIU1,*()   

  1. 1. School of Electrical Engineering & Automation, Harbin Institute of Technology, Harbin 150001, Heilongjiang, China
    2. Institute of Electrical and Control Engineering, Heilongjiang University of Science and Technology, Harbin 150022, Heilongjiang, China
  • Received:2018-06-07 Online:2018-10-01 Published:2018-06-07
  • Contact: Guodong LIU E-mail:wanggx1980@126.com;lgd@hit.edu.cn
  • Supported by:
    国家自然科学基金资助项目(61275096)

RichHTML

15

PDF (PC)

484

Abstract:

In order to enhance the feature information of weak texture target in three-dimensional reconstruction, a feature extraction method of structured light based on color square pseudo-random code was proposed. A pseudo-random coded structured light pattern composed of five kinds of color squares was designed and projected onto the target object. A gradient operator template was established to coarsely locate the corners of the down-sampled image. The local non-maximum was suppressed. The Harris algorithm was extended to color multi-channel images, corner detection was carried out on the coarse locating area of the original image, and then the precise position of the corner point was determined in the color image. The experiment results indicated that the proposed method could effectively guarantee the accuracy of feature extraction and had strong robustness with poor surface color and texture.

Key words: pseudo-random, coded structured light, feature extraction, three-dimensional reconstruction, corner detection

CLC Number: 

  • TP391.41

Fig.1

Color squares coded structured light image"

Fig.2

Gradient operator template"

Fig.3

Downsampled image corner extraction"

Fig.4

Corner extraction image"

Fig.5

Corner extraction test results"

Table 1

Comparison of corner extraction algorithm results"

算法种类 提取点数 正确点数 丢失点数 准确率 漏检率
FAST 2 199 1 356 833 0.62 0.38
经典Harris 1 406 1 299 890 0.92 0.41
彩色Harris 1 862 1 731 458 0.93 0.21
AGAST 2 381 1 559 630 0.65 0.29
本研究算法 1 912 1 826 363 0.96 0.17

Fig.6

Test results of anti-noise performance"

Table 2

Comparison of anti-noise performance results"

算法种类 提取点数 正确点数 丢失点数 准确率 漏检率
彩色Harris 2 156 1 530 659 0.71 0.30
本研究算法 2 014 1 913 276 0.95 0.13

Fig.7

Lighting and projection angle test results"

Table 3

Comparison of lighting and projection angle test results"

算法种类 提取点数 正确点数 丢失点数 准确率 漏检率
FAST 2 113 1 030 758 0.49 0.42
经典Harris 1 310 944 844 0.72 0.47
彩色Harris 1 968 1 519 269 0.77 0.15
AGAST 2 553 962 826 0.38 0.46
本研究算法 1 767 1 731 57 0.98 0.03
1 WONG A K C , NIU Peiyi , HE Xiang . Fast acquisition of dense depth data by a new structuredlight scheme[J]. Computer Vision and Image Understanding, 2005, 98 (3): 398- 422.
doi: 10.1016/j.cviu.2004.09.003
2 ALBITAR C, GRAEBLING P, DOIGNON C. Design of a monochromatic pattern for a robust structured light coding[C]//IEEE International Conference on Image Processing. San Antonio, USA: IEEE, 2007: 529-532.
3 ALBITAR C, GRAEBLING P, DOIGNON C. Robust structured light coding for 3D reconstruction[C]//IEEE 11th International Conference on Computer Vision. Rio de Janeiro, Brazil: IEEE, 2007: 1-6.
4 JIA Xiaojun , YUE Guangxue , MEI Fang . The mathematical model and applications of coded structured light system for object detecting[J]. Journal of Computers, 2009, 40 (1): 53- 60.
5 XU Jing, XI Ning, ZHANG Chi, et al. Real-time 3D shape measurement system based on single structure light pattern[C]//IEEE International Conference on Robotics and Automation. Anchorage, USA: IEEE, 2010: 121-126.
6 SONG Zhan , CHUNG R C K . Grid point extraction and coding for structured light system[J]. Optical Engineering, 2011, 50 (9): 093602.
doi: 10.1117/1.3615649
7 KAWASAKI H, FURUKAWA R, SAGAWA R, et al. Dynamic scene shape reconstruction using a single structured light pattern[C]//IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, USA: IEEE, 2008: 1-8.
8 ZHANG Xu , ZHU Limin . Determination of edge correspondence using color codes for one-shot shape acquisition[J]. Optics and Lasers in Engineering, 2011, 49 (1): 95- 113.
9 唐苏明, 张旭, 屠大维. 彩色伪随机编码结构光解码方法研究[J]. 光电子·激光, 2015, 26 (3): 548- 558.
TANG Suming , ZHANG Xu , TU Dawei . Research on the decoding method for color pseudo-random coding structured light[J]. Journal of Optoelectronics·Laser, 2015, 26 (3): 548- 558.
10 王若曦.一种编码结构光三维重建方法及系统[D].深圳:深圳大学, 2017.
WANG Ruoxi. A coded structured light 3D reconstruction method and system[D]. Shenzhen: Shenzhen University, 2017.
11 陈凤东, 刘国栋, 刘炳国. 基于阵列圆点结构光的柔性薄膜表面几何形貌视觉检测方法[J]. 仪器仪表学报, 2014, 35 (6): 1292- 1297.
CHEN Fengdong , LIU Guodong , LIU Bingguo . Dot-array structure light based photogrammetry of flexible thin-film surface morphology using machine vision[J]. Chinese Journal of Scientific Instrument, 2014, 35 (6): 1292- 1297.
12 SUN Tiezheng , BAI Baoxing , HAN Cheng , et al. A color structured light coding and decoding method based on regional structured image with heterogeneous applications[J]. International Journal of Signal Processing, Image Processing and Pattern Recognition, 2016, 9 (7): 127- 136.
doi: 10.14257/ijsip
13 TANG Suming , ZHANG Xu , SONG Zhan , et al. Three-dimensional surface reconstruction via a robust binary shape-coded structured light method[J]. Optical Engineering, 2017, 56 (1): 014102.
doi: 10.1117/1.OE.56.1.014102
14 HARRIS C, STEPHENS M. A combined corner and edge detector[C]//Proceedings of the 4th Alvey Vision Conference. Manchester, UK: Alvey Vision Club, 1988: 147-151.
15 ROSTEN E, DRUMMOND T. Machine learning for high-speed corner detection[C]//ECCV'06 Proceedings of the 9th European conference on Computer Vision. Berlin, Germany: Springer-Verlag, 2006: 430-443.
16 LEPETIT V , FUA P . Keypoint recognition using randomized trees[J]. IEEE Trans on PAMI, 2006, 28 (9): 1465- 1479.
doi: 10.1109/TPAMI.2006.188
17 ROSTEN E, DRUMMOND T, Fusing points and lines for high performance tracking[C]//Tenth IEEE International Conference on Computer Vision. Beijing: IEEE, 2005: 1508-1515.
18 MAIR E, HAGER G D, BURSCHKA D, et al. Adaptive and generic corner detection based on the accelerated segment test[C]//Proceedings of the 11th European Conference on Computer Vision. Heraklion Crete, Greece: Lecture Notes in Computer Science, 2010: 183-196.
[1] Ying LI,Jiankun WANG. The classification of mild cognitive impairment based on supervised graph regularization and information fusion [J]. Journal of Shandong University(Engineering Science), 2023, 53(4): 65-73.
[2] Chunhong CAO,Hongxuan DUAN,Ling CAO,Lele ZHANG,Kai HU,Fen XIAO. Real-time semantic segmentation of high-resolution remote sensing image based on multi-level feature cascade [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 19-25.
[3] Jun FAN,Qiaolin YE,Ning YE. Face recognition based on improved prameter-free supervised localitypreserving projections [J]. Journal of Shandong University(Engineering Science), 2019, 49(1): 10-16.
[4] YE Ziyun, YANG Jinfeng. A finger-vein recognition method based on weighted graph model [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 103-109.
[5] ZHANG Zhenyue, LI Fei, JIANG Mingyan. Unsupervised face image feature extraction based on low-rank representation projection [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(1): 15-20.
[6] YU Qingmin, LI Xiaolei, ZHAI Yong. Feature extraction method of rolling bearing inner ring in wind turbine based on improved EMD and feature box [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 89-95.
[7] GUO Chao, YANG Yan, JIANG Yongquan, SONG Yi. Condition recognition of high-speed train based on multi-view classification ensemble [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(1): 7-14.
[8] ZHANG Yuling, YIN Chuanhuan. Android malware detection based on SVM [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(1): 42-47.
[9] ZHONG Zhiyan, WEN Zhiqiang, ZHANG Xiaoyun, YE Degang. Neighborhood similarity descriptor used in halftone image [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(3): 58-64.
[10] LU Dan, ZHOU Yiqi. Vibration analysis of excavator seat based on EEMD and CWT [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 58-64.
[11] ZHOU Zhe, SHANG Lin. A sentiment analysis method based on dynamic lexicon and three-way decision [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(1): 19-23.
[12] YU Hai-jing1,2, LI Gui-ju1*. Color smoke image recognition based on differential box-counting fractal dimension algorithm [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2014, 44(1): 35-40.
[13] LI Hui1,2, HU Yun1,3, LI Cun-hua1. The technique of gas disaster information feature extraction based on rough set theory [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(5): 91-95.
[14] CAO Hong-gen1, YUAN Bao-hua1, ZHU Hui-sheng2. Recognition of intersected face based on contrast information and  local binary pattern [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(4): 29-34.
[15] ZHANG Si-yi1,2, WANG Shi-tong1*. Kernelized spatial depth function for the feature extraction method [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(3): 45-51.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] ZHANG Yong-hua,WANG An-ling,LIU Fu-ping . The reflected phase angle of low frequent inhomogeneous[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 22 -25 .
[2] SHI Lai-shun,WAN Zhong-yi . Synthesis and performance evaluation of a novel betaine-type asphalt emulsifier[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 112 -115 .
[3] KONG Xiang-zhen,LIU Yan-jun,WANG Yong,ZHAO Xiu-hua . Compensation and simulation for the deadband of the pneumatic proportional valve[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 99 -102 .
[4] LAI Xiang . The global domain of attraction for a kind of MKdV equations[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(1): 87 -92 .
[5] YU Jia yuan1, TIAN Jin ting1, ZHU Qiang zhong2. Computational intelligence and its application in psychology[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 1 -5 .
[6] JI Tao,GAO Xu/sup>,SUN Tong-jing,XUE Yong-duan/sup>,XU Bing-yin/sup> . Characteristic analysis of fault generated traveling waves in 10 Kv automatic blocking and continuous power transmission lines[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(2): 111 -116 .
[7] QIN Tong, SUN Fengrong*, WANG Limei, WANG Qinghao, LI Xincai. 3D surface reconstruction using the shape based interpolation guided by maximal discs[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 1 -5 .
[8] SUN Dianzhu, ZHU Changzhi, LI Yanrui. [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(1): 84 -86 .
[9] ZHANG Ai-juan. Synthesis of bone-like hydroxyapatite in simulated body fluid[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 86 -90 .
[10] SUN Cong-zheng,GUAN Cong-sheng,QIN Jing-yu,CHENG Chuan . The structure and performances of the electroless Ni-P alloy coating on aluminum alloy[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(5): 108 -112 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd