Journal of Shandong University(Engineering Science) ›› 2019, Vol. 49 ›› Issue (6): 45-54.doi: 10.6040/j.issn.1672-3961.0.2018.495

• Control Science & Engineering - Special Topic on Robot • Previous Articles     Next Articles

A robot service recognition mechanism based on ontology in smart home

Linglong KONG(),Guohui TIAN*()   

  1. School of Control Science and Engineering, Shandong University, Jinan 250061, Shandong, China
  • Received:2018-11-22 Online:2019-12-20 Published:2019-12-17
  • Contact: Guohui TIAN E-mail:linglong_kong@mail.sdu.edu.cn;g.h.tian@sdu.edu.cn
  • Supported by:
    国家自然科学基金资助项目(61773239);山东省自然科学基金资助项目(ZR2015FM007)

Abstract:

In order to enhance the ability of robots to provide different types of services, a classification service reasoning method based on semantic web rule language was proposed for service robots in smart home environments. The ontology model of smart home was established by ontology technology, which integrated data from different data sources and eliminated the heterogeneity between devices. The classification of service types were based on the service characteristics of robot service system in smart home. With historical context information, the service rule bases were set up. The reasoning engine could match the real-time context information and service rules to realize the service reasoning of the robot. The experimental results showed that the robot service reasoning method could achieve different types of service reasoning in smart home environments and further improve the intelligence of the robot service.

Key words: service robot, ontology model, smart home, semantic web, service reasoning

CLC Number: 

  • TP242.6

Fig.1

Service system architecture of robot"

Fig.2

Ontology model layered structure based on OWL"

Fig.3

OWL-based ontology relationship in smart home"

Fig.4

The SSN ontology module structure"

Fig.5

Sensor data mapping process"

Table 1

The types of service based on human behavior"

序号 条件 服务类型
1 (U1U2Se1Se2) & (U1=U2Se1=Se2) U
2 (Su1Su2Se1Se2) & (Su1=Su2Se1=Se2) Su
3 (Lu1Lu2Se1Se2) & (Lu1=Lu2Se1=Se2) Lu
4 (αηSe1Se2) & (α < ηSe1=Se2) Time
5 (U1U2, Su1Su2Se1Se2) & (U1=U2, Su1=Su2Se1=Se2) U-Su
6 (U1U2, Lu1Lu2Se1Se2) & (U1=U2, Lu1=Lu2Se1=Se2) U-Lu
7 (U1U2, αηSe1Se2) & (U1=U2, α < ηSe1=Se2) U-Time
8 (Su1Su2, Lu1Lu2Se1Se2) & (Su1=Su2, Lu1=Lu2Se1=Se2) Su-Lu
9 (Su1Su2, αηSe1Se2) & (Su1=Su2, α < ηSe1=Se2) Su-Time
10 (Lu1Lu2, αηSe1Se2) & (Lu1=Lu2, α < ηSe1=Se2) Lu-Time
11 (U1U2, Su1Su2, Lu1Lu2Se1Se2) & (U1=U2, Su1=Su2, Lu1=Lu2Se1=Se2) U-Su-Lu
12 (U1U2, Su1Su2, αηSe1Se2) & (U1=U2, Su1=Su2, α < ηSe1=Se2) U-Su-Time
13 (U1U2, Lu1Lu2, αηSe1Se2) & (U1=U2, Lu1= Lu2, α < ηSe1=Se2) U-Lu-Time
14 (Su1Su2, Lu1Lu2, αηSe1Se2) & (Su1=Su2, Lu1=Lu2, α < ηSe1=Se2) Su-Lu-Time
15 (U1U2, Su1Su2, Lu1Lu2, αηSe1Se2) & (U1=U2, Su1=Su2, Lu1=Lu2, α < ηSe1=Se2) U-Su-Lu-Time

Fig.6

The generation of SWRL service rule"

Fig.7

The process of service reasoning"

Table 2

Real-time information of test scenario"

主体 属性 客体
Alan hasUserState sit
Alan hasLocation bedroom
sit hasTime 19:00
Bill hasUserState sit
Bill hasLocation livingroom
sit hasTime 19:00
bread1 hasItemsState cooled
bread1 hasLocation table 1
cooled hasTime 19:00

Fig.8

The experimental results of information mapping"

Fig.9

The comparison of service rule generation time"

Fig.10

Experimental platform of the robot"

Table 3

SWRL service rules"

规则名规则表示
Rule-1User(Alan)∧StateUser(sit)∧Location(bedroom)∧Time(t1)∧hasUserState(Alan, sit)∧hasLocation(Alan, bedroom)∧hasTime(sit, t1)→operateOn(drink, coffee)
Rule-2User(Alan)∧StateUser(sit)∧Location(bedroom)∧Time(t2)∧hasUserState(Alan, sit)∧hasLocation(Alan, bedroom)∧hasTime(sit, t2)→operateOn(drink, water)
Rule-3User(Bill)∧StateUser(sit)∧Location(bedroom)∧Time(t1)∧hasUserState(Bill, sit)∧hasLocation(Bill, bedroom)∧hasTime(sit, t1)→operateOn(drink, water)
Rule-4User(Bill)∧StateUser(sit)∧Location(livingroom)∧Time(t2)∧hasUserState(Bill, wake)∧hasLocation(Bill, livingroom)∧hasTime(sit, t2)→operateOn(ON, tv)
Rule-5User(Bill)∧StateUser(wake)∧Location(bedroom)∧Time(t3)∧hasUserState(Bill, wake)∧hasLocation(Bill, bedroom)∧hasTime(wake, t3)→operateOn(open, window1)
Rule-6User(Bill)∧StateUser(sleep)∧Location(bedroom)∧Time(t4)∧hasUserState(Bill, sleep)∧hasLocation(Bill, bedroom)∧hasTime(sleep, t4)→operateOn(close, window1)
Rule-7Items(book1)∧StateItems(on)∧Location(floor)∧Time(t5)∧hasItemsState(book1, on)∧hasLocation(book1, floor)∧hasTime(on, t5)→operateOn(pick, book1)
Rule-8Items(bread1)∧StateItems(cooled)∧Location(table 1)∧Time(t6)∧hasItemsState(bread1, cooled)∧hasLocation(bread1, table 1)∧hasTime(cooled, t6)→operateOn(heat, bread1)
Rule-9User(Alan)∧Location(bedroom)∧Environment(temsensor1)∧Time(t7)∧hasLocation(Alan, bedroom)∧hasLocation(aircondition1, bedroom)∧hasTime(temsensor1, t7)∧hasEnvironment(aircondition1, temsensor1)∧value(temsensor1, 28)→operateOn(adjust, aircondition1)∧value(aircondition1, 25)
Rule-10User(Alan)∧Location(bedroom)∧Environment(temsensor1)∧Time(t8)∧hasLocation(Alan, bedroom)∧hasLocation(aircondition1, bedroom)∧hasTime(temsensor1, t8)∧hasEnvironment(aircondition1, temsensor1)∧value(temsensor1, 16)→operateOn(adjust, aircondition1)∧value(aircondition1, 22)

Fig.11

Process of service reasoning"

Fig.12

Execution result of robot service"

1 MITZNER T L , CHEN T L , KEMP C C , et al. Identifying the potential for robotics to assist older adults in different living environments[J]. International Journal of Social Robotics, 2014, 6 (2): 213- 227.
2 KRISHNAN R H , PUGAZHENTHI S . Mobility assistive devices and self-transfer robotic systems for elderly: a review[J]. Intelligent Service Robotics, 2014, 7 (1): 37- 49.
3 丁满, 袁梦娟, 白仲航, 等. 基于用户无意识行为的服务机器人交互设计[J]. 包装工程, 2018, 39 (10): 91- 95.
DING Man , YUAN Mengjuan , BAI Zhonghang , et al. Interaction design of service robot based on user's unconscious behavior[J]. Packaging Engineering, 2018, 39 (10): 91- 95.
4 王天然, 库涛, 朱云龙, 等. 智能制造空间[J]. 信息与控制, 2017, 46 (6): 641- 645.
WANG Tianran , KU Tao , ZHU Yunlong , et al. Smart manufacturing space[J]. Information and Control, 2017, 46 (6): 641- 645.
5 张国梁, 李秀智, 徐涛, 等. 基于RTM的自主服务机器人智能化分散控制[J]. 北京工业大学学报, 2017, 43 (7): 969- 977.
ZHANG Guoliang , LI Xiuzhi , XU Tao , et al. Intelligent distributed control of autonomous service robots based on RTM[J]. Journal of Beijing University of Technology, 2017, 43 (7): 969- 977.
6 CIRILLO M, KARLSSON L, SAFFIOTTI R. Human-aware task planning for mobile robots[C]//International Conference on Advanced Robotics. Munich, Germany: IEEE, 2009: 1-7.
7 屠大维, 江济良, 许烁, 等. 移动作业助老助残服务机器人人机协作:认知建模及其应用[J]. 高技术通讯, 2012, 22 (12): 1257- 1263.
doi: 10.3772/j.issn.1002-0470.2012.12.007
TU Dawei , JIANG Jiliang , XU Shuo , et al. Human-robot collaboration of mobile robots for aged and disabled assistance: cognition modelling and application[J]. High Technology Letters, 2012, 22 (12): 1257- 1263.
doi: 10.3772/j.issn.1002-0470.2012.12.007
8 HORRIDGE M , BECHHOFER S . The OWL API: a Java API for OWL ontologies[J]. Semantic Web, 2011, 2 (1): 11- 21.
9 宋沐民, 路飞, 陆娜, 等. 智能空间下基于分层任务网络的服务机器人任务规划[J]. 控制理论与应用, 2014, 31 (7): 901- 907.
SONG Mumin , LU Fei , LU Na , et al. Task planning for service robot with hierarchical task network in intelligent space[J]. Control Theory & Applications, 2014, 31 (7): 901- 907.
10 张梦洋, 田国会, 龚京, 等. 基于本体知识库的服务决策机制的设计方法[J]. 华中科技大学学报(自然科学版), 2017, 45 (10): 70- 74.
ZHANG Mengyang , TIAN Guohui , GONG Jing , et al. Design method of service decision mechanism based on ontology knowledge base[J]. Journal of Huazhong University of Science and Technology(Nature Science Edition), 2017, 45 (10): 70- 74.
11 LI Y, JIANG L, YIN Q, et al. Robot task planning based on state semantic network[C]//10th International Conference on Intelligent Computation Technology and Automation. Changsha, China: IEEE, 2017: 420-424.
12 路飞, 田国会, 李擎. 智能空间环境下基于本体的机器人服务自主认知及规划[J]. 机器人, 2017, 39 (4): 423- 430.
LU Fei , TIAN Guohui , LI Qing . Autonomous cognition and planning of robot service based on ontology in intelligent space environment[J]. Robot, 2017, 39 (4): 423- 430.
13 GALINDO C , SAFFIOTTI A . Inferring robot goals from violations of semantic knowledge[J]. Robotics and Autonomous Systems, 2013, 61 (10): 1131- 1143.
doi: 10.1016/j.robot.2012.12.007
14 路飞, 李健, 田国会, 等. 基于参数驱动机制的服务机器人任务自动组合方法[J]. 高技术通讯, 2014, 24 (2): 157- 164.
doi: 10.3772/j.issn.1002-0470.2014.02.008
LU Fei , LI Jian , TIAN Guohui , et al. An automatic approach for service composition of service robots based on parameter-driven mechanism[J]. High Technology Letters, 2014, 24 (2): 157- 164.
doi: 10.3772/j.issn.1002-0470.2014.02.008
15 ZHU H , JING L , WANG Y . Knowledge representation and semantic inference of process based on ontology and semantic web rule language[J]. Transactions of Nanjing University of Aeronautics and Astronautics, 2017, 34 (1): 72- 80.
16 赖天武, 吴伟民, 王静, 等. 基于Jess和机器学习的Robocode策略研究与实现[J]. 系统仿真学报, 2006, 18 (增刊2): 912- 915.
LAI Tianwu , WU Weimin , WANG Jing , et al. Research and implementation of robocode decision-making system based on Jess and machine learning[J]. Journal of System Simulation, 2006, 18 (Suppl.2): 912- 915.
17 MAEDCHE A , STAAB S . Ontology learning for the semantic web[J]. IEEE Intelligent Systems, 2001, 16 (2): 72- 79.
18 BECHHOFER S . OWL: Web ontology language[J]. Encyclopedia of Information Science & Technology Second Edition, 2004, 63 (45): 990- 996.
19 COMPTON M , BARNAGHI P , BERMUDEZ L , et al. The SSN ontology of the W3C semantic sensor network incubator group[J]. Web Semantics: Science, Services and Agents on the World Wide Web, 2012, 17 (4): 25- 32.
20 ZHANG X , ZHAO Y , LIU W . A method for mapping sensor data to SSN ontology[J]. International Journal of Hybrid Information Technology, 2015, 8 (6): 303- 316.
[1] YIN Lei, ZHOU Fengyu, LI Ming, WANG Yugang, GUO Yinbo, CHEN Ke. Design of robot cloud service platform based on microservice [J]. Journal of Shandong University(Engineering Science), 2019, 49(6): 55-62.
[2] MA Hanjie, LIN Xia, XU Xiaohui, ZHANG Jian, ZHANG Zhisheng. Load optimization model of smart home management system based on adaptive particle swarm optimization [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(6): 57-62.
[3] LI Qingdong, LUO Weichao, YE Yingxin, ZHANG Chengrui, HU Tianliang. Sharing mechanism of machine tool resource based on ontology [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2017, 47(3): 130-138.
[4] CHEN Hongxing, ZHOU Fengyu, TIAN Tian, JIANG Zhifei, CHEN Zhumin. Design of SOA interface model in service robot cloud computing platform [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(4): 31-39.
[5] LI Guo-dong, ZHAO Wei, TIAN Guo-hui*, XUE Ying-hua. A visual servoing algorithm based on rotation matrix decomposition [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2012, 42(1): 45-50.
[6] TIAN Guo-hui, SONG Bao-ye. An RFID tag localization method for object localization [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(5): 26-31 .
[7] ZHOU Feng-yu, TIAN Guo-hui, GUO Dan, ZHOU Xiang-zhang. Design and implement of the onboard computer software system of service robots for helping the aged and disabled [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2011, 41(1): 32-39.
[8]

TIAN Guo-hui,LI Xiao-lei,ZHAO Shou-peng,LU Fei

. Research and development of intelligent space technology for a home service robot [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(5): 53-59 .
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] WU Hao,TIAN Guo-hui,HUANG Bin .

Research on the collaboration strategy of multi-robot for exploring unknown environment

[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 27 -31 .
[2] GAO Ming, SHI Yue-Thao, WANG Ni-Ni, SUN Feng-Zhong, PING Ya-Ming. Circumferential inflow air distributing rules in a natural draft  wet-cooling tower under crosswind conditions[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(3): 154 -158 .
[3] LI Meng-li, WANG Wei-qiang ,XU Shu-gen , SONG Ming-da. Possibility analysis on chemical explosion of material causing urea  reactor cylinder fracture[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(6): 1 -6 .
[4] CHEN Wengang,TIAN Lan,JIANG Xiaoqing,SUN Yingming*A speech enhancement method based on quickly tracking the noise spectrum[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2006, 36(4): 26 -28 .
[5] NIU Jiqiang, LIANG Xifeng, XIONG Xiaohui, LIU Feng. Effect of outside vehicle windshield on aerodynamic performance of high-speed train under crosswind[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(2): 108 -115 .
[6] ZHENG Hui,CHEN Shu,LIU Li-yun . Analysis and improvement of multipath routing protocols based on DSR[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(1): 115 -118 .
[7] XIA Shao-bo1, XU E2. A wireless sensor node localization algorithm[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2010, 40(3): 143 -147 .
[8] MIN Ying-ying,LIU Yun-gang . Barbalat Lemma and its application in analysis of system stability[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(1): 51 -55 .
[9] WANG Hao-fang,WU Mei,CHEN Wen-yan. Application of fuzzy cluster analysis to regional water resources carrying capacity evaluation[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(3): 139 -143 .
[10] ZHU Dengyuan, YAO Zhanyong, GE Shouren. Study on buried abutment slope transformation based on numerical simulation and site detections[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2015, 45(3): 86 -94 .