Journal of Shandong University(Engineering Science) ›› 2020, Vol. 50 ›› Issue (1): 21-27.doi: 10.6040/j.issn.1672-3961.0.2019.411

• Machine Learning & Data Mining • Previous Articles     Next Articles

GRU-based collaborative filtering recommendation algorithm with active learning

Delei CHEN1(),Cheng WANG1,*(),Jianwei CHEN2,Yiyin WU1   

  1. 1. College of Computer Science and Technology, Huaqiao University, Xiamen 361021, Fujian, China
    2. Department of Mathematics and Statistics, San Diego State University, San Diego 92182, CA, USA
  • Received:2019-01-03 Online:2020-02-20 Published:2020-02-14
  • Contact: Cheng WANG E-mail:18013083003@hqu.edu.cn;wangcheng@hqu.edu.cn
  • Supported by:
    福建省引导性科技计划资助项目(2017H01010065)

RichHTML

18

PDF (PC)

819

Abstract:

The traditional collaborative filtering recommendation algorithm failed to reflect short-term user interest. In order to reflect the short-term interests of users better, a collaborative filtering recommendation algorithm based on Gated Recurrent Unit (GRU) neural network with active learning was proposed. Based on the GRU neural network, the algorithm processed the data into time-series data to reflect the change of the user's interest and used active learning to sample high-quality data dynamically for accelerating the training of GRU neural network. The result on MovieLens1M dataset showed that the GRU model with active learning could obtain higher short-term prediction success rate, recall rate, item coverage, and user coverage compared with the user-based collaborative filtering method (UCF), the markovian chain model-based collaborative filtering method (MC) and the matrix factory-based collaborative filtering method (LFM), so it could effectively predict the short-term interest of users, improve the accuracy, discover the long-tail items. Meanwhile, it could achieve the same effect with fewer iterations compared with the original GRU model.

Key words: collaborative filtering, gated recurrent unit, active learning, deep learning, time-series data

CLC Number: 

  • TP311

Fig.1

Algorithm flow chart"

Table 1

Comparison of GRU+Active with other recommendation algorithms"

指标 UCF MC LFM GRU+Active
使用数据 原始评分矩阵 时序化评分数据 原始评分矩阵 时序化评分数据
反映短时用户兴趣 差 一般 差 好
短时预测精度 低 一般 低 高
发掘长尾物品能力 差 一般 差 好

Table 2

Parameters values used in the GRU Modeland the GRU+Active Model"

方法 参数
GRU+随机采样 l=0.05, k=50, adam
GRU+Active a=100, l=0.05, k=50, adam

Table 3

The predictive performance of each algorithm on movielens dataset"

方法 Sps/% Recall/% Item-coverage/个 User-coverage/%
UCF 11.62 5.77 301 77.99
LFM 11.28 5.65 399 80.80
MC 19.54 5.27 558 78.70
GRU 32.16 8.85 659 87.98
GRU+Active 32.51 8.86 662 88.81

Fig.2

Comparison of GRU and GRU+Active in Sps"

Fig.3

Comparison of GRU and GRU+Active in recall"

Fig.4

Comparison of GRU and GRU+Active in user coverage"

Fig.5

Comparison of GRU and GRU+Active in item coverage"

1 冷亚军, 陆青, 梁昌勇. 协同过滤推荐技术综述[J]. 模式识别与人工智能, 2014, 27 (8): 720- 734.
doi: 10.3969/j.issn.1003-6059.2014.08.007
LENG Yajun , LU Qing , LIANG Changyong . Survey of recommendation based on collaborative filtering[J]. Pattern Recognition and Artificial Intelligence, 2014, 27 (8): 720- 734.
doi: 10.3969/j.issn.1003-6059.2014.08.007
2 翁小兰, 王志坚. 协同过滤推荐算法研究进展[J]. 计算机工程与应用, 2018, 54 (1): 25- 31.
WENG Xiaolan , WANG Zhijian . Research progress of collaborative filtering recommendation algorithm[J]. Computer Engineering and Applications, 2018, 54 (1): 25- 31.
3 KOREN Y , BELL R . Recommender systems handbook[M]. New York, USA: Springer, 2015: 77- 118.
4 THORAT P B , GOUDAR R M , BARVE S . Survey on collaborative filtering, content-based filtering and hybrid recommendation system[J]. International Journal of Computer Applications, 2015, 110 (4): 31- 36.
doi: 10.5120/19308-0760
5 ELAHI M , RICCI F , RUBENS N . A survey of active learning in collaborative filtering recommender systems[J]. Computer Science Review, 2016, 20, 29- 50.
doi: 10.1016/j.cosrev.2016.05.002
6 季芸, 胡雪蕾. 基于Baseline SVD主动学习算法的推荐系统[J]. 现代电子技术, 2015, 38 (12): 8- 11.
JI Yun , HU Xuelei . Recommender system based on Baseline SVD active learning algorithm[J]. Modern Electronics Technique, 2015, 38 (12): 8- 11.
7 余天豪.基于社会网络的主动信息推送算法研究[D].杭州:杭州师范大学, 2012.
YU Tianhao. Research on recommendation algorithm based on social network[D]. Hangzhou: Hangzhou Normal University, 2012.
8 GUO G, ZHANG J, YORKE-SMITH N. Trust SVD: collaborative filtering with both the explicit and implicit influence of user trust and of item ratings[C]//Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. Texas, USA: AAAI Press, 2015: 123-129.
9 JOHNSON J, NG Y K. Enhancing long tail item recommendations using tripartite graphs and Markov process[C]//Proceedings of the International Conference on Web Intelligence. California, USA: ACM, 2017: 761-768.
10 ALSHAMMARI G, JORRO-ARAGONESES J L, KAPETANAKIS S, et al. A hybrid CBR approach for the long tail problem in recommender systems[C]// International Conference on Case-Based Reasoning. Trondheim, Norway: Springer, 2017: 35-45.
11 HE X, LIAO L, ZHANG H, et al. Neural collaborative filtering[C]// Proceedings of the 26th International Conference on World Wide Web. Perth, Australia: ACM, 2017: 173-182.
12 XUE H J, DAI X Y, ZHANG J, et al. Deep matrix factorization models for recommender systems[C]//International Joint Conference on Artificial Intelligence. Melbourne, Australia: AAAI Press, 2017: 3203-3209.
13 CHEN T, SUN Y, SHI Y, et al. On sampling strategies for neural network-based collaborative filtering[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Halifax, Canada: ACM, 2017: 767-776.
14 BILLSUS D, PAZZANI M J. Learning collaborative information filters[C]// Proceedings of the Fifteenth International Conference on Machine Learning. California, USA: Morgan Kaufmann Publishers Inc., 1998: 46-54.
15 FUNK S. Netflix update: try this at home[EB/OL]. (2006-12-11) [2019-04-12]. http://sifter.org/~simon/journal/20061211.html.
16 KOREN Y . Factor in the neighbors: scalable and accurate collaborative filtering[J]. Acm Transactions on Knowledge Discovery from Data, 2010, 4 (1): 1- 24.
17 DEVOOGHT R, BERSINI H. Long and short-term recommendations with recurrent neural networks[C]//Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. Bratislava, Slovakia: ACM, 2017: 13-21.
18 LIU J , WU C , WANG J . Gated recurrent units based neural network for time heterogeneous feedback recommendation[J]. Information Sciences, 2018, 423, 50- 65.
doi: 10.1016/j.ins.2017.09.048
19 HOCHREITER S , SURHONE J . Long short-term memory[J]. Neural Computation, 1997, 9 (8): 1735- 1780.
doi: 10.1162/neco.1997.9.8.1735
20 CHO K, VAN MERRIENBOER B, GULCEHRE C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation[C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Doha, Qatar: MIT Press, 2014: 1724-1734.
21 HIDASI B, KARATZOGLOU A. Recurrent neural networks with top-k gains for session-based recommendations[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management. Torino, Italy:ACM, 2018: 843-852.
22 CHAKRABORTY S , BALASUBRAMANIAN V , SUN Q . Active batch selection via convex relaxations with guaranteed solution bounds[J]. IEEE Trans Pattern Anal Mach Intell, 2015, 37 (10): 1945- 1958.
doi: 10.1109/TPAMI.2015.2389848
23 KONYUSHKOVA K, SZNITMAN R, FUA P. Learning active learning from data[C]//Advances in Neural Information Processing Systems. California, USA: ACM, 2017: 4225-4235.
24 HUANG S J, ZHAO J W, LIU Z Y. Cost-effective training of deep cnns with active model adaptation[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. London, UK:ACM, 2018: 1580-1588.
25 KARIMI R, FREUDENTHALER C, NANOPOULOS A, et al. Non-myopic active learning for recommender systems based on Matrix Factorization[C]//IEEE International Conference on Information Reuse and Integration. Las Vegas, USA: IEEE, 2011:299-303.
26 ZHOU D, WANG B, RAHIMI S M, et al. A study of recommending locations on location-based social network by collaborative filtering[C]//Canadian Conference on Artificial Intelligence. Toronto, Canada:Springer, 2012: 255-266.
27 RENDLE S, FREUDENTHALER C, SCHMIDT-THIEME L. Factorizing personalized markov chains for next-basket recommendation[C]//Proceedings of the 19th international conference on World wide web. North Carolina, USA:ACM, 2010: 811-820.
[1] Yue YUAN,Yanli WANG,Kan LIU. Named entity recognition model based on dilated convolutional block architecture [J]. Journal of Shandong University(Engineering Science), 2022, 52(6): 105-114.
[2] Tongyu JIANG, Fan CHEN, Hongjie HE. Lightweight face super-resolution network based on asymmetric U-pyramid reconstruction [J]. Journal of Shandong University(Engineering Science), 2022, 52(1): 1-8.
[3] Jianqing WU,Xiuguang SONG. Review on development of simultaneous localization and mapping technology [J]. Journal of Shandong University(Engineering Science), 2021, 51(5): 16-31.
[4] YANG Xiuyuan, PENG Tao, YANG Liang, LIN Hongfei. Adaptive multi-domain sentiment analysis based on knowledge distillation [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 15-21.
[5] Qingfa CHAI,Shoujing SUN,Jifu QIU,Ming CHEN,Zhen WEI,Wei CONG. Prediction method of power grid emergency supplies under meteorological disasters [J]. Journal of Shandong University(Engineering Science), 2021, 51(3): 76-83.
[6] XIE Ziqi, WANG Lihong, LI Man. Active learning of pairwise constraints in block diagonal subspace clustering [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 65-73.
[7] LIAO Jinping, MO Yuchang, YAN Ke. Model and application of short-term electricity consumption forecast based on C-LSTM [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 90-97.
[8] Guoyong CAI,Xinhao HE,Yangyang CHU. Visual sentiment analysis based on spatial attention mechanism and convolutional neural network [J]. Journal of Shandong University(Engineering Science), 2020, 50(4): 8-13.
[9] LIU Shuai, WANG Lei, DING Xutao. Emotional EEG recognition based on Bi-LSTM [J]. Journal of Shandong University(Engineering Science), 2020, 50(4): 35-39.
[10] Shengnan ZHANG,Lei WANG,Chunhong CHANG,Benli HAO. Image denoising based on 3D shearlet transform and BM4D [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 83-90.
[11] Chunyang LI,Nan LI,Tao FENG,Zhuhe WANG,Jingkai MA. Abnormal sound detection of washing machines based on deep learning [J]. Journal of Shandong University(Engineering Science), 2020, 50(2): 108-117.
[12] Peng WAN. Object detection of 3D point clouds based on F-PointNet [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 98-104.
[13] Yutian LIU, Runjia SUN, Hongtao WANG, Xueping GU. Review on application of artificial intelligence in power system restoration [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 1-8.
[14] Zhixiang LIANG,Xiaoming LIU,Ying MU,Yutian LIU. Prediction method of wind power and PV ramp event based on deep learning [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 24-28.
[15] Ji ZHANG,Cui JIN,Hongyuan WANG,Shoubing CHEN. Pedestrian recognition based on singular value decomposition pedestrian alignment network [J]. Journal of Shandong University(Engineering Science), 2019, 49(5): 91-97.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] CHENG Daizhan, LI Zhiqiang. A survey on linearization of nonlinear systems[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(2): 26 -36 .
[2] WANG Yong, XIE Yudong. Gas control technology of largeflow pipe[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(2): 70 -74 .
[3] BO De-Yun, ZHANG Dao-Jiang. Adaptive spectral clustering algorithm[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(5): 22 -26 .
[4] LONG Zhi-Jian, ZHANG Chang-Qiao. Synthesis and properties of associating DRA by binary copolymerization based on lauryl methacrylate[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(5): 128 -132 .
[5] LI Shan-ping,HU Zhen,SUN Yi-ming*,ZHEN Bo-ru,ZHANG Qi-lei,CAO Han-lin . Preparation and evaluation of the electro-catalytic characteristics of novel lead Ti-based dioxide electrodes[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(3): 109 -113 .
[6] LUO Yun-hu,WU Xu-wen,PAN Shuang-lai,DONG Er-ling,SUN Xiu-juan,WANG Chuan-jiang,WU Na . Coordination of two kinds of interruptible loads of demand side and reserve capacity of generation side[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2007, 37(6): 66 -70 .
[7] ZHAI Xin-Xian, CHEN Dong-Hai, GUO Nian-Bo, GOU Pan-Feng. The laws of strata behavior for the gob-side tailgate in the  Jining No.3 Coal Mine[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2009, 39(4): 92 -96 .
[8] LIU Dian-rui,ZHAO Hui-hong,ZHONG Mai-ying . The H∞ fault estimation for linear discrete time-varying systems[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 11 -16 .
[9] QIAO Xiaoyan. Automatic recognition method of microscopic image of harmful algae[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(3): 1 -6 .
[10]

L〖AKU¨] Guo-ren,YAN Shu-ming,BAI Shu-feng,JIA Ning,MA Liang

. Impact property research on a new type of guardrail terminal for freeway[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2008, 38(4): 47 -52 .
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd