基于信息熵的协同过滤算法

doi:10.6040/j.issn.1672-3961.2.2015.047

摘要/Abstract

摘要： 针对用户评分数据的稀疏性制约着系统的推荐质量的问题,提出了一种基于信息熵的协同过滤算法。首先定义了用户信息熵以反映用户评分分布和倾向程度;然后,利用大间隔的方法计算目标用户与其他用户的间隔距离,结合目标用户的信息熵,得到目标用户的近邻选择范围;最后,同时考虑用户的信息熵和用户间的相似性大小得到目标用户的近邻集合,以降低数据稀疏性对推荐结果的影响。试验结果表明:基于信息熵的协同过滤算法能够有效地提高推荐质量。

关键词: 数据稀疏性, 相似性, 大间隔, 近邻选择, 协同过滤, 信息熵

Abstract: In the recommender system, the recommended quality was restricted by the sparsity of user rating data. To solve this problem, a novel entropy-based collaborative filtering algorithm was proposed. First, the definition of user entropy was given to reflect the rating distribution of users and their rating tendency degree. Then, the method of large margin was introduced to calculate the margin distance, and the neighbor selection range was determined via combining both of the active users entropy and margin distance with other users. Finally, neighbors were obtained by making full of the user entropy and the similarity between users, which could degrade the influence of the sparse rating data. Experimental results on two data sets showed that the proposed algorithm could improve the recommended quality effectively.

Key words: data sparsity, similarity, large margin, entropy, collaborative filtering, neighbor selection

中图分类号:

TP391

张佳,林耀进,林梦雷,刘景华,李慧宗. 基于信息熵的协同过滤算法[J]. 山东大学学报(工学版), 2016, 46(2): 43-50.

ZHANG Jia, LIN Yaojin, LIN Menglei, LIU Jinghua, LI Huizong. Entropy-based collaborative filtering algorithm[J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2016, 46(2): 43-50.

参考文献

[1] ADOMAVICIUS G, TUZHILIN A. Toward the next generation of recommender systems:a survey of the state-of-the-art and possible extensions[J]. IEEE Transactions on Knowledge and Data Engineering, 2005, 17(6):734-749.
[2] LI Yanen, ZHAI Chengxiang, Chen Ye. Exploiting rich user information for one-class collaborative filtering[J]. Knowledge and Information Systems, 2014, 38(2):277-301.
[3] SHI Yue, LARSON M, HANJALIC A. Collaborative filtering beyond the user-item matrix:a survey of the state of the art and future challenges[J]. ACM Computing Surveys, 2014, 47(1):3:1-3:45.
[4] BOBADILLA J, ORTEGA F, HEMANDO A, et al. Recommender systems survey[J]. Knowledge-Based Systems, 2013,(46):109-132.
[5] BREESE J S, HECKERMAN D, KADIE C. Empirical Analysis of Predictive Algorithms for Collaborative Filtering[C] //Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. Madison, USA:UAI, 1998:43-52.
[6] RESNICK P, IACOVOU N, SUCHAK M, et al. GroupLens:An open architecture for collaborative filtering of netnews[C] //Proceedings of the ACM Conference on Computer Supported Cooperative Work. Chapel Hill, USA:ACM, 1994:175-186.
[7] JAMALI M, ESTER M. TrustWalker:a random walk model for combining trust-based and item-based recommendation[C] //Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA:ACM, 2009:397-406.
[8] SARWAR B, KARPIS G, KONSTAN J, et al. Item-based collaborative filtering recommendation algorithms[C] //Proceedings of the 10th International Conference on World Wide Web. New York, USA:ACM, 2001:285-295.
[9] AHN H J. A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem[J]. Information Sciences, 2008, 178(1):37-51.
[10] 李改,李磊.一种解决协同过滤系统冷启动问题的新算法[J].山东大学学报(工学版),2012,42(2):11-17. LI Gai, LI Lei. A new algorithm of cold-start in a collaborative filtering system[J]. Journal of Shandong University(Engineering Science), 2012, 42(2):11-17.
[11] LIU Haifeng, HU Zheng, MIAN Ahmad, et al. A new user similarity model to improve the accuracy of collaborative filtering[J]. Knowledge-Based Systems, 2014(56):156-166.
[12] 邓晓懿,金淳,韩庆平,等.基于情境聚类和用户评级的协同过滤推荐模型[J].系统工程理论与实践,2013,33(11):2945-2953. DENG Xiaoyi, JIN Chun, HAN Qingping, et al. Improved collaborative filtering model based on context clustering and user raking[J]. Systems Engineering—Theory & Practice, 2013, 33(11):2945-2953.
[13] 邓爱林,朱扬勇,施伯乐.基于项目评分预测的协同过滤推荐算法[J].软件学报,2003,14(9):1621-1628. DENG Ailin, ZHU Yangyong, SHI Bole. A collaborative filtering recommendation algorithm based on item rating prediction[J]. Journal of Software, 2003, 14(9):1621-1628.
[14] 林耀进,胡学钢,李慧宗.基于用户群体影响的协同过滤推荐算法[J].情报学报,2013,32(3):299-305. LIN Yaojin, HU Xuegang, LI Huizong. Collaborative filtering recommendation algorithm based on user group influence[J]. Journal of the China Society for Scientific and Technical Information, 2013, 32(3):299-305.
[15] JEONG B, LEE J, CHO H. User credit-based collaborative filtering[J]. Expert Systems with Applications, 2009, 36(6):7309-7312.
[16] ANAND D, BHARADWAJ K K. Utilizing various sparsity measures for enhancing accuracy of collaborative recommender systems based on local and global similarities[J]. Expert Systems with Applications, 2011, 38(5):5101-5109.
[17] BOUMAZA A, BRUN A. Stochastic search for global neighbors selection in collaborative filtering[C] //Proceedings of the 27th Annual ACM Symposium on Applied Computing. New York, USA:ACM, 2012:232-237.
[18] 黄创光,印鉴,汪静,等.不确定近邻的协同过滤推荐算法[J].计算机学报,2010,33(8):1369-1377. HUANG Chuangguang, YIN Jian, WANG Jing, et al. Uncertain neighbors' collaborative filtering recommendation algorithm[J]. Chinese Journal of Computers, 2010, 33(8):1369-1377.
[19] 李聪,梁昌勇,马丽.基于领域最近邻的协同过滤推荐算法[J].计算机研究与发展,2008,45(9):1532-1538. LI Cong, LIANG Changyong, MA Li. A collaborative filtering recommendation algorithm based on domain nearest neighbor[J]. Journal of Computer Research and Development, 2008, 45(9):1532-1538.
[20] LIU Qi, CHEN Enhong, XIONG Hui, et al. Enhancing collaborative filtering by user interest expansion via personalized ranking[J]. IEEE Transactions on Systems, Man, and Cybernetics, 2012, 42(1):218-233.
[21] BOBADILLA J, HERNANDO A, ORTEGA F, et al. Collaborative filtering based on significances[J]. Information Sciences, 2012, 185(1):1-17.
[22] LIN Yaojin, HU Xuegang, WU Xindong. Quality of information-Based source assessment and selection[J]. Neurocomputing, 2014(133):95-102.
[23] YANG Ming, WANG Fei, YANG Ping. A novel feature selection algorithm based on hypothesis-margin[J]. Journal of Computers, 2008, 3(12):27-34.
[24] KALELI C.An entropy-based neighbor selection approach for collaborative filtering[J]. Knowledge-Based Systems, 2014(56):273-280.

多维度评价

Viewed

Full text

Abstract

Cited

Shared

Discussed