Journal of Shandong University(Engineering Science) ›› 2026, Vol. 56 ›› Issue (5): 52-61.doi: 10.6040/j.issn.1672-3961.0.2025.132

• Machine Learning & Data Mining • Previous Articles    

Label distribution learning based on label-specific features and common features

Kong Shu1,2, Chen Linlin1,2*, He Qiang1,2, Wang Hengyou1,2   

  1. Kong Shu1, 2, Chen Linlin1, 2*, He Qiang1, 2, Wang Hengyou1, 2(1. College of Science, Beijing University of Civil Engineering and Architecture, Beijing 102616, China;
    2. Institute of Big Data Modeling and Technology, Beijing University of Civil Engineering and Architecture, Beijing 102616, China
  • Published:2026-10-19

Abstract: Label distribution learning(LDL)is an innovative machine learning paradigm that focuses on the label descriptiveness of specific instances. Existing LDL models were built on a simple feature space where all features were shared by all class labels. However, this traditional data representation strategy tended to select features that were distinguishable across all labels while overlooking label-specific features that were relevant and distinctive for each class label. In this paper, we proposed a label distribution learning method based on label-specific features and common features. First, we calculated the label correlation matrix for label pairs, and for each label pair, all instances were partitioned based on descriptiveness, clustering was performed for each class, and label pair-specific features were constructed. Next, clustering analysis was performed on all instances to construct common features for the labels. Finally, training and testing were conducted by querying the clustering results. Extensive experiments on multiple real label distribution datasets validated the superiority of the method and the effectiveness of label-specific features.

Key words: label distribution learning, label-specific feature, label common features, label correlation, clustering

CLC Number: 

  • TP181
[1] Zhang M L, Wu L. Lift: multi-label learning with label-specific features[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(1): 107-120.
[2] 张海翔, 李培培, 胡学钢. 类不平衡的公共和标签特定特征多标签分类[J]. 计算机技术与发展, 2024, 34(2): 46-52. Zhang Haixiang, Li Peipei, Hu Xuegang. Class imbalance multi-label classification with common and label specific features[J]. Computer Technology and Development, 2024, 34(2): 46-52.
[3] Ren T T, Jia X Y, Li W W, et al. Label distribution learning with label-specific features[C] //Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. New York, USA: International Joint Conferences on Artificial Intelligence Organization, 2019: 3318-3324.
[4] 王进, 梁晨, 孙开伟, 等. 基于标签相关性的标签特定特征多标签学习[J]. 江苏大学学报(自然科学版), 2023, 44(5): 554-563. Wang Jin, Liang Chen, Sun Kaiwei, et al. Multi-label learning with label-specific features via label correlations[J]. Journal of Jiangsu University(Natural Science Edition), 2023, 44(5): 554-563.
[5] Qian W B, Ye Q Z, Li Y H, et al. Label distribution feature selection with feature weights fusion and local label correlations[J]. Knowledge-Based Systems, 2022, 256: 109778.
[6] 石荣毅. 基于标签特定特征和偏标签的多标签学习[D]. 舟山: 浙江海洋大学, 2025: 19-26. Shi Rongyi. Multi-label learning with label-specific features and partial labels[D]. Zhoushan: Zhejiang Ocean University, 2025: 19-26.
[7] Li G L, Zhang H R, Min F, et al. Two-stage label distribution learning with label-independent prediction based on label-specific features[J]. Knowledge-Based Systems, 2023, 267: 110426.
[8] Geng X, Smith-Miles K, Zhou Z H. Facial age estimation by learning from label distributions[C] //Proceedings of the 24th AAAI Conference on Artificial Intelligence. Atlanta, USA: AAAI Press, 2010: 451-456.
[9] Geng X. Label distribution learning[J]. IEEE Transactions on Knowledge and Data Engineering, 2016, 28(7): 1734-1748.
[10] Liu S P, Samonte M J C. The advancement in multi-label and label distribution learning[C] //2024 International Conference on Electronics and Devices, Computational Science. Marseille, France: IEEE, 2024: 747-751.
[11] Shu W H, Xia Q, Qian W B. Label distribution feature selection based on label-specific features[J]. Applied Intelligence, 2024, 54(19): 9195-9212.
[12] Zhang Z Y, Wang J, Geng X. Label distribution learning by utilizing common and label-specific feature fusion space[J]. International Journal of Machine Learning and Cybernetics, 2025, 16(3): 1545-1558.
[13] Huang J, Qin F, Zheng X, et al. Improving multi-label classification with missing labels by learning label-specific features[J]. Information Sciences, 2019, 492: 124-146.
[14] Ma J H, Chow T W S, Zhang H J. Semantic-gap-oriented feature selection and classifier construction inmultilabel learning[J]. IEEE Transactions on Cybernetics, 2022, 52(1): 101-115.
[15] Li J L, Li P P, Hu X G, et al. Learning common and label-specific features for multi-Label classification with correlation information[J]. Pattern Recognition, 2022, 121: 108259.
[16] Zhang J, Wu H R, Jiang M, et al. Group-preserving label-specific feature selection for multi-label learning[J]. Expert Systems with Applications, 2023, 213: 118861.
[17] Hang J Y, Zhang M L. Collaborative learning of label semantics and deep label-specific features for multi-labelclassification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(12): 9860-9871.
[18] Zhang M L, Fang J P, Wang Y B.BiLabel-specific features for multi-label classification[J]. ACM Transactions on Knowledge Discovery from Data, 2021, 16(1): 1-23.
[19] 马坤, 刘筱云, 李乐平, 等. 用于意图识别的自适应多标签信息学习模型[J]. 山东大学学报(工学版), 2024, 54(1): 45-51. Ma Kun, Liu Xiaoyun, Li Leping, et al. Adaptive label information learning for intention detection[J]. Journal of Shandong University(Engineering Science), 2024, 54(1): 45-51.
[20] 唐杰烽, 张佳, 龙锦益. 基于全局冗余最小的快速多标签特征选择方法[J]. 山东大学学报(工学版), 2025, 55(6): 21-34. Tang Jiefeng, Zhang Jia, Long Jinyi. Fast multi-label feature selection method based on global redundancy minimization[J]. Journal of Shandong University(Engineering Science), 2025, 55(6): 21-34.
[21] Klein Y, Efrati E, Sharon E. Shaping of elastic sheets by prescription of non-euclidean metrics[J]. Science, 2007, 315(5815): 1116-1120.
[22] Geng X, Luo L R. Multilabel ranking with inconsistent rankers[C] //2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA: IEEE, 2014: 3742-3747.
[23] Boutell M R, Luo J B, Shen X P, et al. Learning multi-label scene classification[J]. Pattern Recognition, 2004, 37(9): 1757-1771.
[24] Yin L J, Wei X Z, Sun Y, et al. A 3D facial expression database for facial behavior research[C] //7th International Conference on Automatic Face and Gesture Recognition. LosAlamitos, USA: IEEE, 2006: 211-216.
[25] Wang J, Feng F,Lv J H, et al. Residual k-nearest neighbors label distribution learning[J]. Pattern Recognition, 2025, 158: 111006.
[26] Friedman M. A comparison of alternative tests of significance for the problem of m rankings[J]. The Annals of Mathematical Statistics, 1940, 11(1): 86-92.
[27] Dunn O J. Multiple comparisons among means[J]. Journal of the American Statistical Association, 1961, 56(293): 52-64.
[28] Demšar J. Statistical comparisons of classifiers over multiple data sets[J]. Journal of Machine Learning Research, 2006, 7: 1-30.
[1] Dai Hongna, Li Zhongrui, Feng Haixia, Zhao Huanhuan, Fan Hongxian. The study of commuter flow identification methods on expressways in megacities based on ETC toll data [J]. Journal of Shandong University(Engineering Science), 2026, 56(5): 40-51.
[2] LI Xiaohui, LIU Xiaofei, SUN Weitong, ZHAO Yi, DONG Yuan, JIN Yinli. An inspection task assignment and path planning algorithm based on vehicles-UAVs collaboration [J]. Journal of Shandong University(Engineering Science), 2025, 55(5): 101-109.
[3] CHEN Sugen, ZHAO Zhizhong. Density peak clustering combining local truncation distance and small clusters merging [J]. Journal of Shandong University(Engineering Science), 2025, 55(2): 58-70.
[4] ZHU Hengdong, MA Yingcang, DAI Xuezhen. Adaptive semi-supervised neighborhood clustering algorithm [J]. Journal of Shandong University(Engineering Science), 2021, 51(4): 24-34.
[5] XIE Ziqi, WANG Lihong, LI Man. Active learning of pairwise constraints in block diagonal subspace clustering [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 65-73.
[6] ZHU Changming, YUE Wen, WANG Panhong, SHEN Zhenyu, ZHOU Rigui. Global and local multi-view multi-label learning with active three-way clustering [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 34-46.
[7] Bei LI,Song ZHAO,Zhijia XIE,Meng NIU. Electric vehicle virtual energy storage available capacity modeling [J]. Journal of Shandong University(Engineering Science), 2020, 50(6): 101-111.
[8] Yibin WANG,Tianli LI,Yusheng CHENG,Kun QIAN. Label distribution learning based on kernel extreme learning machine auto-encoder [J]. Journal of Shandong University(Engineering Science), 2020, 50(3): 58-65.
[9] Run XIANG,Sufen CHEN,Xueqiang ZENG. Facial age estimation based on multivariate multiple regression [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 54-60.
[10] Jun QIN,Yuanpeng ZHANG,Yizhang JIANG,Wenlong HANG. Transfer fuzzy clustering based on self-constraint of multiple medoids [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 107-115.
[11] Xinyu DONG,Hanyue CHEN,Jiaguo LI,Qingyan MENG,Shihe XING,Liming ZHANG. An unsupervised color image segmentation method based on fusion of multiple methods [J]. Journal of Shandong University(Engineering Science), 2019, 49(2): 96-101.
[12] Yingxue ZHU,Ruizhang HUANG,Can MA. A short text dynamic clustering approach bias on new topic [J]. Journal of Shandong University(Engineering Science), 2018, 48(6): 8-18.
[13] Qiyue SONG, Xuewen MU, Huan CHENG. Segmentation of connected characters based on improved drop-fall algorithm [J]. Journal of Shandong University(Engineering Science), 2018, 48(6): 89-94.
[14] DU Xixi, LIU Huafeng, JING Liping. An additive co-clustering for recommendation of integrating social network [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 96-102.
[15] YANG Tianpeng, XU Kunpeng, CHEN Lifei. Coefficient of variation clustering algorithm for non-uniform data [J]. JOURNAL OF SHANDONG UNIVERSITY (ENGINEERING SCIENCE), 2018, 48(3): 140-145.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!