Journal of Shandong University(Engineering Science) ›› 2021, Vol. 51 ›› Issue (2): 83-89.doi: 10.6040/j.issn.1672-3961.0.2020.246

Previous Articles    

Aspect-level sentiment classification combined with syntactic dependency information

ZHANG Qinyang, LI Xu*, YAO Chunlong, LI Changwu   

  1. School of Information Science and Engineering, Dalian Polytechnic University, Dalian 116034, Liaoning, China
  • Published:2021-04-16

PDF (PC)

351

Abstract: Considering introducing syntactic dependency information into the original aspect terms, a new aspect term representation method was proposed. First Glove word vector was used to represent the words and dependency relationship between words, and the dependency adjacency matrix and the representation of dependency relationship matrix including syntactic dependency information was constructed. Then graph convolution neural network and multi-head attention mechanism were used to integrate syntactic dependency information into aspect terms, so that aspect terms were highly related to context structure. The models generalization ability were effectively improved by replacing the existing models with the improved aspect term expression. Through comparative experiments and analysis, effectiveness and generalization of the method were proved.

Key words: syntactically dependency information, aspect-level sentiment classification, Glove word vector, graph convolution, attention mechanism

CLC Number: 

  • TP183
[1] WAGNER J, ARORA P, CORTES S, et al. Dcu: aspect-based polarity classification for SemEval task 4[C] //International Conference on Computational Linguistics. Dublin, Ireland: ACL, 2014: 223-229.
[2] WANG Y, HUANG M, ZHU X, et al. Attention-based LSTM for aspect-level sentiment classification[C] //Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Austin, USA: ACL, 2016: 606-615.
[3] HAZARIKA D, PORIA S, VIJ P, et al. Modeling inter-aspect dependencies for aspect-based sentiment analysis[C] //Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics. New Orleans, USA: NAACL, 2018: 266-270.
[4] SCHMITT M, STEINHEBER S, SCHREIBER K, et al. Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks[DB/OL].(2018-08-28)[2020-04-15].https://arxiv.org/pdf/1808.09238.pdf.
[5] RAN X, PAN Y, SUN W, et al. Learn to select via hierarchical gate mechanism for aspect-based sentiment analysis[C] //Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence Main Track. Macao, China: IJCAI, 2019: 5160-5167.
[6] VASANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C] //31st Conference on Neural Information Processing Systems. Long Beach, USA: NIPS, 2017: 5998-6008.
[7] SONG Y, WANG J, JIANG T, et al. Targeted Sentiment Classification with Attentional Encoder Network[C] //International Conference on Artificial Neural Networks. Munich, Germany: ICANN, 2019: 93-103.
[8] SUN C, HUANG L, QIU X. Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence[DB/OL].(2019-03-22)[2020-04-30].https://arxiv.org/pdf/1903.09588.pdf.
[9] DONG L, WEI F, TAN C, et al. Adaptive recursive neural network for target-dependent twitter sentiment classification[C] //Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics(volume 2: Short papers). Baltimore, USA: AMACL, 2014: 49-54.
[10] KIPF T N, WELLING M. Semi-supervised classification with graph convolutional networks[EB/OL].(2017-02-22)[2020-4-30]. https://arxiv.org/pdf/1609.02907.pdf.
[11] RAO D, RAVICHANDRAN D. Semi-supervised polarity lexicon induction[C] //Proceedings of the 12th Con-ference of the European Chapter of the ACL. Athens, Greece: ECACL, 2009: 675-682.
[12] KIRITCHENKO S, ZHU X, MOHAMMAD S M. Sentiment analysis of short informal texts[J]. Journal of Artificial Intelligence Research, 2014, 50: 723-762.
[13] JIANG L, YU M, ZHOU M, et al. Target-dependent twitter sentiment classification[C] //Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: human language technologies. Portland, Oregon: ALACM, 2011: 151-160.
[14] TANG D, QIN B, LIU T. Aspect level sentiment classification with deep memory network[DB/OL].(2016-09-24)[2020-04-30]. https://arxiv.org/pdf/1605.08900.pdf.
[15] TAY Y, LUU A T, HUI S C. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis[DB/OL].(2017-12-14)[2020-4-30]. https://arxiv.org/pdf/1712.05403.pdf.
[16] XING B, LIAO L, SONG D, et al. Earlier attention? aspect-aware LSTM for aspect-based sentiment analysis[DB/OL].(2019-07-07)[2020-04-20]. https://arxiv.org/pdf/1905.07719.pdf.
[17] HE R, LEE W S, NG H T, et al. Effective attention modeling for aspect-level sentiment classification[C] //Proceedings of the 27th International Conference on Computational Linguistics. Santa Fe, New Mexico: ICCL, 2018: 1121-1131.
[18] SUN K, ZHANG R, MENSAH S, et al. Aspect-level sentiment analysis via convolution over dependency tree[C] //Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Hong Kong, China: JCNLP, 2019: 5683-5692.
[19] PENNINGTON J, SOCHER R, MANNING C D. Glove: Global vectors for word representation[C] //Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar: EMNLP, 2014: 1532-1543.
[20] PONTIKI M, GALANIS D, PAVLOPOULOS J, et al. SemEval-2014 task 4: aspect based sentiment analysis[C] //International Conference on Computational Linguistics. Doha, Qatar: EMNLP, 2014: 27-35.
[21] KIRITCHENKO S, ZHU X, CHERRY C, et al. NRC-Canada-2014: detecting aspects and sentiment in customer reviews[C] //Proceedings of the 8th International Workshop on Semantic Evaluation. Dublin, Ireland: SemEval, 2014: 437-442.
[22] MA D, LI S, ZHANG X, et al. Interactive attention networks for aspect-level sentiment classification[DB/OL].(2017-09-04)[2020-04-30]. https://arxiv.org/abs/1709.00893.
[23] LI X, CHANG D, TIAN T, et al. Large-margin regularized softmax cross-entropy loss[J]. IEEE Access, 2019, 7: 19572-19578.
[24] KINGMA D P, BA J. Adam: a method for stochastic optimization[DB/OL].(2015-07-23)[2020-04-30]. https://arxiv.org/pdf/1412.6980v8.
[25] DEVLIN J, CHANG M W, LEE K, et al. Bert: pre-training of deep bidirectional transformers for language understanding[DB/OL].(2019-05-09)[2020-04-30]. https://arxiv.org/pdf/1810.04805.pdf.
[1] ZHANG Junsan, CHENG Qiaoqiao, WAN Yao, ZHU Jie, ZHANG Shidong. MIRGAN: a medical image report generation model based on GAN [J]. Journal of Shandong University(Engineering Science), 2021, 51(2): 9-18.
[2] ZHANG Yuefang, DENG Hongxia, HU Chunxiang, QIAN Guanyu, LI Haifang. Hippocampal segmentation combining residual attention mechanism and generative adversarial networks [J]. Journal of Shandong University(Engineering Science), 2020, 50(6): 76-81.
[3] LIAO Nanxing, ZHOU Shibin, ZHANG Guopeng, CHENG Deqiang. Image caption generation method based on class activation mapping and attention mechanism [J]. Journal of Shandong University(Engineering Science), 2020, 50(4): 28-34.
[4] Guoyong CAI,Xinhao HE,Yangyang CHU. Visual sentiment analysis based on spatial attention mechanism and convolutional neural network [J]. Journal of Shandong University(Engineering Science), 2020, 50(4): 8-13.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of Journal of Shandong University (Engineering Science)
Supported by Beijing Magtech Co.Ltd