SenticGAT: Sentiment Knowledge Enhanced Graph Attention Network for Multi-view Feature Representation in Aspect-based Sentiment Analysis
DOI:
https://doi.org/10.15837/ijccc.2023.5.5089Keywords:
Computational Intelligence, Aspect-based Sentiment Analysis, Graph Attention Network, Feature Fusion, Attention MechanismAbstract
Currently, computational intelligence methods, especially artificial neural networks, are increasingly applied to many scenarios. We mainly attempt to explore the task of fine-grained sentiment classification of review data through computational intelligence methods, especially artificial neural networks, and this task is also known as aspect-based sentiment analysis (ABSA). We propose a new technique called SenticGAT which is a multi-view features fusion model enhanced by an external sentiment database. We encode the external sentiment information into the syntactic dependency tree to obtain an enhanced graph with rich sentiment representation. Then we obtain multi-view features including semantics, syntactic, and sentiment features through GAT based on the enhanced graph by external knowledge. We also design a new strategy for fusing multi-view features using the feature parallel frame and convolution method. Eventually, the sentiment polarity of a specific aspect is determined based on the completely fused multi-view features. Experimental results on four public benchmark datasets demonstrate that our method is effective and sound. And it performs superiorly to existing approaches in fusion multiple-view features.References
Bastings, J., Titov, I., Aziz, W., Marcheggiani, D., Sima'an, K. (2017). Graph convolutional encoders for syntax-aware neural machine translation, in: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 1957-1967, 2017.
https://doi.org/10.18653/v1/D17-1209
Cambria, E., Poria, S., Hazarika, D., Kwok, K. (2018). Senticnet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings, in: Proceedings of the AAAI conference on artificial intelligence, 2018.
https://doi.org/10.1609/aaai.v32i1.11559
Chen, C., Teng, Z., Zhang, Y. (2020). Inducing target-specific latent structures for aspect sentiment classification, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 5596-5607, 2020.
https://doi.org/10.18653/v1/2020.emnlp-main.451
Chen, G., Tian, Y., Song, Y. (2020). Joint aspect extraction and sentiment analysis with directional graph convolutional networks, in: Proceedings of the 28th international conference on computational linguistics, pp. 272-279, 2020.
https://doi.org/10.18653/v1/2020.coling-main.24
Devlin, J., Chang, M.W., Lee, K., Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018 .
Ding, X., Liu, B., Yu, P.S. (2008). A holistic lexicon-based approach to opinion mining, in: Proceedings of the 2008 international conference on web search and data mining, pp. 231-240, 2008.
https://doi.org/10.1145/1341531.1341561
Dragoni, M., Poria, S., Cambria, E. (2018). Ontosenticnet: A commonsense ontology for sentiment analysis. IEEE Intelligent Systems 33, 77-85, 2018.
https://doi.org/10.1109/MIS.2018.033001419
Fan, F., Feng, Y., Zhao, D. (2018). Multi-grained attention network for aspect-level sentiment classification, in: Proceedings of the 2018 conference on empirical methods in natural language processing, pp. 3433-3442, 2018.
https://doi.org/10.18653/v1/D18-1380
Guo, F., He, R., Dang, J., Wang, J. (2020). Working memory-driven neural networks with a novel knowledge enhancement paradigm for implicit discourse relation recognition, in: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 7822-7829, 2020.
https://doi.org/10.1609/aaai.v34i05.6287
Huang, L., Sun, X., Li, S., Zhang, L., Wang, H. (2020). Syntax-aware graph attention network for aspect-level sentiment classification, in: Proceedings of the 28th international conference on computational linguistics, pp. 799-810, 2020.
https://doi.org/10.18653/v1/2020.coling-main.69
Huo, Y., Jiang, D., Sahli, H. (2021). Aspect-based sentiment analysis with weighted relational graph attention network, in: Companion Publication of the 2021 International Conference on Multimodal Interaction, pp. 63-70, 2021.
https://doi.org/10.1145/3461615.3491104
Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T. (2011). Target-dependent twitter sentiment classification, in: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pp. 151-160, 2011.
Kim, E.J., (2022). Applying social computing to analyze the effect of negative emotions on social desirability. Journal of Logistics, Informatics and Service Science 9, 234-257, 2022.
Kipf, T.N., Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
Li, X., Bing, L., Lam, W., Shi, B. (2018). Transformation networks for target-oriented sentiment classification. arXiv preprint arXiv:1805.01086, 2018.
https://doi.org/10.18653/v1/P18-1087
Liang, B., Su, H., Gui, L., Cambria, E., Xu, R. (2022). Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks. Knowledge-Based Systems 235, 107643, 2022.
https://doi.org/10.1016/j.knosys.2021.107643
Ma, Y., Peng, H., Cambria, E. (2018). Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive lstm, in: Proceedings of the AAAI conference on artificial intelligence, 2018.
https://doi.org/10.1609/aaai.v32i1.12048
Manandhar, S. (2014). Semeval-2014 task 4: Aspect based sentiment analysis, in: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), 2014.
Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., De Clercq, O., et al. (2016). Semeval-2016 task 5: Aspect based sentiment analysis, in: International workshop on semantic evaluation, pp. 19-30, 2016.
https://doi.org/10.18653/v1/S16-1002
Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I. (2015). Semeval- 2015 task 12: Aspect based sentiment analysis, in: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp. 486-495, 2015.
https://doi.org/10.18653/v1/S15-2082
Poria, S., Chaturvedi, I., Cambria, E., Bisio, F. (2016). Sentic lda: Improving on lda with semantic similarity for aspect-based sentiment analysis, in: 2016 international joint conference on neural networks (IJCNN), IEEE. pp. 4465-4473, 2016.
https://doi.org/10.1109/IJCNN.2016.7727784
Song, Y., Wang, J., Jiang, T., Liu, Z., Rao, Y. (2019). Attentional encoder network for targeted sentiment classification. arXiv preprint arXiv:1902.09314, 2019.
Song, Y., (2021). Construction of event knowledge graph based on semantic analysis. Tehnički vjesnik 28, 1640-1646, 2021.
https://doi.org/10.17559/TV-20210427063132
Srinivasan, S.M., Shah, P., Surendra, S.S., (2021). An approach to enhance business intelligence and operations by sentimental analysis. Journal of System and Management Sciences 11, 27-40.
Tian, Y., Chen, G., Song, Y. (2021). Enhancing aspect-level sentiment analysis with word dependencies, in: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pp. 3726-3739, 2021.
https://doi.org/10.18653/v1/2021.eacl-main.326
TRUŞCĂ, M.M., Aldea, A., GRĂDINARU, S.E., ALBU, C., (2021). Post-processing and dimensionality reduction for extreme learning machine in text classification. Economic Computation & Economic Cybernetics Studies & Research 55, 2021.
https://doi.org/10.24818/18423264/55.4.21.03
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems 30, 2017.
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y. (2018). Graph Attention Networks. International Conference on Learning Representations, 2018.
Vo, D.T., Zhang, Y. (2015). Target-dependent twitter sentiment classification with rich automatic features, in: Twenty-fourth international joint conference on artificial intelligence, 2015.
Wang, Y., Huang, M., Zhu, X., Zhao, L. (2016). Attention-based lstm for aspect-level sentiment classification, in: Proceedings of the 2016 conference on empirical methods in natural language processing, pp. 606-615, 2016.
https://doi.org/10.18653/v1/D16-1058
Xiao, L., Hu, X., Chen, Y., Xue, Y., Gu, D., Chen, B., Zhang, T. (2020). Targeted sentiment classification based on attentional encoding and graph convolutional networks. Applied Sciences 10, 957, 2020.
https://doi.org/10.3390/app10030957
Xiao, Z., Wu, J., Chen, Q., Deng, C. (2021). Bert4gcn: Using bert intermediate layers to augment gcn for aspect-based sentiment classification. arXiv preprint arXiv:2110.00171, 2021.
https://doi.org/10.18653/v1/2021.emnlp-main.724
Xing, F.Z., Pallucchini, F., Cambria, E. (2019). Cognitive-inspired domain adaptation of sentiment lexicons. Information Processing & Management 56, 554-564, 2019.
https://doi.org/10.1016/j.ipm.2018.11.002
Xu, P., Patwary, M., Shoeybi, M., Puri, R., Fung, P., Anandkumar, A., Catanzaro, B. (2020). Megatron-cntrl: Controllable story generation with external knowledge using large-scale language models, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 2831-2845, 2020.
https://doi.org/10.18653/v1/2020.emnlp-main.226
Yadav, R.K., Jiao, L., Goodwin, M., Granmo, O.C. (2021). Positionless aspect based sentiment analysis using attention mechanism. Knowledge-Based Systems 226, 107136, 2021.
https://doi.org/10.1016/j.knosys.2021.107136
Zeng, F., Yang, B., Zhao, M., Xing, Y., Ma, Y., (2022). Masanet: Multi-angle self-attention network for semantic segmentation of remote sensing images. Tehnički vjesnik 29, 1567-1575, 2022.
https://doi.org/10.17559/TV-20220421142959
Zhang, C., Li, Q., Song, D. (2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. arXiv preprint arXiv:1909.03477, 2019.
https://doi.org/10.18653/v1/D19-1464
Zhang, M., Qian, T. (2020). Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis, in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3540-3549, 2020.
https://doi.org/10.18653/v1/2020.emnlp-main.286
Zhou, J., Huang, J.X., Hu, Q.V., He, L. (2020). Sk-gcn: Modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Systems 205, 106292, 2020.
Additional Files
Published
Issue
Section
License
Copyright (c) 2023 bin yang, Haoling Li, Ying Xing
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
