Sentiment Analysis with Abstract Meaning Representation and Dependency Grammar
Li Xuelian1,Wang Bi2(),Li Lixin3,Han Dixuan4
1School of Foreign Studies, Nanjing University of Posts and Telecommunications, Nanjing 210023, China 2School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou 341000, China 3School of Computer Science and Engineering, Southeast University, Nanjing 210096, China 4School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta 30318, United States
[Objective] This paper aims to combine the deep semantic representation and surface syntactic structure of natural language sentences. [Methods] We proposed an integration strategy based on semantic and syntactic rule concatenation and utilized it for the aspect-based sentiment analysis. This strategy used the answer set programming language (ASP) to represent abstract meaning representation (AMR), dependency grammar (DEP), and part of speech (POS) as ASP facts. It also integrated the DEP and POS through rule body extension based on AMR rules. Therefore, a sentence’s two or more language features were concatenated into the rule body. Based on this strategy, we developed the AMR-DEP-POS-C and AMR-DEP-C models. [Results] We examined the new methods on eight publicly available review datasets. The AMR-DEP-POS-C achieved a complementary relationship between semantics and syntax and performed better than the baseline methods based on semantic, syntactic, and deep learning. [Limitations] Our new models rely on the accuracy of the existing AMR and DEP parsers. [Conclusions] AMR-DEP-POS-C can effectively integrate different language features and bring new research perspectives and tools for aspect-based sentiment analysis.
李雪莲, 王碧, 李立鑫, 韩迪轩. 融合抽象语义表示和依存语法的方面级情感分析*[J]. 数据分析与知识发现, 2024, 8(1): 55-68.
Li Xuelian, Wang Bi, Li Lixin, Han Dixuan. Sentiment Analysis with Abstract Meaning Representation and Dependency Grammar. Data Analysis and Knowledge Discovery, 2024, 8(1): 55-68.
(Zhong Jiawa, Liu Wei, Wang Sili, et al. Review of Methods and Applications of Text Sentiment Analysis[J]. Data Analysis and Knowledge Discovery, 2021, 5(6): 1-13.)
(Shang Rongxuan, Zhang Bin, Mi Jianing. End-to-End Aspect-Level Sentiment Analysis for E-Government Applications Based on BRNN[J]. Data Analysis and Knowledge Discovery, 2022, 6(2/3): 364-375.)
[5]
Rastegar-Mojarad M, Elayavilli R K, Wang Y S, et al. Semantic Information Retrieval: Exploring Dependency and Word Embedding Features in Biomedical Information Retrieval[C]// Proceedings of the 2017 BioCreative VI Challenge Evaluation Workshop. 2017: 74-77.
[6]
Wang Y S, Liu S J, Rastegar-Mojarad M, et al. Dependency and AMR Embeddings for Drug-Drug Interaction Extraction from Biomedical Literature[C]// Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. ACM, 2017: 36-43.
[7]
Marcheggiani D, Bastings J, Titov I. Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks[C]// Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. 2018: 486-492.
[8]
Gebser M, Kaminski R, Kaufmann B, et al. Answer Set Solving in Practice[M]. Cham: Springer, 2012.
[9]
Son T C, Baral C, Tran N, et al. Domain-Dependent Knowledge in Answer Set Planning[J]. ACM Transactions on Computational Logic, 2002, 7(4): 613-657.
doi: 10.1145/1183278.1183279
[10]
Baral C. Knowledge Representation, Reasoning, and Declarative Problem Solving[M]. Cambridge: Cambridge University Press, 2003.
[11]
van der Hallen M, Paramonov S, Janssens G, et al. Knowledge Representation Analysis of Graph Mining[J]. Annals of Mathematics and Artificial Intelligence, 2019, 86(1): 21-60.
doi: 10.1007/s10472-019-09624-y
[12]
Falkner A, Friedrich G, Schekotihin K, et al. Industrial Applications of Answer Set Programming[J]. KI - Künstliche Intelligenz, 2018, 32(2): 165-176.
doi: 10.1007/s13218-018-0548-6
[13]
Wang Y, Lee J, Kim D S. A Logic Based Approach to Answering Questions About Alternatives in DIY Domains[C]// Proceedings of the 31st AAAI Conference on Artificial Intelligence. ACM, 2017: 4753-4758.
[14]
Piovesan L, Terenziani P, Theseider Dupré D. Conformance Analysis for Comorbid Patients in Answer Set Programming[J]. Journal of Biomedical Informatics, 2020, 103: Article No.103377.
[15]
Gebser M, Kaufmann B, Schaub T. Conflict-Driven Answer Set Solving: From Theory to Practice[J]. Artificial Intelligence, 2012, 187-188: 52-89.
[16]
Faber W, Pfeifer G, Leone N, et al. Design and Implementation of Aggregate Functions in the DLV System[J]. Theory and Practice of Logic Programming, 2008, 8(5-6): 545-580.
doi: 10.1017/S1471068408003323
[17]
Simons P, Niemelä I, Soininen T. Extending and Implementing the Stable Model Semantics[J]. Artificial Intelligence, 2002, 138(1-2): 181-234.
doi: 10.1016/S0004-3702(02)00187-X
[18]
Liu B. Sentiment Analysis and Opinion Mining[M]. Cham: Springer, 2012.
[19]
Qiu G, Liu B, Bu J J, et al. Opinion Word Expansion and Target Extraction Through Double Propagation[J]. Computational Linguistics, 2011, 37(1): 9-27.
doi: 10.1162/coli_a_00034
[20]
Liu Q, Gao Z Q, Liu B, et al. A Logic Programming Approach to Aspect Extraction in Opinion Mining[C]// Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technologies. IEEE, 2013: 276-283.
[21]
Liu Q, Gao Z Q, Liu B, et al. Automated Rule Selection for Aspect Extraction in Opinion Mining[C]// Proceedings of the 24th International Conference on Artificial Intelligence. ACM, 2015: 1291-1297.
[22]
Liu Q, Liu B, Zhang Y L, et al. Improving Opinion Aspect Extraction Using Semantic Similarity and Aspect Associations[C]// Proceedings of the 30th AAAI Conference on Artificial Intelligence. ACM, 2016: 2986-2992.
Wang Tiekun. Language Planning Based on the Conception of Language Resources—An Exemplification of “Monitoring Study of Language Resources” and “Construction of the Corpus of Vocal Data of Chinese Language Resources”[J]. Journal of Shaanxi Normal University (Philosophy and Social Sciences Edition), 2010, 39(6): 58-66.)
[24]
王世凯. 语言资源与语言研究[M]. 上海: 学林出版社, 2009.
[24]
(Wang Shikai. Language Resources and Language Studies[M]. Shanghai: Academia Press, 2009.)
[25]
Liu Q, Gao Z Q, Liu B, et al. Automated Rule Selection for Opinion Target Extraction[J]. Knowledge-Based Systems, 2016, 104: 74-88.
doi: 10.1016/j.knosys.2016.04.010
[26]
Zhang S, Jia W J, Xia Y J, et al. Opinion Analysis of Product Reviews[C]// Proceedings of the 6th International Conference on Fuzzy Systems and Knowledge Discovery. IEEE, 2009: 591-595.
[27]
Jin W, Ho H H. A Novel Lexicalized HMM-Based Learning Framework for Web Opinion Mining[C]// Proceedings of the 26th Annual International Conference on Machine Learning. ACM, 2009: 465-472.
[28]
Yu J X, Zha Z J, Wang M, et al. Aspect Ranking: Identifying Important Product Aspects from Online Consumer Reviews[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies. ACM, 2011: 1496-1505.
[29]
Ma D H, Li S J, Wu F Z, et al. Exploring Sequence-to-Sequence Learning in Aspect Term Extraction[C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019: 3538-3547.
[30]
Wu C H, Wu F Z, Wu S X, et al. A Hybrid Unsupervised Method for Aspect Term and Opinion Target Extraction[J]. Knowledge-Based Systems, 2018, 148: 66-73.
doi: 10.1016/j.knosys.2018.01.019
[31]
Hu M Q, Liu B. Mining and Summarizing Customer Reviews[C]// Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2004: 168-177.
[32]
Zhuang L, Jing F, Zhu X Y. Movie Review Mining and Summarization[C]// Proceedings of the 15th ACM International Conference on Information and Knowledge Management. ACM, 2006: 43-50.
[33]
Wang B, Wang H F. Bootstrapping Both Product Features and Opinion Words from Chinese Customer Reviews with Cross-Inducing[C]// Proceedings of the 3rd International Joint Conference on Natural Language Processing. 2008: 289-295.
[34]
Wu Y B, Zhang Q, Huang X J, et al. Phrase Dependency Parsing for Opinion Mining[C]// Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACM, 2009: 1533-1541.
[35]
Zhang L, Liu B, Lim S H, et al. Extracting and Ranking Product Features in Opinion Documents[C]//Proceedings of the 23rd International Conference on Computational Linguistics:Posters. ACM, 2010: 1462-1470.
[36]
Zhao Y Y, Qin B, Hu S, et al. Generalizing Syntactic Structures for Product Attribute Candidate Extraction[C]// Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. ACM, 2010: 377-380.
[37]
Wang W Y, Pan S J, Dahlmeier D, et al. Recursive Neural Conditional Random Fields for Aspect-Based Sentiment Analysis[C]// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 2016: 616-626.
[38]
Yin Y C, Wei F R, Dong L, et al. Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction[C]// Proceedings of the 25th International Joint Conference on Artificial Intelligence. ACM, 2016: 2979-2985.
[39]
Ye H, Yan Z C, Luo Z C, et al. Dependency-Tree Based Convolutional Neural Networks for Aspect Term Extraction[C]// Proceedings of the 2017 Pacific-Asia Conference on Knowledge Discovery and Data Mining. Cham: Springer, 2017: 350-362.
[40]
Wang W Y, Pan S J, Dahlmeier D. Memory Networks for Fine-Grained Opinion Mining[J]. Artificial Intelligence, 2018, 265: 1-17.
doi: 10.1016/j.artint.2018.09.002
[41]
Xu H, Liu B, Shu L, et al. Double Embeddings and CNN-Based Sequence Labeling for Aspect Extraction[C]// Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. 2018: 592-598.
[42]
Li X, Bing L D, Li P J, et al. A Unified Model for Opinion Target Extraction and Target Sentiment Prediction[C]// Proceedings of the 33rd Conference on Artificial Intelligence and 31st Innovative Applications of Artificial Intelligence Conference and 9th AAAI Symposium on Educational Advances in Artificial Intelligence. 2019: 6714-6721.
[43]
Do H H, Prasad P, Maag A, et al. Deep Learning for Aspect-Based Sentiment Analysis: A Comparative Review[J]. Expert Systems with Applications, 2019, 118: 272-299.
doi: 10.1016/j.eswa.2018.10.003
[44]
Liao C, Feng C, Yang S, et al. A Hybrid Method of Domain Lexicon Construction for Opinion Targets Extraction Using Syntax and Semantics[J]. Journal of Computer Science and Technology, 2016, 31(3): 595-603.
doi: 10.1007/s11390-016-1649-z
[45]
Kabir M, Everardo F O, Shukla A K, et al. ApproxASP—A Scalable Approximate Answer Set Counter[C]// Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022: 5755-5764.
[46]
Obermeier P. Scalable Robotic Intra-Logistics with Answer Set Programming[C]// Proceedings of the 34th International Conference on Logic Programming. 2018(24): 5-9.
[47]
Jakob N, Gurevych I. Extracting Opinion Targets in a Single- and Cross-Domain Setting with Conditional Random Fields[C]// Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. ACM, 2010: 1035-1045.