Research on Gesar event detection method based on attention mechanism
Conference: CAIBDA 2022 - 2nd International Conference on Artificial Intelligence, Big Data and Algorithms
06/17/2022 - 06/19/2022 at Nanjing, China
Proceedings: CAIBDA 2022
Pages: 4Language: englishTyp: PDF
Authors:
Lu, Ziling; Wang, Hongyang (Research Institute of China National Information Technology, Northwest Minzu University, Lanzhou, China)
Wang, Tiejun; Guo, Xiaoran (School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, China)
Abstract:
In the process of constructing the event graph of Gesar domain, it is necessary to classify the event text of Gesar domain. However, experiments have found that the traditional models of convolution neural network (CNN) and long short-term memory network (LSTM) have weak generalization ability and insufficient semantic feature extraction ability on the text of Gesar events. Therefore, Albert-ARNN model is proposed. The model first uses Albert pre-training language model to obtain the global semantic information of the text, and then uses the BiLSTM model with attention mechanism to obtain the contextual feature representation of the text. The experimental results show that on the Gesar domain text dataset, the F1 value reaches 94.21%, which is 0.81% higher than that of Albert model. Compared with Albert-BiLSTM model, the F1 value is improved by 0.78%.