Please wait a minute...
Data Analysis and Knowledge Discovery
Current Issue | Archive | Adv Search |
Information Augmentation based improved model for intent detection and slot tagging in few shot learning
Xiang Zhuoyuan,Chen Hao,Wang Qian,Li Na
(Faculty of Information and Safety Engineering, Zhongnan University of Economics and Law, Wuhan,430073,China)   (Hubei Tobacco Company ,Huangshi City Company, Huangshi,435000, China)
Download:
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective]Intent detection and slot tagging are two subtasks of dialog language understanding. How to apply conversational language understanding tasks to dialogue systems with frequent domain updates without sufficient labeled data to support model learning is the focus of this paper. [Methods] This paper proposes an Information Augmentation Model for Few-shot spoken Language Understanding (IAM-FSLU). It uses few-shot learning to solve the problems of different types and quantities of intents in new fields and across domains, lack of data and poor model applicability, and constructs a more effective explicit relationship between the two tasks of few-shot intent recognition and few-shot slot extraction. [Results] Compared with non-union modeling models, under the 1-shot setting, the F1 score of slot extraction is improved by nearly 30%, and the sentence accuracy rate is improved by nearly 10%. Under the 3-shot setting, the F1 score of slot extraction is improved by nearly 35%, and the sentence accuracy rate is improved by nearly 13 to 16%.

[Limitations] From the results, the IAM-FSLU model still needs further improvement in the intention recognition subtask, and compared with the implicit relationship modeling model, although there is a great improvement in the slot extraction task, the sentence accuracy improvement effect is limited, and there is still a large room for improvement.[Conclusions] In this paper, the effect of the IAM-FSLU model is verified by the comparative experiments of different few shot settings, and the results show that the overall effect of the IAM-FSLU model is better than that of other mainstream models.

Key words deep learning      dialogue system      intention detection      dialog language understanding      joint modeling      
Published: 17 March 2023
ZTFLH:  TP391.1  

Cite this article:

Xiang Zhuoyuan, Chen Hao, Wang Qian, Li Na. Information Augmentation based improved model for intent detection and slot tagging in few shot learning . Data Analysis and Knowledge Discovery, 0, (): 1-.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2022-0825     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y0/V/I/1

[1] Zhang Zhijian, Xia Sudi, Liu Zhenghao. Seal Recognition and Application Based on Multi-feature Fusion Deep Learning[J]. 数据分析与知识发现, 2024, 8(3): 143-155.
[2] Zhang Xiongtao, Zhu Na, Guo Yuhui. A Survey on Session-Based Recommendation Methods with Graph Neural Network[J]. 数据分析与知识发现, 2024, 8(2): 1-16.
[3] Li Hui, Hu Yaohua, Xu Cunzhen. Personalized Recommendation Algorithm with Review Sentiments and Importance[J]. 数据分析与知识发现, 2024, 8(1): 69-79.
[4] Xiang Zhuoyuan, Chen Hao, Wang Qian, Li Na. Few-Shot Language Understanding Model for Task-Oriented Dialogues[J]. 数据分析与知识发现, 2023, 7(9): 64-77.
[5] Nie Hui, Cai Ruisheng. Online Doctor Recommendation System with Attention Mechanism[J]. 数据分析与知识发现, 2023, 7(8): 138-148.
[6] Li Guangjian, Yuan Yue. Review of Knowledge Elements Extraction in Scientific Literature Based on Deep Learning[J]. 数据分析与知识发现, 2023, 7(7): 1-17.
[7] Wu Jialun, Zhang Ruonan, Kang Wulin, Yuan Puwei. Deep Learning Model of Drug Recommendation Based on Patient Similarity Analysis[J]. 数据分析与知识发现, 2023, 7(6): 148-160.
[8] Wang Xiaofeng, Sun Yujie, Wang Huazhen, Zhang Hengzhang. Construction and Verification of Type-Controllable Question Generation Model Based on Deep Learning and Knowledge Graphs[J]. 数据分析与知识发现, 2023, 7(6): 26-37.
[9] Wang Nan, Wang Qi. Evaluating Student Engagement with Deep Learning[J]. 数据分析与知识发现, 2023, 7(6): 123-133.
[10] Liu Yang, Zhang Wen, Hu Yi, Mao Jin, Huang Fei. Hotel Stock Prediction Based on Multimodal Deep Learning[J]. 数据分析与知识发现, 2023, 7(5): 21-32.
[11] Huang Xuejian, Ma Tinghuai, Wang Gensheng. Detecting Weibo Rumors Based on Hierarchical Semantic Feature Learning Model[J]. 数据分析与知识发现, 2023, 7(5): 81-91.
[12] Wang Yinqiu, Yu Wei, Chen Junpeng. Automatic Question-Answering in Chinese Medical Q & A Community with Knowledge Graph[J]. 数据分析与知识发现, 2023, 7(3): 97-109.
[13] Zhang Zhengang, Yu Chuanming. Knowledge Graph Completion Model Based on Entity and Relation Fusion[J]. 数据分析与知识发现, 2023, 7(2): 15-25.
[14] Shen Lining, Yang Jiayi, Pei Jiaxuan, Cao Guang, Chen Gongzheng. A Fine-Grained Sentiment Recognition Method Based on OCC Model and Triggering Events[J]. 数据分析与知识发现, 2023, 7(2): 72-85.
[15] Cao Wei, Liao Chenyue, Zhang Fuwei. RMB Exchange Rate Forecasting Driven by Cross-Market and Cross-Source Sentiment Analysis[J]. 数据分析与知识发现, 2023, 7(12): 75-87.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn