Please wait a minute...
Data Analysis and Knowledge Discovery
Current Issue | Archive | Adv Search |
Information Augmentation based improved model for intent detection and slot tagging in few shot learning
Xiang Zhuoyuan,Chen Hao,Wang Qian,Li Na
(Faculty of Information and Safety Engineering, Zhongnan University of Economics and Law, Wuhan,430073,China)   (Hubei Tobacco Company ,Huangshi City Company, Huangshi,435000, China)
Download:
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective]Intent detection and slot tagging are two subtasks of dialog language understanding. How to apply conversational language understanding tasks to dialogue systems with frequent domain updates without sufficient labeled data to support model learning is the focus of this paper. [Methods] This paper proposes an Information Augmentation Model for Few-shot spoken Language Understanding (IAM-FSLU). It uses few-shot learning to solve the problems of different types and quantities of intents in new fields and across domains, lack of data and poor model applicability, and constructs a more effective explicit relationship between the two tasks of few-shot intent recognition and few-shot slot extraction. [Results] Compared with non-union modeling models, under the 1-shot setting, the F1 score of slot extraction is improved by nearly 30%, and the sentence accuracy rate is improved by nearly 10%. Under the 3-shot setting, the F1 score of slot extraction is improved by nearly 35%, and the sentence accuracy rate is improved by nearly 13 to 16%.

[Limitations] From the results, the IAM-FSLU model still needs further improvement in the intention recognition subtask, and compared with the implicit relationship modeling model, although there is a great improvement in the slot extraction task, the sentence accuracy improvement effect is limited, and there is still a large room for improvement.[Conclusions] In this paper, the effect of the IAM-FSLU model is verified by the comparative experiments of different few shot settings, and the results show that the overall effect of the IAM-FSLU model is better than that of other mainstream models.

Key words deep learning      dialogue system      intention detection      dialog language understanding      joint modeling      
Published: 17 March 2023
ZTFLH:  TP391.1  

Cite this article:

Xiang Zhuoyuan, Chen Hao, Wang Qian, Li Na. Information Augmentation based improved model for intent detection and slot tagging in few shot learning . Data Analysis and Knowledge Discovery, 0, (): 1-.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2022-0825     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y0/V/I/1

[1] Wang Weijun, Ning Zhiyuan, Du Yi, Zhou Yuanchun. Identifying Interdisciplinary Sci-Tech Literature Based on Multi-Label Classification[J]. 数据分析与知识发现, 2023, 7(1): 102-112.
[2] Xiao Yuhan, Lin Huiping. Mining Differentiated Demands with Aspect Word Extraction: Case Study of Smartphone Reviews[J]. 数据分析与知识发现, 2023, 7(1): 63-75.
[3] Cheng Quan, She Dexin. Drug Recommendation Based on Graph Neural Network with Patient Signs and Medication Data[J]. 数据分析与知识发现, 2022, 6(9): 113-124.
[4] Wang Lu, Le Xiaoqiu. Research Progress on Citation Analysis of Scientific Papers[J]. 数据分析与知识发现, 2022, 6(4): 1-15.
[5] Zheng Xiao, Li Shuqing, Zhang Zhiwang. Measuring User Item Quality with Rating Analysis for Deep Recommendation Model[J]. 数据分析与知识发现, 2022, 6(4): 39-48.
[6] Yu Chuanming, Lin Hongjun, Zhang Zhengang. Joint Extraction Model for Entities and Events with Multi-task Deep Learning[J]. 数据分析与知识发现, 2022, 6(2/3): 117-128.
[7] Zhang Yunqiu, Li Bocheng, Chen Yan. Automatic Classification with Unbalanced Data for Electronic Medical Records[J]. 数据分析与知识发现, 2022, 6(2/3): 233-241.
[8] Zhang Fangcong, Qin Qiuli, Jiang Yong, Zhuang Runtao. Named Entity Recognition for Chinese EMR with RoBERTa-WWM-BiLSTM-CRF[J]. 数据分析与知识发现, 2022, 6(2/3): 251-262.
[9] Hu Yamin, Wu Xiaoyan, Chen Fang. Review of Technology Term Recognition Studies Based on Machine Learning[J]. 数据分析与知识发现, 2022, 6(2/3): 7-17.
[10] Liu Yang, Ma Lili, Zhang Wen, Hu Zhongyi, Wu Jiang. Detecting Sarcasm from Travel Reviews Based on Cross-Modal Deep Learning[J]. 数据分析与知识发现, 2022, 6(12): 23-31.
[11] Cao Lina,Zhang Jian,Chen Jindong,Fan Hui. Comprehensive Quality Profiling for Micro-, Small-, and Medium-sized Enterprises Based on Deep Learning[J]. 数据分析与知识发现, 2022, 6(11): 126-138.
[12] Li Zhi, Sun Rui, Yao Yuxuan, Li Xiaohuan. Recommending Point-of-Interests with Real-Time Event Detection[J]. 数据分析与知识发现, 2022, 6(10): 114-127.
[13] Huang Xuejian, Liu Yuyang, Ma Tinghuai. Classification Model for Scholarly Articles Based on Improved Graph Neural Network[J]. 数据分析与知识发现, 2022, 6(10): 93-102.
[14] Zhou Zeyu,Wang Hao,Zhao Zibo,Li Yueyan,Zhang Xiaoqin. Construction and Application of GCN Model for Text Classification with Associated Information[J]. 数据分析与知识发现, 2021, 5(9): 31-41.
[15] Xu Yuemei, Wang Zihou, Wu Zixin. Predicting Stock Trends with CNN-BiLSTM Based Multi-Feature Integration Model[J]. 数据分析与知识发现, 2021, 5(7): 126-138.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn