Online Doctor Recommendation System with Attention Mechanism
Nie Hui1(),Cai Ruisheng2
1School of Information Management, Sun Yat-Sen University, Guangzhou 510006, China 2The Seventh Affiliated Hospital, Sun Yat-Sen University, Shenzhen 518107, China
[Objective] This paper utilizes deep learning to recommend medical services for patients, which helps them choose doctors during online diagnosis and treatment. [Methods] First, we used the Hierarchical Attention Network and patient consultation records to construct doctor-patient models. Then, we designed doctor recommendation schemes based on the “doctor-patient” compatibility and patient “rating”. Both schemes incorporated the HAN deep learning framework to build doctor-patient models and used attention mechanisms to enhance the interaction of “doctor-patient”. Patients with similar conditions to those inquiring about treatments receive higher weights, which helped us calculate the doctor’s recommendation score. [Results] The HAN model could extract the critical information representing the patient’s condition from their disease descriptions. The recommendation hit rate was improved by 16.45% compared to the classical Word2Vec model by improving the modeling quality. For the recommendation score, the “rating” scheme based on the attention mechanism achieved the highest hit rate (79.7%), which is significantly outperforming the cosine similarity-based scheme (74.9%). [Limitations] This study only utilized historical patient consultation data under each doctor’s name to model the doctors, and the model did not include information such as the doctor’s reputation, credentials, and expertise. [Conclusions] Constructing user and recommendation objects is crucial in designing recommendation systems. Enhancing feature interaction between the users and recommendation objectives can improve recommendation quality. This study validates the advantages of deep learning modeling techniques in recommendation tasks.
聂卉, 蔡瑞昇. 引入注意力机制的在线问诊推荐研究*[J]. 数据分析与知识发现, 2023, 7(8): 138-148.
Nie Hui, Cai Ruisheng. Online Doctor Recommendation System with Attention Mechanism. Data Analysis and Knowledge Discovery, 2023, 7(8): 138-148.
(General Office of National Health Commission. Notice and Interpretation of the General Office of the National Health Commission on the Work of Internet Consultation Services in the Prevention and Control of Epidemics[EB/OL]. [2022-06-02]. https://baijiahao.baidu.com/s?id=1657958526525905506&wfr=spider&for=pc.)
(Wu Jiang, Hou Shaoxin, Jin Mengmeng, et al. LDA Feature Selection Based Text Classification and User Clustering in Chinese Online Health Community[J]. Journal of the China Society for Scientific and Technical Information, 2017, 36(11): 1183-1191.)
(Liu Tong. An Application Research of Automatic Physician Matching Algorithm Based on Online Healthcare Consultation Records[J]. Information Studies: Theory & Application, 2018, 41(6): 143-148,123.)
doi: 10.16353/j.cnki.1000-7490.2018.06.024
(Xiong Huixiang, Li Xiaomin, Li Jianling. Research on Online Doctor Recommendation Based on Doctor-patient Interaction Data[J]. Information Studies: Theory & Application, 2020, 43(8):159-166.)
[7]
Yan Y, Yu G, Yan X. Online Doctor Recommendation with Convolutional Neural Network and Sparse Inputs[J]. Computational Intelligence and Neuroscience, 2020. DOI:10.1155/2020/8826557.
[8]
Yuan H, Deng W. Doctor Recommendation on Healthcare Consultation Platforms: An Integrated Framework of Knowledge Graph and Deep Learning[J]. Internet Research, 2022, 32(2): 454-476.
doi: 10.1108/INTR-07-2020-0379
[9]
Koren Y, Bell R, Volinsky C. Matrix Factorization Techniques for Recommender Systems[J]. Computer, 2009, 42(8): 30-37.
[10]
Shan Y, Hoens T R, Jiao J, et al. Deep Crossing: Web-scale Modeling Without Manually Crafted Combinatorial Features[C]// Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016: 255-262.
[11]
Cheng H T, Koc L, Harmsen J, et al. Wide & Deep Learning for Recommender Systems[C]// Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 2016: 7-10.
[12]
He X, Liao L, Zhang H, et al. Neural Collaborative Filtering[C]// Proceedings of the 26th International Conference on World Wide Web. 2017: 173-182.
[13]
Vaswani A, Shazeer N, Parmar N, et al. Attention is All You Need[C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017:6000-6010.
[14]
Xiao J, Ye H, He X, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks [OL]. arXiv Preprint, arXiv:1708.04617.
[15]
Zhou G, Zhu X, Song C, et al. Deep Interest Network for Click-through Rate Prediction[C]// Proceedings of the 24th ACM International Conference on Knowledge Discovery & Data Mining. 2018:1059-1068.
[16]
Zhou G, Mou N, Fan Y, et al. Deep Interest Evolution Network for Click-through Rate Prediction[C]// Proceedings of the AAAI Conference on Artificial Intelligence. 2019:5941-5948.
[17]
Yang Z, Yang D, Dyer C, et al. Hierarchical Attention Networks for Document Classification[C]// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. 2016: 1480-1489.
[18]
Mikolov T, Sutskever I, Chen K, et al. Distributed Representations of Words and Phrases and Their Compositionality[C]// Proceedings of the 26th International Conference on Neural Information Processing System. 2013: 3111-3119.
