Please wait a minute...
Data Analysis and Knowledge Discovery  2023, Vol. 7 Issue (8): 138-148    DOI: 10.11925/infotech.2096-3467.2022.0761
Current Issue | Archive | Adv Search |
Online Doctor Recommendation System with Attention Mechanism
Nie Hui1(),Cai Ruisheng2
1School of Information Management, Sun Yat-Sen University, Guangzhou 510006, China
2The Seventh Affiliated Hospital, Sun Yat-Sen University, Shenzhen 518107, China
Download: PDF (1289 KB)   HTML ( 20
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper utilizes deep learning to recommend medical services for patients, which helps them choose doctors during online diagnosis and treatment. [Methods] First, we used the Hierarchical Attention Network and patient consultation records to construct doctor-patient models. Then, we designed doctor recommendation schemes based on the “doctor-patient” compatibility and patient “rating”. Both schemes incorporated the HAN deep learning framework to build doctor-patient models and used attention mechanisms to enhance the interaction of “doctor-patient”. Patients with similar conditions to those inquiring about treatments receive higher weights, which helped us calculate the doctor’s recommendation score. [Results] The HAN model could extract the critical information representing the patient’s condition from their disease descriptions. The recommendation hit rate was improved by 16.45% compared to the classical Word2Vec model by improving the modeling quality. For the recommendation score, the “rating” scheme based on the attention mechanism achieved the highest hit rate (79.7%), which is significantly outperforming the cosine similarity-based scheme (74.9%). [Limitations] This study only utilized historical patient consultation data under each doctor’s name to model the doctors, and the model did not include information such as the doctor’s reputation, credentials, and expertise. [Conclusions] Constructing user and recommendation objects is crucial in designing recommendation systems. Enhancing feature interaction between the users and recommendation objectives can improve recommendation quality. This study validates the advantages of deep learning modeling techniques in recommendation tasks.

Key wordsRecommendation System      Intelligent Healthcare      Deep Learning      Online Medical Consultation     
Received: 21 July 2022      Published: 08 October 2023
ZTFLH:  TP391  
Fund:2020 Guangzhou Science and Technology Planning Project(202002020036)
Corresponding Authors: Nie Hui,ORCID: 0000-0001-8567-3084,E-mail: issnh@mail.sysu.edu.cn。   

Cite this article:

Nie Hui, Cai Ruisheng. Online Doctor Recommendation System with Attention Mechanism. Data Analysis and Knowledge Discovery, 2023, 7(8): 138-148.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2022.0761     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2023/V7/I8/138

The Structure of HAN
疾病描述 医生姓名 所在医院 科室
1月23日咳嗽至2月3日,后不咳嗽,近三天如右侧图示(曲线为右侧肋骨边缘,圆圈为痛处) 初期咳嗽的时候吃过 乙酰螺旋霉素,无不良反应。 昨天服用 盐酸丙卡特罗片 心跳明显加快。 周x丽 中山大学附属第三医院 呼吸与危重症医学科
医生你好,上个月(8月),我带我女儿去江西省儿童医院检查腺样体肥大,拍片子以后,医生说不要紧,我看那个医生年纪很小有点不放心,麻烦你帮我看看要紧吗?是否需要手术? 史x波 中山大学附属第一医院 耳鼻咽喉科
Examples of the corpus
Experiment Framework
实验 文本表示 推荐模型
组别 实验方案 词向量 句向量 医生建模 推荐计算
1 1.1 Word2Vec 词向量求均值 句向量求均值 余弦相似度
1.2 HAN
2 2.1 Word2Vec HAN 注意力权重求和 余弦相似度
2.2 评分方案
Experiment Design
Loss /Accuracy with Epoches on the Training and Validation Sets
实验方案 特征建模 MRR ACC SIM EXP
1.1 Word2Vec 0.287 0.584 1.267 443.059
1.2 HAN 0.423 0.749 2.053 448.494
The Evaluation of Different Text Representations
实验方案 推荐方法 MRR ACC EXP
1.2 余弦相似度 0.423 0.749 448.494
2.1 ATT+余弦相似度 0.405 0.739 599.872
2.2 ATT+评分方案 0.516 0.797 723.715
The Evaluation of Recommendation Schemes
The Screenshot from www.haodf.com
方案 推荐列表1号 推荐列表2号 推荐列表3号
1.1 柯超 中山大学附属肿瘤医院 神经外科 翁胤仑 中山大学孙逸仙纪念医院 神经外科 陈锡辉 中山大学附属第一医院 耳鼻咽喉科
1.2 陈锡辉 中山大学附属第一医院 耳鼻咽喉科 杨海弟 中山大学孙逸仙纪念医院 耳鼻喉科 熊观霞 中山大学附属第一医院 耳鼻咽喉科
2.1 党华 中山大学孙逸仙纪念医院 耳鼻喉科 樊韵平 中山大学附属第七医院 耳鼻咽喉头颈外科 吴旋 中山大学附属第一医院 耳鼻咽喉科
2.2 党华 中山大学孙逸仙纪念医院 耳鼻喉科 熊观霞 中山大学附属第一医院 耳鼻咽喉科 吴旋 中山大学附属第一医院 耳鼻咽喉科
The Recommendation for Case 1
方案 推荐列表1号 推荐列表2号 推荐列表3号
1.1 李洁 中山大学附属第六医院 生殖医学中心 李宇彬 中山大学附属第一医院 生殖医学中心 欧建平 中山大学附属第三医院 生殖医学中心
1.2 李宇彬 中山大学附属第一医院 生殖医学中心 李洁 中山大学附属第六医院 生殖医学中心 蔡柳洪 中山大学附属第三医院 生殖医学中心
2.1 李予 中山大学孙逸仙纪念医院 妇科生殖内分泌专科 欧建平 中山大学附属第三医院 生殖医学中心 林海燕 中山大学孙逸仙纪念医院 生殖医学中心
2.2 李宇彬 中山大学附属第一医院 生殖医学中心 蔡柳洪 中山大学附属第三医院 生殖医学中心 杨星 中山大学附属第六医院 生殖医学中心
The Recommendation for Case 2
方案 推荐列表1号 推荐列表2号 推荐列表3号
1.1 王涛 中山大学附属第三医院 耳鼻咽喉-头颈外科 韦民 中山大学附属第六医院 呼吸内科 王章锋 中山大学附属第一医院 耳鼻咽喉科
1.2 王涛 中山大学附属第三医院 耳鼻咽喉-头颈外科 张雪媛 中山大学孙逸仙纪念医院 耳鼻喉科 王章锋 中山大学附属第一医院 耳鼻咽喉科
2.1 樊韵平 中山大学附属第七医院 耳鼻咽喉头颈外科 王章锋 中山大学附属第一医院 耳鼻咽喉科 党华 中山大学孙逸仙纪念医院 耳鼻喉科
2.2 党华 中山大学孙逸仙纪念医院 耳鼻喉科 王涛 中山大学附属第三医院 耳鼻咽喉-头颈外科 樊韵平 中山大学附属第七医院 耳鼻咽喉头颈外科
The Recommendation for Case 3
[1] 国家卫生健康委员会. 国家卫生健康委办公厅关于在疫情防控中做好互联网诊疗咨询服务工作的通知及解读[EB/OL]. [2022-06-02]. https://baijiahao.baidu.com/s?id=1657958526525905506&wfr=spider&for=pc.
[1] (General Office of National Health Commission. Notice and Interpretation of the General Office of the National Health Commission on the Work of Internet Consultation Services in the Prevention and Control of Epidemics[EB/OL]. [2022-06-02]. https://baijiahao.baidu.com/s?id=1657958526525905506&wfr=spider&for=pc.)
[2] 吴江, 侯绍新, 靳萌萌, 等. 基于LDA模型特征选择的在线医疗社区文本分类及用户聚类研究[J]. 情报学报, 2017, 36(11): 1183-1191.
[2] (Wu Jiang, Hou Shaoxin, Jin Mengmeng, et al. LDA Feature Selection Based Text Classification and User Clustering in Chinese Online Health Community[J]. Journal of the China Society for Scientific and Technical Information, 2017, 36(11): 1183-1191.)
[3] 潘有能, 倪秀丽. 基于Labeled-LDA模型的在线医疗专家推荐研究[J]. 数据分析与知识发现, 2020, 4(4): 34-43.
[3] (Pan Younneg, Ni Xiuli. Recommending Online Medical Experts with Labeled-LDA Model[J]. Data Analysis and Knowledge Discovery, 2020, 4(4): 34-43.)
[4] 刘通. 基于在线咨询记录的医生自动匹配算法应用研究[J]. 情报理论与实践, 2018, 41(6): 143-148,123.
doi: 10.16353/j.cnki.1000-7490.2018.06.024
[4] (Liu Tong. An Application Research of Automatic Physician Matching Algorithm Based on Online Healthcare Consultation Records[J]. Information Studies: Theory & Application, 2018, 41(6): 143-148,123.)
doi: 10.16353/j.cnki.1000-7490.2018.06.024
[5] 孟秋晴, 熊回香. 基于在线问诊文本信息的医生推荐研究[J]. 情报科学, 2021, 39(6): 152-160.
[5] (Meng Qiuqing, Xiong Huixiang. Doctor Recommendation Based on Online Consultation Text Information[J]. Information Science, 2021, 39(6): 152-160.)
[6] 熊回香, 李晓敏, 李建玲. 基于医患交互数据的在线医生推荐研究[J]. 情报理论与实践, 2020, 43(8):159-166.
[6] (Xiong Huixiang, Li Xiaomin, Li Jianling. Research on Online Doctor Recommendation Based on Doctor-patient Interaction Data[J]. Information Studies: Theory & Application, 2020, 43(8):159-166.)
[7] Yan Y, Yu G, Yan X. Online Doctor Recommendation with Convolutional Neural Network and Sparse Inputs[J]. Computational Intelligence and Neuroscience, 2020. DOI:10.1155/2020/8826557.
[8] Yuan H, Deng W. Doctor Recommendation on Healthcare Consultation Platforms: An Integrated Framework of Knowledge Graph and Deep Learning[J]. Internet Research, 2022, 32(2): 454-476.
doi: 10.1108/INTR-07-2020-0379
[9] Koren Y, Bell R, Volinsky C. Matrix Factorization Techniques for Recommender Systems[J]. Computer, 2009, 42(8): 30-37.
[10] Shan Y, Hoens T R, Jiao J, et al. Deep Crossing: Web-scale Modeling Without Manually Crafted Combinatorial Features[C]// Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016: 255-262.
[11] Cheng H T, Koc L, Harmsen J, et al. Wide & Deep Learning for Recommender Systems[C]// Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 2016: 7-10.
[12] He X, Liao L, Zhang H, et al. Neural Collaborative Filtering[C]// Proceedings of the 26th International Conference on World Wide Web. 2017: 173-182.
[13] Vaswani A, Shazeer N, Parmar N, et al. Attention is All You Need[C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017:6000-6010.
[14] Xiao J, Ye H, He X, et al. Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks [OL]. arXiv Preprint, arXiv:1708.04617.
[15] Zhou G, Zhu X, Song C, et al. Deep Interest Network for Click-through Rate Prediction[C]// Proceedings of the 24th ACM International Conference on Knowledge Discovery & Data Mining. 2018:1059-1068.
[16] Zhou G, Mou N, Fan Y, et al. Deep Interest Evolution Network for Click-through Rate Prediction[C]// Proceedings of the AAAI Conference on Artificial Intelligence. 2019:5941-5948.
[17] Yang Z, Yang D, Dyer C, et al. Hierarchical Attention Networks for Document Classification[C]// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. 2016: 1480-1489.
[18] Mikolov T, Sutskever I, Chen K, et al. Distributed Representations of Words and Phrases and Their Compositionality[C]// Proceedings of the 26th International Conference on Neural Information Processing System. 2013: 3111-3119.
[1] Qian Cong, Qi Jianglei, Ding Hao. Online Publication Recommendation Based on Weighted Features of User Multiple Interest Drift[J]. 数据分析与知识发现, 2023, 7(8): 119-127.
[2] Li Guangjian, Yuan Yue. Review of Knowledge Elements Extraction in Scientific Literature Based on Deep Learning[J]. 数据分析与知识发现, 2023, 7(7): 1-17.
[3] Wang Nan, Wang Qi. Evaluating Student Engagement with Deep Learning[J]. 数据分析与知识发现, 2023, 7(6): 123-133.
[4] Wang Xiaofeng, Sun Yujie, Wang Huazhen, Zhang Hengzhang. Construction and Verification of Type-Controllable Question Generation Model Based on Deep Learning and Knowledge Graphs[J]. 数据分析与知识发现, 2023, 7(6): 26-37.
[5] Wu Jialun, Zhang Ruonan, Kang Wulin, Yuan Puwei. Deep Learning Model of Drug Recommendation Based on Patient Similarity Analysis[J]. 数据分析与知识发现, 2023, 7(6): 148-160.
[6] Ben Yanyan, Pang Xueqin. Identifying Medical Named Entities with Word Information[J]. 数据分析与知识发现, 2023, 7(5): 123-132.
[7] Liu Yang, Zhang Wen, Hu Yi, Mao Jin, Huang Fei. Hotel Stock Prediction Based on Multimodal Deep Learning[J]. 数据分析与知识发现, 2023, 7(5): 21-32.
[8] Huang Xuejian, Ma Tinghuai, Wang Gensheng. Detecting Weibo Rumors Based on Hierarchical Semantic Feature Learning Model[J]. 数据分析与知识发现, 2023, 7(5): 81-91.
[9] Wang Yinqiu, Yu Wei, Chen Junpeng. Automatic Question-Answering in Chinese Medical Q & A Community with Knowledge Graph[J]. 数据分析与知识发现, 2023, 7(3): 97-109.
[10] Zhang Zhengang, Yu Chuanming. Knowledge Graph Completion Model Based on Entity and Relation Fusion[J]. 数据分析与知识发现, 2023, 7(2): 15-25.
[11] Shen Lining, Yang Jiayi, Pei Jiaxuan, Cao Guang, Chen Gongzheng. A Fine-Grained Sentiment Recognition Method Based on OCC Model and Triggering Events[J]. 数据分析与知识发现, 2023, 7(2): 72-85.
[12] Wang Weijun, Ning Zhiyuan, Du Yi, Zhou Yuanchun. Identifying Interdisciplinary Sci-Tech Literature Based on Multi-Label Classification[J]. 数据分析与知识发现, 2023, 7(1): 102-112.
[13] Xiao Yuhan, Lin Huiping. Mining Differentiated Demands with Aspect Word Extraction: Case Study of Smartphone Reviews[J]. 数据分析与知识发现, 2023, 7(1): 63-75.
[14] Cheng Quan, She Dexin. Drug Recommendation Based on Graph Neural Network with Patient Signs and Medication Data[J]. 数据分析与知识发现, 2022, 6(9): 113-124.
[15] Wang Lu, Le Xiaoqiu. Research Progress on Citation Analysis of Scientific Papers[J]. 数据分析与知识发现, 2022, 6(4): 1-15.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn