[Objective] This paper designs and implements an unsupervised algorithm to evaluate the information accuracy of physicians’ feedbacks from online consulting service. [Methods] First, we identified word co-occurrence relationships based on large amount of online service records. Then, we built a statistical model to predict standard feedbacks for the given questions. Finally, we decided the accuracy of physicians’ answers by calculating content similarity between real feedbacks and the standard ones. [Results] We examined the proposed algorithm with records from Haodf.com as well as manually labeled results. The accuracy rates were 41.0% and 82.4% for rigorous and relax matching. [Limitations] We did not include the word sequence information in the algorithm. [Conclusions] The proposed algorithm could help patients know the accuracy of online medical information and improve their healthcare decisions makings.
刘通, 杨敬成. 基于信号传播算法的在线医疗咨询反馈内容评估方法*[J]. 数据分析与知识发现, 2017, 1(11): 29-36.
Liu Tong,Yang Jingcheng. Evaluating Online Healthcare Consultation Feedbacks Based on Signal Transmission Algorithm. Data Analysis and Knowledge Discovery, 2017, 1(11): 29-36.
Oh S, Yan Z, Min S P.Health Information Needs on Diseases: A Coding Schema Development for Analyzing Health Questions in Social Q&A[J]. Proceedings of the American Society for Information Science & Technology, 2012, 49(1): 1-4.
doi: 10.1002/meet.14504901316
(Deng Shengli, Guan Xian.Study of the Factors Influencing User Intention of Access to Health Information Based on Social Q&A[J]. Information Science, 2016, 34(11): 53-59.)
[3]
Yang H, Guo X, Wu T.Exploring the Influence of the Online Physician Service Delivery Process on Patient Satisfaction[J]. Decision Support Systems, 2015, 78: 113-121.
doi: 10.1016/j.dss.2015.05.006
[4]
Zhu Z, Bernhard D, Gurevych I.A Multi-Dimensional Model for Assessing the Quality of Answers in Social Q&A Sites[C]//Proceedings of International Conference on Information Quality. DBLP, 2009.
(Jia Jia, Song Enmei, Su Huan.Research on Assessment of Answer Quality in Social Q&A Platform[J]. Journal of Information Research Management, 2013, 3(2): 19-28.)
(Luo Yi, Cao Qian.Research on Answers’ Quality of Social Q&A Platforms Based on RIPA[J]. Library and Information Service, 2015, 59(3): 126-133.)
doi: 10.13266/j.issn.0252-3116.2015.03.018
[7]
Jeon J, Croft W B, Lee J H, et al.A Framework to Predict the Quality of Answers with Non-textual Features[C]// Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2006: 228-235.
[8]
Agichtein E, Castillo C, Donato D, et al.Finding High-quality Content in Social Media[C]//Proceedings of International Conference on Web Search and Web Data Mining. DBLP, 2008: 183-194.
(Lai Shean, Cai Zhongmin.Question Answering Quality Evaluation for Community Question Answering Based on Similarity[J]. Computer Applications and Software, 2013, 30(2): 266-269.)
[10]
Hu H, Liu B, Wang B, et al.Multimodal DBN for Predicting High-Quality Answers in cQA Portals[C]// Proceedings of Meeting of the Association for Computational Linguistics. 2013: 843-847.
[11]
Toba H, Ming Z Y, Adriani M, et al.Discovering High Quality Answers in Community Question Answering Archives Using a Hierarchy of Classifiers[J]. Information Sciences, 2014, 261(5): 101-115.
doi: 10.1016/j.ins.2013.10.030
(Xu Anying, Ji Zongcheng, Wang Bin.Answer Quality Prediction Based on Answering Order in Community Question Answering[J]. Journal of Chinese Information Processing, 2017, 31(2): 132-138.)
[13]
Page L, Brin S, Motwani R, et al.The PageRank Citation Ranking: Bringing Order to the Web [R]. Stanford InfoLab, 1999.
[14]
Mihalcea R, Tarau P.TextRank: Bringing Order into Texts[C]// Proceedings of Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2004.
[15]
Griffiths T L, Steyvers M.Finding Scientific Topics[J]. Proceedings of the National Academy of Sciences, 2004, 101(S1): 5228-5235.
doi: 10.1073/pnas.0307752101