|
|
|
| Optimizing Quality Evaluation for Answers of Q&A Community |
Shen Wang,Li Shiyu,Liu Jiayu,Li He( ) |
| School of Management, Jilin University, Jilin 130022, China |
|
|
|
|
Abstract [Objective] This paper tries to construct a new quality evaluation system for answers from a Q&A community (Zhihu in China). [Methods] First, we established a quality criteria based on user evaluation and data characteristics. Then, we created vectors for the answers. Third, we used the SVM model to learn the label representation of texts as well as the accuracy of text classification. [Results] The proposed system yielded a classification accuracy of 85.32%, which is higher than the one only included user evaluation criteria (61.44%) and the other one only adopted data characteristics (79.10%). [Limitations] Our evaluation method might be biased due to the subjective annotations. [Conclusions] The proposed method is an effective way to evaluate answer quality of the Q&A community.
|
|
Received: 01 July 2020
Published: 11 March 2021
|
|
|
| Fund:National Natural Science Foundation of China(71974075) |
|
Corresponding Authors:
Li He ORCID：0000-0001-8847-3619
E-mail: lihe200303@163.com
|
| [1] |
Delone W H, McLean E R. Information Systems Success: The Quest for the Dependent Variable[J]. Information Systems Research, 1992,3(1):60-95.
doi: 10.1287/isre.3.1.60
|
| [2] |
Eppler M J. Managing Information Quality: Increase the Value of Information in Knowledge-Intensive Products and Processes[M]. Berlin, Germany: Springer-Verlag, 2006.
|
| [3] |
Lin Y H, Shen H Y. SmartQ: A Question and Answer System for Supplying High-Quality and Trustworthy Answers[J]. IEEE Transactions on Big Data, 2018,4(4):600-613.
doi: 10.1109/TBigData.6687317
|
| [4] |
Procaci T B, Siqueira S W M, Nunes B P, et al. Modelling Experts Behaviour in Q&A Communities to Predict Worthy Discussions[C]//Proceedings of the 17th IEEE International Conference on Advanced Learning Technologies. 2017: 291-295.
|
| [5] |
齐云飞, 赵宇翔, 朱庆华. 在线问答社区中参与者知识行为研究综述[J]. 图书情报知识, 2018(3):103-112.
|
| [5] |
( Qi Yunfei, Zhao Yuxiang, Zhu Qinghua. A Review on Participants’ Knowledge Behaviors in Online Q&A Community[J]. Documentation, Informaiton & Knowledge, 2018(3):103-112.)
|
| [6] |
马丽. 微信公众平台用户信息采纳行为影响因素研究[D]. 哈尔滨:黑龙江大学, 2018.
|
| [6] |
( Ma Li. Research on Influencing Factors of User Information Adoption Behavior of WeChat Public Platform[D]. Harbin: Heilongjiang University, 2018.)
|
| [7] |
Fu H Y, Oh S. Quality Assessment of Answers with User-Identified Criteria and Data-Driven Features in Social Q&A[J]. Information Processing and Management, 2019,56(1):14-28.
doi: 10.1016/j.ipm.2018.08.007
|
| [8] |
Le L T, Shah C, Choi E. Assessing the Quality of Answers Autonomously in Community Question-Answering[J]. International Journal on Digital Libraries, 2019,20:351-367.
doi: 10.1007/s00799-019-00272-5
|
| [9] |
Tao D H, LeRouge C, Smith K J, et al. Defining Information Quality into Health Websites: A Conceptual Framework of Health Website Information Quality for Educated Young Adults[J]. JMIR Human Factors, 2017,4(4):e25.
doi: 10.2196/humanfactors.6455
pmid: 28986336
|
| [10] |
郭顺利. 社会化问答社区用户生成答案知识聚合及服务研究[D]. 长春: 吉林大学, 2018.
|
| [10] |
( Guo Shunli. Research on User Generate Answers Knowledge Aggregation and Knowledge Service of Social Question & Answer Community[D]. Changchun: Jilin University, 2018.)
|
| [11] |
王杰. 学术类微信公众号信息质量评价体系研究[D]. 保定: 河北大学, 2018.
|
| [11] |
( Wang Jie. Study of Assessment System of Academic WeChat Public Number Information Quality[D]. Baoding: Hebei University, 2018.)
|
| [12] |
张克永, 李贺. 健康微信公众平台信息质量评价指标体系研究[J]. 情报科学, 2017,35(11):143-148, 155.
|
| [12] |
( Zhang Keyong, Li He. Research on the Evaluation System of Health Information Quality in WeChat Public Platform[J]. Information Science, 2017,35(11):143-148,155.)
|
| [13] |
赵玉遂, 许燕, 吴青青, 等. 应用德尔菲法构建网络健康信息质量评价指标体系[J]. 预防医学, 2018,30(2):121-124.
|
| [13] |
( Zhao Yusui, Xu Yan, Wu Qingqing, et al. The Development of an Evaluation Index System on Health Information on the Internet Using Delphi Method[J]. Journal of Preventive Medicine, 2018,30(2):121-124.)
|
| [14] |
付予我, 刘春年. 基于AHP的ERP系统信息质量评价指标体系研究[J]. 科技广场, 2017(10):159-163.
|
| [14] |
( Fu Yuwo, Liu Chunnian. Research on the Evaluation Index System of ERP System Information Quality Based on AHP[J]. Science Mosaic, 2017(10):159-163.)
|
| [15] |
姜雯, 许鑫. 在线问答社区信息质量评价研究综述[J]. 现代图书情报技术, 2014(6):41-50.
|
| [15] |
( Jiang Wen, Xu Xin. Review on Information Quality Evaluation of Online Community Question Answering Sites[J]. New Technology of Library and Information Service, 2014(6):41-50.)
|
| [16] |
Sahu T P, Nagwani N K, Verma S. Topical Authoritative Answerer Identification on Q&A Posts Using Supervised Learning in CQA Sites[C]//Proceedings of the 9th Annual ACM India Conference. ACM, 2016: 129-132.
|
| [17] |
姜雯, 许鑫, 武高峰. 附加情感特征的在线问答社区信息质量自动化评价[J]. 图书情报工作, 2015,59(4):100-105.
|
| [17] |
( Jiang Wen, Xu Xin, Wu Gaofeng. Online Q&A Community Automatically Information Quality Evaluation with Sentiment Feature[J]. Library and Information Service, 2015,59(4):100-105.)
|
| [18] |
胡媛, 韦肖莹, 王灿. 微博信息质量评价指标体系构建研究[J]. 情报科学, 2017,35(6):44-50.
|
| [18] |
( Hu Yuan, Wei Xiaoying, Wang Can. Research on the Construction of Micro-blog Information Quality Evaluation Indicator System[J]. Information Science, 2017,35(6):44-50.)
|
| [19] |
Vapnik V N, Lerner A Y. Recognition of Patterns with Help of Generalized Portraits[J]. Avtomat. i Telemekh., 1963,24(6):774-780.
|
| [20] |
Vapnik V, Chervonenkis A. A Note on One Class of Perceptrons[J]. Automation and Remote Control, 1964,25(1).
|
| [21] |
林浩, 李雷孝, 王慧. 支持向量机在智能交通系统中的研究应用综述[J]. 计算机科学与探索, 2020,14(6):901-917.
|
| [21] |
( Lin Hao, Li Leixiao, Wang Hui. Survey on Research and Application of Support Vector Machines in Intelligent Transportation System[J]. Journal of Frontiers of Computer Science & Technology, 2020,14(6):901-917.)
|
| [22] |
郭顺利, 张向先, 陶兴, 等. 社会化问答社区用户生成答案质量自动化评价研究——以“知乎”为例[J]. 图书情报工作, 2019,63(11):118-130.
|
| [22] |
( Guo Shunli, Zhang Xiangxian, Tao Xing, et al. Research on Automated Evaluation of User Generated Answer Quality in Social Question and Answer Community ——Taking “Zhihu” as an Example[J]. Library and Information Service, 2019,63(11):118-130.)
|
| [23] |
崔敏君. 多特征层次化答案质量评价方法研究[D]. 太原: 太原理工大学, 2016.
|
| [23] |
( Cui Minjun. Research on Multi Feature Hierarchical Answer Quality Evaluation Method[D]. Taiyuan: Taiyuan University of Technology, 2016.)
|
| [24] |
孔维泽, 刘奕群, 张敏, 等. 问答社区中回答质量的评价方法研究[J]. 中文信息学报, 2011,25(1):3-8.
|
| [24] |
( Kong Weize, Liu Yiqun, Zhang Min, et al. Answer Quality Analysis on Community Question Answering[J]. Journal of Chinese Information Processing, 2011,25(1):3-8.)
|
| [25] |
Kim S, Oh S. Users’ Relevance Criteria for Evaluating Answers in a Social Q&A Site[J]. Journal of the Association for Information Science and Technology, 2009,60(4):716-727.
|
| [26] |
Bian J, Liu Y D, Agichtein E, et al. Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media[C]//Proceedings of the 17th International Conference on World Wide Web. 2008: 467-476.
|
| [27] |
方秋棠. 《知乎日报》每日推送选题研究[J]. 西部皮革, 2016,38(18):295.
|
| [27] |
( Fang Qiutang. Research on Daily Push Topics of Zhihu Daily[J]. Western Leather, 2016,38(18):295.)
|
| [28] |
杜裕琳. 知乎日报:与知乎社区实现共赢[J]. 青年记者, 2015(23):63-64.
|
| [28] |
( Du Yulin. Zhihu Daily: Win Together with Zhihu Community[J]. Young Journalist, 2015(23):63-64.)
|
| [29] |
徐启华, 耿帅, 师军. 基于大规模训练集SVM的发动机故障诊断[J]. 航空动力学报, 2011,26(12):2841-2848.
|
| [29] |
( Xu Qihua, Geng Shuai, Shi Jun. Fault Diagnosis Method for Aero-Engine Based on SVM with Large-Scale Training Set[J]. Journal of Aerospace Power, 2011,26(12):2841-2848.)
|
| [30] |
汤荣志, 段会川, 孙海涛. SVM训练数据归一化研究[J]. 山东师范大学学报(自然科学版), 2016,31(4):60-65.
|
| [30] |
( Tang Rongzhi, Duan Huichuan, Sun Haitao. Research on Normalization of SVM Training Data[J]. Journal of Shandong Normal University (Natural Science), 2016,31(4):60-65.)
|
| [31] |
李骏亮, 李耕, 张曙. 命名实体识别在无效文本过滤中的应用——过滤影视作品中的无效评论[J]. 电子技术, 2017,46(9):56-60, 49.
|
| [31] |
( Li Junliang, Li Geng, Zhang Shu. Application of Named Entity Recognition in Invalid Text Filtering —— Filtering Invalid Comments in Film and Television Works[J]. Electronic Technology, 2017,46(9):56-60, 49.)
|
| [32] |
屈玉涛, 邓万宇. 基于MATLAB的SVM分类预测实现[J]. 信息通信, 2017(3):33-34.
|
| [32] |
( Qu Yutao, Deng Wanyu. Realization of SVM Classification Prediction Based on MATLAB[J]. Information & Communications, 2017(3):33-34.)
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
