Please wait a minute...
New Technology of Library and Information Service  2014, Vol. 30 Issue (6): 41-50    DOI: 10.11925/infotech.1003-3513.2014.06.05
Current Issue | Archive | Adv Search |
Review on Information Quality Evaluation of Online Community Question Answering Sites
Jiang Wen, Xu Xin
Department of Information Science, Business School, East China Normal University, Shanghai 200241, China
Download: PDF(449 KB)   HTML  
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] To summarize the researches on the information quality evaluation of online Community Question Answering (CQA). [Coverage] Use Web of Knowledge and CNKI and reference retroactive method to retrieve English and Chinese literatures related to information quality evaluation of online CQA. [Methods] Literature investigation, summarized by research topic. [Results] So far, the researches on the information quality evaluation of online CQA sites focus on three aspects that are influencing factors of evaluation, manual evaluation and automatic evaluation, and for automatic evaluation, the machine learning application is the main method. [Limitations] Comparison of different solutions lacks specific quantitative evaluation. [Conclusions] There are some weakness in the current researches such as lacking authoritative evaluation criterion and lacking domain focus. In the future, more comprehensive and deeper researches are needed in this area, and automatic evaluation will be the hot spot.

Key wordsCQA      Information quality evaluation      Information quality     
Received: 26 January 2014      Published: 09 July 2014
:  G203  

Cite this article:

Jiang Wen, Xu Xin. Review on Information Quality Evaluation of Online Community Question Answering Sites. New Technology of Library and Information Service, 2014, 30(6): 41-50.

URL:

http://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.1003-3513.2014.06.05     OR     http://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2014/V30/I6/41

[1] Shah C, Oh J S, Oh S. Exploring Characteristics and Effects of User Participation in Online Social Q&A Sites[J/OL]. First Monday, 2008, 13(9). [2014-01-20]. http://www.firstmonday. dk/ojs/index.php/fm/article/view/2182/2028.
[2] 张英敏.借鉴Google Answers构建高校图书馆咨询专家队伍[J]. 图书馆学刊, 2007, 29(5):36-37. (Zhang Yingmin. Constructing the University Library Advisory Experts Team Use the Experience of Google Answers[J]. Journal of Library Science, 2007, 29(5): 36-37.)
[3] Wikipedia. Google Answers [EB/OL]. [2014-01-20]. http://zh.wikipedia.org/wiki/Google_Answers.
[4] Jeon G Y J, Rieh S Y. Do You Trust Answers?: Credibility Judgments in Social Search Using Social Q&A Sites [C].In: Proceedings of Workshop on Social Media Question Answering at CSCW2013, San Antonio, Texas, USA. 2013.
[5] 你不知道的百度知道[EB/OL]. [2014-01-20]. http://zhidao. baidu.com/s/bigdata/index_17.html. (Baidu Know What You don't Know [EB/OL]. [2014-01-20]. http://zhidao.baidu.com/s/bigdata/index_17.html. )
[6] 刘高勇, 邓胜利. 社交问答服务的演变与发展研究[J]. 图书馆论坛, 2013, 33(1): 17-21. (Liu Gaoyong, Deng Shengli. Evolution and Development of Social Q&A Service[J]. Library Tribune, 2013, 33(1):17-21.)
[7] Wikipedia. List of Question-and-answer Websites [EB/OL].[2014-01-20]. http://en.wikipedia.org/wiki/List_of_ question-and-answer_websites.
[8] Gazan R. Social Q&A[J].Journal of the American Society for Information Science and Technology, 2011, 62(12): 2301-2312.
[9] Liu Y, Agichtein E. On the Evolution of the Yahoo! Answers QA Community[C]. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'08). New York: ACM, 2008: 737-738.
[10] Bian J, Liu Y, Agichtein E, et al. A Few Bad Votes Too Many?: Towards Robust Ranking in Social Media[C]. In: Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web (AIRWeb'08). New York: ACM, 2008:53-60.
[11] 袁毅, 蔚海燕.问答社区低可信度信息的传播与控制研究[J]. 图书馆论坛, 2011, 31(6): 171-177. (Yuan Yi, Yu Haiyan. The Research on Low Credibility Information Communication and Control in Q&A Community[J]. Library Tribune, 2011, 31(6): 171-177.)
[12] Fichman P. How Many Answers are Enough? Optimal Number Of Answers for Q&A Sites[C]. In: Proceedings of the 4th International Conference on Social Informatics, Lausanne, Switzerland. Berlin, Heidelberg: Springer, 2012: 260-274.
[13] Fichman P. Information Quality on Yahoo! Answers[A].//Tsiakis T, Kargidis T, Katsaros P. Approaches and Processes for Managing the Economics of Information Systems[M]. IGI Global, 2013.
[14] 张兴刚. 中文问答社区信息传播机制研究[D]. 上海: 华东师范大学, 2010. (Zhang Xinggang. The Study in Information Dissemination Mechanism of Chinese Q&A Community[D]. Shanghai: East China Normal University, 2010.)
[15] Katerattanakul P, Siau K. Measuring Information Quality of Web Sites: Development of an Instrument[C]. In: Proceedings of the 20th International Conference on Information Systems(ICIS'99), Charlotte, North Carolina, United States. Atlanta: Association for Information Systems, 1999: 279-285.
[16] Rieh S Y. Judgment of Information Quality and Cognitive Authority in the Web[J]. Journal of the American Society for Information Science and Technology, 2002, 53(2): 145-161.
[17] Wang R Y, Strong D M. Beyond Accuracy: What Data Quality Means to Data Consumers[J]. Journal of Management Information Systems, 1996, 12(4): 5-33.
[18] Batini C, Scannapieco M. Data Quality: Concepts, Methodologies and Techniques[M]. Springer, 2006.
[19] Kim S, Oh J S, Oh S. Best-Answer Selection Criteria in a Social Q&A Site from the User-Oriented Relevance Perspective[C]. In: Proceedings of the 70th Annual Meeting of American Society for Information Science and Technology (ASIST). 2007:1-15.
[20] Kim S, Oh S. Users' Relevance Criteria for Evaluating Answers in a Social Q&A Site[J]. Journal of the American Society for Information Science and Technology, 2009, 60(4): 716-727.
[21] Zhu Z M, Bernhard D, Gurevych I.A Multi-dimensional Model for Assessing the Quality of Answers in Social Q&A[EB/OL].[2014-01-20]. http://tuprints.ulb.tu-darmstadt.de/1940/1/TR_dimension_model.pdf.
[22] Ishikawa D, Kando N, Sakai T. What Makes a Good Answer in Community Question Answering? An Analysis of Assessors' Criteria[C]. In: Proceedings of the 4th International Workshop on Evaluating Information Access (EVIA), Tokyo, Japan. 2011.
[23] 蒋楠, 王鹏程.社会化问答服务中用户需求与信息内容的相关性评价研究——以“百度知道”为例[J]. 信息资源管理学报, 2012(3): 35-45. (Jiang Nan, Wang Pengcheng. Study on the Evaluation Creteria of Relevance of Users' Need and Information Content in Social Question and Answer Service: Take Baidu Knows as an Example[J]. Journal of Information Resources Management, 2012(3): 35-45.)
[24] Oh S, Worrall A, Yi Y J. Quality Evaluation of Health Answers in Yahoo! Answers: A Comparison Between Experts and Users[J]. Proceedings of the American Society for Information Science and Technology, 2011, 48(1): 1-3.
[25] Oh S, Yi Y J, Worrall A.Quality of Health Answers in Social Q&A[J]. Proceedings of the American Society for Information Science and Technology, 2012, 49(1): 1-6.
[26] Worrall A, Oh S. The Place of Health Information and Socio-emotional Support in Social Questioning and Answering[J]. Information Research, 2013, 18(3). [2014-01-20]. http://informationr.net/ir/18-3/paper587.html.
[27] Oh S, Worrall A. Health Answer Quality Evaluation by Librarians, Nurses, and Users in Social Q&A[J]. Library & Information Science Research, 2013, 35(4): 288-298.
[28] Shah C, Pomerantz J. Evaluating and Predicting Answer Quality in Community QA[C]. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'10). New York: ACM, 2010: 411-418.
[29] Fichman P. A Comparative Assessment of Answer Quality on Four Question Answering Sites[J]. Journal of Information Science, 2011, 37(5): 476-486.
[30] 贾佳, 宋恩梅, 苏环.社会化问答平台的答案质量评估——以“知乎”、“百度知道”为例[J]. 信息资源管理学报, 2013(2): 19-28. (Jia Jia, Song Enmei, Su Huan. Research on Assessment of Answer Quality in Social Q&A Platform[J]. Journal of Information Resources Management, 2013(2): 19-28.)
[31] Shachaf P, Rosenbaum H. Online Social Reference: A Research Agenda Through a STIN Framework[C]. In: Proceedings of iConference 2009, Chapel Hill, NC, USA. 2009.
[32] Shachaf P. The Paradox of Expertise: Is the Wikipedia Reference Desk as Good as Your Library?[J]. Journal of Documentation, 2009, 65(6): 977-996.
[33] Chua A Y K, Balkunje R S. Comparative Evaluation of Community Question Answering Websites[C]. In: Proceedings of the 14th International Conference on Asia-Pacific Digital Libraries(ICADL'12), Taipei, Taiwan, China. Berlin, Heidelberg: Springer, 2012: 209-218.
[34] Chua A Y K, Banerjee S. So Fast So Good: An Analysis of Answer Quality and Answer Speed in Community Question‐Answering Sites[J]. Journal of the American Society for Information Science and Technology, 2013, 64(10): 2058-2068.
[35] 张兴刚, 袁毅.基于搜索引擎的中文问答社区比较研究[J].图书馆学研究, 2009(6):65-72. (Zhang Xinggang, Yuan Yi.A Comparative Study of Chinese Q&A Communities Based on Search Engine[J]. Researches in Library Science, 2009(6): 65-72.)
[36] 邓胜利.国内外交互问答平台的比较及其对策研究[J].情报理论与实践, 2009, 32(3): 50-55. (Deng Shengli. Comparison of the Domestic and Foreign Interactive Question-and-Answer Platforms & Their Development Strategies[J]. Information Studies: Theory & Application, 2009, 32(3): 50-55.)
[37] 吴丹, 刘媛, 王少成.中英文网络问答社区比较研究与评价实验[J]. 现代图书情报技术, 2011(1): 74-82. (Wu Dan, Liu Yuan, Wang Shaocheng. A Comparison and Evaluation Experiment on Chinese and English Online Question Answering Communities[J]. New Technology of Library and Information Service, 2011(1): 74-82.)
[38] 吴丹, 严婷, 金国栋.网络问答社区与联合参考咨询比较与评价[J]. 中国图书馆学报, 2011, 37(4): 94-105. (Wu Dan, Yan Ting, Jin Guodong. Comparison and Evaluation Between Community-based Q&A Sites and Library's Reference Services[J]. Journal of Library Science in China, 2011, 37(4): 94-105.)
[39] Jeon J, Croft W B, Lee J H, et al. A Framework to Predict the Quality of Answers with Non-textual Features[C]. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA. ACM, 2006:228-235.
[40] Agichtein E, Castillo C, Donato D, et al. Finding High-quality Content in Social Media[C]. In: Proceedings of the 2008 International Conference on Web Search and Web Data Mining (WSDM'08). New York: ACM, 2008: 183-194.
[41] Hoang L, Lee J, Song Y, et al. A Model for Evaluating the Quality of User-created Documents[C]. In: Proceedings of the 4th Asia Information Retrieval Symposium (AIRS'08), Harbin, China. Berlin, Heidelberg: Springer, 2008: 496-501.
[42] Liu Y, Bian J, Agichtein E. Predicting Information Seeker Satisfaction in Community Question Answering[C]. In: Proceedings of the 31st Annual International ACM SIGIR Conference Research and Development in Information Retrieval, Singapore. ACM, 2008: 483-490.
[43] Agichtein E, Liu Y, Bian J, Modeling Information Seeker Satisfaction in Community Question Answering[J]. ACM Transactions on Knowledge Discovery from Data, 2009, 3(2): Article No. 10.
[44] John B M, Chua A Y, Goh D H. What Makes a High-quality User-generated Answer?[J]. IEEE Internet Computing, 2011, 15(1): 66-71.
[45] Cai Y, Chakravarthy S. Predicting Answer Quality in Q/A Social Networks: Using Temporal Features[R]. Department of Computer Science and Engineering, University of Texas at Arlington, 2011.
[46] Cai Y, Chakravarthy S.Improving Answer Quality Prediction in Q/A Social Networks by Leveraging Temporal Features[C]. In: Proceedings of WSDM 2013, Italy, Rome. 2013.
[47] Li B, Jin T, Lyu M R, et al. Analyzing and Predicting Question Quality in Community Question Answering Services[C]. In: Proceedings of the 21st International Conference Companion on World Wide Web (WWW'12).New York: ACM, 2012: 775-782.
[48] Arai K, Handayani A N. Predicting Quality of Answer in Collaborative Q/A Community[J]. International Journal of Advanced Research in Artificial Intelligence, 2013, 2(3): 21-25.
[49] Tian Q, Zhang P, Li B. Towards Predicting the Best Answers in Community-Based Question-Answering Services[C]. In: Proceedings of the 7th International AAAI Conference on Weblogs and Social Media. 2013.
[50] 孔维泽, 刘奕群, 张敏, 等. 问答社区中回答质量的评价方法研究[J]. 中文信息学报, 2011, 25(1): 3-8. (Kong Weize, Liu Yiqun, Zhang Min, et al. Answer Quality Analysis on Community Question Answering[J]. Journal of Chinese Information Processing, 2011, 25(1): 3-8.)
[51] 李晨, 巢文涵, 陈小明, 等.中文社区问答中问题答案质量评价和预测[J]. 计算机科学, 2011, 38(6): 230-236. (Li Chen, Chao Wenhan, Chen Xiaoming, et al. Quality Evaluation and Prediction for Question and Answer in Chinese Community Question Answering[J]. Computer Science, 2011, 38(6): 230-236.)
[52] 刘高军, 马砚忠, 段建勇.社区问答系统中“问答对”的质量评价[J].北方工业大学学报, 2012, 24(3): 31-36. (Liu Gaojun, Ma Yanzhong, Duan Jianyong. Assessment of Quality of “Questions and Answers” in Community Q&A System[J]. Journal of North China University of Technology, 2012, 24(3): 31-36.)
[53] 来社安, 蔡中民. 基于相似度的问答社区问答质量评价方法[J]. 计算机应用与软件, 2013, 30(2): 266-269. (Lai She'an, Cai Zhongmin. Question Answering Quality Evaluation for Community Question Answering Based on Similarity[J]. Computer Applications and Software, 2013, 30(2): 266-269.)

[1] Jing Shi,Chenlu Li,Yuxing Qian,Liqin Zhou,Bin Zhang. Information Needs of Domestic and International HCQA Users ——An Empirical Analysis[J]. 数据分析与知识发现, 2019, 3(5): 1-10.
[2] Shen Wang, Guo Jia, Li He. Research on Information Quality and Credibility Evaluation in Online Community——Based on User Perspective[J]. 现代图书情报技术, 2013, 29(1): 69-74.
[3] Wu Xian. Searching High Quality Information Via Search Engines[J]. 现代图书情报技术, 2000, 16(6): 51-53.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn