Please wait a minute...
Advanced Search
现代图书情报技术  2014, Vol. 30 Issue (6): 41-50    DOI: 10.11925/infotech.1003-3513.2014.06.05
  知识组织与知识管理 本期目录 | 过刊浏览 | 高级检索 |
姜雯, 许鑫
华东师范大学商学院信息学系 上海 200241
Review on Information Quality Evaluation of Online Community Question Answering Sites
Jiang Wen, Xu Xin
Department of Information Science, Business School, East China Normal University, Shanghai 200241, China
全文: PDF(449 KB)   HTML  
输出: BibTeX | EndNote (RIS)      

[目的]对在线问答社区信息质量评价相关研究进行梳理和综述。[文献范围]利用Web of Knowledge、中国知网(CNKI)以及追溯法检索到的问答社区信息质量评价相关中英文文献。[方法]文献调研法, 并按研究主题进行综述。[结果]目前在线问答社区信息质量评价研究主要集中在影响评价因素研究、人工评价、自动化评价三个方面, 其中自动化评价以机器学习方法应用为主。[局限]不同解决方案比较时缺少具体的定量测评。[结论]目前的研究还存在缺乏权威评价标准以及缺少领域聚焦等不足, 问答社区的信息质量问题还有很多尚未解决, 更全面深入的分析评价以及自动化评价将是未来研究热点和重点。

E-mail Alert
关键词 问答社区质量评价信息质量    

[Objective] To summarize the researches on the information quality evaluation of online Community Question Answering (CQA). [Coverage] Use Web of Knowledge and CNKI and reference retroactive method to retrieve English and Chinese literatures related to information quality evaluation of online CQA. [Methods] Literature investigation, summarized by research topic. [Results] So far, the researches on the information quality evaluation of online CQA sites focus on three aspects that are influencing factors of evaluation, manual evaluation and automatic evaluation, and for automatic evaluation, the machine learning application is the main method. [Limitations] Comparison of different solutions lacks specific quantitative evaluation. [Conclusions] There are some weakness in the current researches such as lacking authoritative evaluation criterion and lacking domain focus. In the future, more comprehensive and deeper researches are needed in this area, and automatic evaluation will be the hot spot.

Key wordsCQA    Information quality evaluation    Information quality
收稿日期: 2014-01-26     
:  G203  
通讯作者: 许鑫     E-mail:
作者简介: 作者贡献声明:姜雯:文献调研,论文起草;许鑫:提出研究思路和论文框架,负责最终版本修订。
姜雯, 许鑫. 在线问答社区信息质量评价研究综述[J]. 现代图书情报技术, 2014, 30(6): 41-50.
Jiang Wen, Xu Xin. Review on Information Quality Evaluation of Online Community Question Answering Sites. New Technology of Library and Information Service, DOI:10.11925/infotech.1003-3513.2014.06.05.

[1] Shah C, Oh J S, Oh S. Exploring Characteristics and Effects of User Participation in Online Social Q&A Sites[J/OL]. First Monday, 2008, 13(9). [2014-01-20]. http://www.firstmonday. dk/ojs/index.php/fm/article/view/2182/2028.
[2] 张英敏.借鉴Google Answers构建高校图书馆咨询专家队伍[J]. 图书馆学刊, 2007, 29(5):36-37. (Zhang Yingmin. Constructing the University Library Advisory Experts Team Use the Experience of Google Answers[J]. Journal of Library Science, 2007, 29(5): 36-37.)
[3] Wikipedia. Google Answers [EB/OL]. [2014-01-20].
[4] Jeon G Y J, Rieh S Y. Do You Trust Answers?: Credibility Judgments in Social Search Using Social Q&A Sites [C].In: Proceedings of Workshop on Social Media Question Answering at CSCW2013, San Antonio, Texas, USA. 2013.
[5] 你不知道的百度知道[EB/OL]. [2014-01-20]. http://zhidao. (Baidu Know What You don't Know [EB/OL]. [2014-01-20]. )
[6] 刘高勇, 邓胜利. 社交问答服务的演变与发展研究[J]. 图书馆论坛, 2013, 33(1): 17-21. (Liu Gaoyong, Deng Shengli. Evolution and Development of Social Q&A Service[J]. Library Tribune, 2013, 33(1):17-21.)
[7] Wikipedia. List of Question-and-answer Websites [EB/OL].[2014-01-20]. question-and-answer_websites.
[8] Gazan R. Social Q&A[J].Journal of the American Society for Information Science and Technology, 2011, 62(12): 2301-2312.
[9] Liu Y, Agichtein E. On the Evolution of the Yahoo! Answers QA Community[C]. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'08). New York: ACM, 2008: 737-738.
[10] Bian J, Liu Y, Agichtein E, et al. A Few Bad Votes Too Many?: Towards Robust Ranking in Social Media[C]. In: Proceedings of the 4th International Workshop on Adversarial Information Retrieval on the Web (AIRWeb'08). New York: ACM, 2008:53-60.
[11] 袁毅, 蔚海燕.问答社区低可信度信息的传播与控制研究[J]. 图书馆论坛, 2011, 31(6): 171-177. (Yuan Yi, Yu Haiyan. The Research on Low Credibility Information Communication and Control in Q&A Community[J]. Library Tribune, 2011, 31(6): 171-177.)
[12] Fichman P. How Many Answers are Enough? Optimal Number Of Answers for Q&A Sites[C]. In: Proceedings of the 4th International Conference on Social Informatics, Lausanne, Switzerland. Berlin, Heidelberg: Springer, 2012: 260-274.
[13] Fichman P. Information Quality on Yahoo! Answers[A].//Tsiakis T, Kargidis T, Katsaros P. Approaches and Processes for Managing the Economics of Information Systems[M]. IGI Global, 2013.
[14] 张兴刚. 中文问答社区信息传播机制研究[D]. 上海: 华东师范大学, 2010. (Zhang Xinggang. The Study in Information Dissemination Mechanism of Chinese Q&A Community[D]. Shanghai: East China Normal University, 2010.)
[15] Katerattanakul P, Siau K. Measuring Information Quality of Web Sites: Development of an Instrument[C]. In: Proceedings of the 20th International Conference on Information Systems(ICIS'99), Charlotte, North Carolina, United States. Atlanta: Association for Information Systems, 1999: 279-285.
[16] Rieh S Y. Judgment of Information Quality and Cognitive Authority in the Web[J]. Journal of the American Society for Information Science and Technology, 2002, 53(2): 145-161.
[17] Wang R Y, Strong D M. Beyond Accuracy: What Data Quality Means to Data Consumers[J]. Journal of Management Information Systems, 1996, 12(4): 5-33.
[18] Batini C, Scannapieco M. Data Quality: Concepts, Methodologies and Techniques[M]. Springer, 2006.
[19] Kim S, Oh J S, Oh S. Best-Answer Selection Criteria in a Social Q&A Site from the User-Oriented Relevance Perspective[C]. In: Proceedings of the 70th Annual Meeting of American Society for Information Science and Technology (ASIST). 2007:1-15.
[20] Kim S, Oh S. Users' Relevance Criteria for Evaluating Answers in a Social Q&A Site[J]. Journal of the American Society for Information Science and Technology, 2009, 60(4): 716-727.
[21] Zhu Z M, Bernhard D, Gurevych I.A Multi-dimensional Model for Assessing the Quality of Answers in Social Q&A[EB/OL].[2014-01-20].
[22] Ishikawa D, Kando N, Sakai T. What Makes a Good Answer in Community Question Answering? An Analysis of Assessors' Criteria[C]. In: Proceedings of the 4th International Workshop on Evaluating Information Access (EVIA), Tokyo, Japan. 2011.
[23] 蒋楠, 王鹏程.社会化问答服务中用户需求与信息内容的相关性评价研究——以“百度知道”为例[J]. 信息资源管理学报, 2012(3): 35-45. (Jiang Nan, Wang Pengcheng. Study on the Evaluation Creteria of Relevance of Users' Need and Information Content in Social Question and Answer Service: Take Baidu Knows as an Example[J]. Journal of Information Resources Management, 2012(3): 35-45.)
[24] Oh S, Worrall A, Yi Y J. Quality Evaluation of Health Answers in Yahoo! Answers: A Comparison Between Experts and Users[J]. Proceedings of the American Society for Information Science and Technology, 2011, 48(1): 1-3.
[25] Oh S, Yi Y J, Worrall A.Quality of Health Answers in Social Q&A[J]. Proceedings of the American Society for Information Science and Technology, 2012, 49(1): 1-6.
[26] Worrall A, Oh S. The Place of Health Information and Socio-emotional Support in Social Questioning and Answering[J]. Information Research, 2013, 18(3). [2014-01-20].
[27] Oh S, Worrall A. Health Answer Quality Evaluation by Librarians, Nurses, and Users in Social Q&A[J]. Library & Information Science Research, 2013, 35(4): 288-298.
[28] Shah C, Pomerantz J. Evaluating and Predicting Answer Quality in Community QA[C]. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval(SIGIR'10). New York: ACM, 2010: 411-418.
[29] Fichman P. A Comparative Assessment of Answer Quality on Four Question Answering Sites[J]. Journal of Information Science, 2011, 37(5): 476-486.
[30] 贾佳, 宋恩梅, 苏环.社会化问答平台的答案质量评估——以“知乎”、“百度知道”为例[J]. 信息资源管理学报, 2013(2): 19-28. (Jia Jia, Song Enmei, Su Huan. Research on Assessment of Answer Quality in Social Q&A Platform[J]. Journal of Information Resources Management, 2013(2): 19-28.)
[31] Shachaf P, Rosenbaum H. Online Social Reference: A Research Agenda Through a STIN Framework[C]. In: Proceedings of iConference 2009, Chapel Hill, NC, USA. 2009.
[32] Shachaf P. The Paradox of Expertise: Is the Wikipedia Reference Desk as Good as Your Library?[J]. Journal of Documentation, 2009, 65(6): 977-996.
[33] Chua A Y K, Balkunje R S. Comparative Evaluation of Community Question Answering Websites[C]. In: Proceedings of the 14th International Conference on Asia-Pacific Digital Libraries(ICADL'12), Taipei, Taiwan, China. Berlin, Heidelberg: Springer, 2012: 209-218.
[34] Chua A Y K, Banerjee S. So Fast So Good: An Analysis of Answer Quality and Answer Speed in Community Question‐Answering Sites[J]. Journal of the American Society for Information Science and Technology, 2013, 64(10): 2058-2068.
[35] 张兴刚, 袁毅.基于搜索引擎的中文问答社区比较研究[J].图书馆学研究, 2009(6):65-72. (Zhang Xinggang, Yuan Yi.A Comparative Study of Chinese Q&A Communities Based on Search Engine[J]. Researches in Library Science, 2009(6): 65-72.)
[36] 邓胜利.国内外交互问答平台的比较及其对策研究[J].情报理论与实践, 2009, 32(3): 50-55. (Deng Shengli. Comparison of the Domestic and Foreign Interactive Question-and-Answer Platforms & Their Development Strategies[J]. Information Studies: Theory & Application, 2009, 32(3): 50-55.)
[37] 吴丹, 刘媛, 王少成.中英文网络问答社区比较研究与评价实验[J]. 现代图书情报技术, 2011(1): 74-82. (Wu Dan, Liu Yuan, Wang Shaocheng. A Comparison and Evaluation Experiment on Chinese and English Online Question Answering Communities[J]. New Technology of Library and Information Service, 2011(1): 74-82.)
[38] 吴丹, 严婷, 金国栋.网络问答社区与联合参考咨询比较与评价[J]. 中国图书馆学报, 2011, 37(4): 94-105. (Wu Dan, Yan Ting, Jin Guodong. Comparison and Evaluation Between Community-based Q&A Sites and Library's Reference Services[J]. Journal of Library Science in China, 2011, 37(4): 94-105.)
[39] Jeon J, Croft W B, Lee J H, et al. A Framework to Predict the Quality of Answers with Non-textual Features[C]. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA. ACM, 2006:228-235.
[40] Agichtein E, Castillo C, Donato D, et al. Finding High-quality Content in Social Media[C]. In: Proceedings of the 2008 International Conference on Web Search and Web Data Mining (WSDM'08). New York: ACM, 2008: 183-194.
[41] Hoang L, Lee J, Song Y, et al. A Model for Evaluating the Quality of User-created Documents[C]. In: Proceedings of the 4th Asia Information Retrieval Symposium (AIRS'08), Harbin, China. Berlin, Heidelberg: Springer, 2008: 496-501.
[42] Liu Y, Bian J, Agichtein E. Predicting Information Seeker Satisfaction in Community Question Answering[C]. In: Proceedings of the 31st Annual International ACM SIGIR Conference Research and Development in Information Retrieval, Singapore. ACM, 2008: 483-490.
[43] Agichtein E, Liu Y, Bian J, Modeling Information Seeker Satisfaction in Community Question Answering[J]. ACM Transactions on Knowledge Discovery from Data, 2009, 3(2): Article No. 10.
[44] John B M, Chua A Y, Goh D H. What Makes a High-quality User-generated Answer?[J]. IEEE Internet Computing, 2011, 15(1): 66-71.
[45] Cai Y, Chakravarthy S. Predicting Answer Quality in Q/A Social Networks: Using Temporal Features[R]. Department of Computer Science and Engineering, University of Texas at Arlington, 2011.
[46] Cai Y, Chakravarthy S.Improving Answer Quality Prediction in Q/A Social Networks by Leveraging Temporal Features[C]. In: Proceedings of WSDM 2013, Italy, Rome. 2013.
[47] Li B, Jin T, Lyu M R, et al. Analyzing and Predicting Question Quality in Community Question Answering Services[C]. In: Proceedings of the 21st International Conference Companion on World Wide Web (WWW'12).New York: ACM, 2012: 775-782.
[48] Arai K, Handayani A N. Predicting Quality of Answer in Collaborative Q/A Community[J]. International Journal of Advanced Research in Artificial Intelligence, 2013, 2(3): 21-25.
[49] Tian Q, Zhang P, Li B. Towards Predicting the Best Answers in Community-Based Question-Answering Services[C]. In: Proceedings of the 7th International AAAI Conference on Weblogs and Social Media. 2013.
[50] 孔维泽, 刘奕群, 张敏, 等. 问答社区中回答质量的评价方法研究[J]. 中文信息学报, 2011, 25(1): 3-8. (Kong Weize, Liu Yiqun, Zhang Min, et al. Answer Quality Analysis on Community Question Answering[J]. Journal of Chinese Information Processing, 2011, 25(1): 3-8.)
[51] 李晨, 巢文涵, 陈小明, 等.中文社区问答中问题答案质量评价和预测[J]. 计算机科学, 2011, 38(6): 230-236. (Li Chen, Chao Wenhan, Chen Xiaoming, et al. Quality Evaluation and Prediction for Question and Answer in Chinese Community Question Answering[J]. Computer Science, 2011, 38(6): 230-236.)
[52] 刘高军, 马砚忠, 段建勇.社区问答系统中“问答对”的质量评价[J].北方工业大学学报, 2012, 24(3): 31-36. (Liu Gaojun, Ma Yanzhong, Duan Jianyong. Assessment of Quality of “Questions and Answers” in Community Q&A System[J]. Journal of North China University of Technology, 2012, 24(3): 31-36.)
[53] 来社安, 蔡中民. 基于相似度的问答社区问答质量评价方法[J]. 计算机应用与软件, 2013, 30(2): 266-269. (Lai She'an, Cai Zhongmin. Question Answering Quality Evaluation for Community Question Answering Based on Similarity[J]. Computer Applications and Software, 2013, 30(2): 266-269.)

[1] 易明,张婷婷. 大众性问答社区答案质量排序方法研究*[J]. 数据分析与知识发现, 2019, 3(6): 12-20.
[2] 石静,厉臣璐,钱宇星,周利琴,张斌. 国内外健康问答社区用户信息需求对比研究*——基于主题和时间视角的实证分析[J]. 数据分析与知识发现, 2019, 3(5): 1-10.
[3] 程秀峰,张心怡,王宁. 基于CART决策树的网络问答社区新兴话题识别研究*[J]. 数据分析与知识发现, 2018, 2(12): 52-59.
[4] 孙赫,李淑琴,吕学强,刘克会. 微博城市投诉文本中地理位置实体的完整性研究*[J]. 现代图书情报技术, 2016, 32(3): 58-66.
[5] 沈旺, 国佳, 李贺. 网络社区信息质量及可靠性评价研究——基于用户视角[J]. 现代图书情报技术, 2013, 29(1): 69-74.
[6] 吴丹, 刘媛, 王少成. 中英文网络问答社区比较研究与评价实验[J]. 现代图书情报技术, 2011, 27(1): 74-82.
[7] 阚德涛,张志武. 服务质量评价系统设计及实现[J]. 现代图书情报技术, 2008, 24(7): 66-69.
[8] 张娴,杨志萍,周宁丽,李丹. 国家科学数字图书馆网络联合参考咨询服务质量控制及评价方案研究*[J]. 现代图书情报技术, 2005, 21(11): 30-33.
[9] 张晓芬. EBSCO网络数据库综合评价[J]. 现代图书情报技术, 2000, 16(6): 72-74.
Full text



版权所有 © 2015 《数据分析与知识发现》编辑部
地址:北京市海淀区中关村北四环西路33号 邮编:100190