Construction of the Usability Evaluation Indicators on Search Engine
Ke Qing1, Cheng Ying1, Zheng Yanning2, Pan Yuntao2
1. Department of Information Management, Nanjing University, Nanjing 210093, China; 2. Institute of Scientific & Technical Information of China, Beijing 100038, China
Abstract：This paper firstly analyzes the relation between search engine evaluation and usability analysis. Based on the characteristics of the three stages of information retrieval by search engine, the demand of usability evaluation is given,and the evaluation hierarchical model on the usability of search engine is constructed based on the four foundations for the choice of evaluation indicators. Then the weights of indicators are accounted by Delphi method,and a valuable search engine usability evaluation system is provided.
柯青, 成颖, 郑彦宁, 潘云涛. 搜索引擎可用性评价指标体系构建[J]. 现代图书情报技术, 2011, (11): 24-30.
Ke Qing, Cheng Ying, Zheng Yanning, Pan Yuntao. Construction of the Usability Evaluation Indicators on Search Engine. New Technology of Library and Information Service, 2011, (11): 24-30.
[1] Jansen B J, Spink A. How are We Searching the World Wide Web? A Comparison of Nine Search Engine Transaction Logs [J]. Information Processing and Management, 2006, 42(1):248-263. [2] Bevan N. International Standards for HCI . http://www.nigelbevan.com/papers/ International_standards_ HCI.pdf. [3] Nielsen J. Usability Engineering[M]. Cambridge, MA: Academic Press, 1993:1-17. [4] Shackel B. Usabiliy-Context,Framework,Definition,Design and Evaluation // Shackel B, Richardson S. Human Factors for Informatics Usability [M].Cambridge: Cambridge University Press, 1991:21-38. [5] Chu H, Rosentha1 M.Search Engines for the World Wide Web:A Comparative Study and Evaluation Methodology .In: Proceedings of the 59th Annual Meeting of the American Society for Information Science,Baltimore, USA. 1996:127-135. [6] Bar-Ilan J. Methods for Measuring Search Engine Performance over Time [J].Journal of the American Society for Information Science and Technology,2002,53(4):308-319. [7] 曾民族.网络信息检索现状和性能评价[J]. 情报学报, 1997,16(2):90-99. [8] 宛玲,杨秀丹,杜晓静.试析中文搜索引擎的评价标准[J]. 情报科学, 2000,18(1):28-31,38. [9] 凌美秀.关于搜索引擎当前存在的主要问题及其发展趋势的探讨[J]. 高校图书馆工作, 2001,21(5):29-33. [10] 朱庆华,杜佳. 搜索引擎评价指标体系的建立与应用[J]. 情报学报, 2007,26(5):684-690. [11] Agarwal R, Venkatesh V. Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability [J]. Information Systems Research, 2002, 13 (2):168-186. [12] Nielsen J. Designing Web Usability: The Practice of Simplicity [M]. CA, USA:New Riders Publishing Thousand Oaks, 2000. [13] Turner S. The HEP Test for Grading Web Site Usability [J]. Computers in Libraries, 2002, 22 (10): 37-39. [14] Palmer J W. Web Site Usability, Design, and Performance Metrics [J]. Information Systems Research, 2002, 13 (2): 151- 167. [15] Tarafdar M, Zhang J. Analyzing the Influence of Web Site Design Parameters on Web Site Usability [J]. Information Resources Management Journal, 2005,18(4):62-80. [16] Rosen D E, Purinton E, Lloyd S J. Web Site Design: Building a Cognitive Framework [J]. Journal of Electronic Commerce in Organizations, 2004, 2 (1): 15 - 28. [17] Buzzi M, Andronico P, Leporini B. Accessibility and Usability of Search Engine Interfaces: Preliminary Testing . http://ui4all.ics.forth.gr/workshop2004/files/ui4all_proceedings/ adjunct/accessibility/58.pdf. [18] Rosen D E. Reconciling Information-Seeking Behavior with Search User Interfaces for the Web [J]. Journal of the American Society for Information Science and Technology, 2006, 57(6): 797-799. [19] Sutcliffe A. Assessing the Reliability of Heuristic Evaluation for Website Attractiveness and Usability . In: Proceedings of the 35th Annual Hawaii International Conference on System Sciences, Hawaii, USA.2002 (5):137. [20] 清华大学IT可用性实验室搜索引擎评估报告 . http://news.ccidnet.com/art/951/20040702/127264_1.html. [21] 2005中文搜索引擎质量对比 . http://news.xinhuanet.com/it/2005-11/21/content_3812695.htm. [22] 风笑天.社会学研究方法[M].北京:中国人民大学出版社,2005: 97-99.
