%A Ren Xiaoyan,Kang Xiaojun,Zhang Hongwei %T Web Crawler’s Design and Implementation Based on Dynamic Tunneling %0 Journal Article %D 2008 %J Data Analysis and Knowledge Discovery %R 10.11925/infotech.1003-3513.2008.06.16 %P 83-87 %V 24 %N 6 %U {https://manu44.magtech.com.cn/Jwk_infotech_wk3/CN/abstract/article_532.shtml} %8 2008-06-25 %X

 Based on analysis of the traditional Web Crawlers’ searching mechanics,this paper combines the tunneling and Web page division with Web Crawler’s searching strategy. Then a dynamic tunneling Web Crawler’s searching algorithm is proposed. Experiments in four university Websites are carried out in allusion to “education resources”, and results show that the new algorithm outperforms two standard crawlers for focused crawling.