Please wait a minute...
New Technology of Library and Information Service  2007, Vol. 2 Issue (1): 29-32    DOI: 10.11925/infotech.1003-3513.2007.01.07
Current Issue | Archive | Adv Search |
A Design of Distributed News & Weblog Search Engine Based on RSS
Liu Feng   Shi Shuicai   Xiao Shibin   Wang Hongwei
(Chinese Information Processing Research Center, Beijing Information Science & Technology University, Beijing 100101,China)
Download:
Export: BibTeX | EndNote (RIS)      
Abstract  

For the problem of traditional search engine can’t get completed and updated copies of the whole Web in time, especially news and Weblog site with high update frequency, this paper designes a distributed news & Weblog search engine based on RSS syndicated data. Using the pastry protocol, distributed data could be stored and transferred smoothly. This paper also compresses index file with Bloom filter. So the news and Weblog site with high update frequency could be searched in time and the cost of storage could be reduced. The system has a bright future.
Key words： RSS      Pastry      Bloom filter      Distributed search engine     
Received: 11 October 2006      Published: 25 January 2007
: 

TP391

 		 
Corresponding Authors: Liu Feng     E-mail: liu.feng@trs.com.cn
About author:: Liu Feng,Shi Shuicai,Xiao Shibin,Wang Hongwei
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors

Cite this article:

Liu Feng,Shi Shuicai,Xiao Shibin,Wang Hongwei . A Design of Distributed News & Weblog Search Engine Based on RSS. New Technology of Library and Information Service, 2007, 2(1): 29-32.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.1003-3513.2007.01.07     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2007/V2/I1/29

1Balakrishnan H, Kaashoek M, Karger D, Morris R,  Stoica I. Looking Up Data in P2P Systems.Comm. of the ACM, February 2003
2伍玉伟. RSS:网络信息“聚合”利器.图书情报论坛，2006(1) ：72-73
3于忠涛，刘兴伟.Pastry 网络模型的路由机制及改进.西华大学学报自然科学版，2006，25(1) ：27-30
4Ripeanu M.Peer-to-peer Architecture Case Study:Gnutella.In Proceedings of International Conference on P2P Computing, 2001
5Bloom Filter.http://www.nist.gov/dads/HTML/bloomFilter.html(Accessed Aug.18,2006)
6池静，方启泉. Bloom filter 的研究和应用.河北建筑科技学院学报，2003，20(4) ：59-61
[1] Bi Qiang, Bao Yulai. Design and Implementation of Domain Ontology and RSS Based Integrated Portal for Open Access Resource[J]. 现代图书情报技术, 2012, 28(3): 78-82.
[2] Xue Juan. Design and Implementation of Key Subjects Information Push System Based on RSS Technology[J]. 现代图书情报技术, 2010, 26(4): 83-86.
[3] Li Wenjiang,Chen Shiqin. The Design of RSS 2.0 Generating and Parsing Class Library Based on LINQ[J]. 现代图书情报技术, 2009, 25(7-8): 131-135.
[4] Ding Zhenguo,Wu Baogui,Xin Youqiang. Research of large-scale URL Filter Base on Bloom Filter[J]. 现代图书情报技术, 2008, 24(3): 45-50.
[5] Zhou Yan,Ma Jianguo. Design of News Broadcasting System Based on Broadcast-store Grid[J]. 现代图书情报技术, 2007, 2(9): 76-79.
[6] Wu Baogui,Ding Zhenguo. Research of Distributed Search Engine Based on Map/Reduce[J]. 现代图书情报技术, 2007, 2(8): 52-55.
[7] Jiang Enbo . The Service and Technology Based on Information Syndication[J]. 现代图书情报技术, 2007, 2(4): 32-34.
[8] Qian Aibing . Design and Implementation of Focused Web News Aggregator Based on RSS[J]. 现代图书情报技术, 2007, 2(4): 56-61.
[9] Zhang Bei,Zhang Chengyu,Jiang Airong . Application of Ajax and RSS in Personalized Portal Site of the Library[J]. 现代图书情报技术, 2007, 2(3): 65-68.
[10] Gong Weitao,Ma Ziwei. The Digital Library Portal Integration Technology and Implementation[J]. 现代图书情报技术, 2007, 2(11): 23-27.
[11] Liu Li,Xiao Shibin,Wang Tao,Shi Shuicai. Design and Realization of Weblog Gathering System Based on RSS[J]. 现代图书情报技术, 2007, 2(11): 45-48.
[12] Chen Linghui . The Idea and Implementation of RSS-Based Individual Information Service of Information Portal[J]. 现代图书情报技术, 2007, 2(1): 33-36.
[13] Tian Yang . Implementation and Application of an XQuery Processor Based on Free Component of AltovaXML[J]. 现代图书情报技术, 2006, 1(4): 70-73.
[14] Zhang Huier,Zhang Zhixiong,Lin Ying,Li Sa. Implementation of RSS-based Science and Technology  Information Syndication System[J]. 现代图书情报技术, 2005, 21(7): 60-63.
[15] Wang Jiantao. Application of RSS in Information Service of Library[J]. 现代图书情报技术, 2005, 21(7): 86-88.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626，82624938   E-mail:jishu@mail.las.ac.cn