Research on Image Semantic Mapping with Multiple-Reservoirs Echo State Network
Wang Huaqiu1, Wang Bin1, Nie Zhen2
1 College of Computer Science and Engineering, Chongqing University of Technology, Chongqing 400054, China;
2 Chongqing University of Technology Library, Chongqing 400054, China
[Objective] The mapping between low-level visual feature and high-level semantic information is built up to fill the “semantic gap” of image retrieval and improve accuracy. [Methods] Referring to the idea of ensemble learning, Multiple-Reservoirs Echo State Networks (MESN) is applied to semantic mapping model. After the low-level visual features of images are divided by feature types and trained by different reservoirs, the training results are combined linearly. [Results] Compared to BP Neural Network and traditional Echo State Network, the average error rate of MESN decreases by 31.64% and 19.28% respectively, the precision rate increases 4.56% and 1.86% respectively. [Limitations] The parameters of reservoirs are set artificially. Parameter optimization algorithm isn't constructed. [Conclusions] Experimental results show that the semantic mapping model of Echo State Networks with Multiple-Reservoirs is effective.
王华秋, 王斌, 聂珍. 一种应用多储备池回声状态网络的图像语义映射研究[J]. 现代图书情报技术, 2015, 31(6): 41-48.
Wang Huaqiu, Wang Bin, Nie Zhen. Research on Image Semantic Mapping with Multiple-Reservoirs Echo State Network. New Technology of Library and Information Service, 2015, 31(6): 41-48.
[1] Gudivada V N, Raghavan V V. Content-based Image Retrieval System [J]. IEEE Computer, 1995, 28(9): 18-22.
[2] Smeulder A W M, Worring M, Santini S, et al. Content-based Image Retrieval at the End of the Early Years [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(12): 1349-1380.
[3] Li J, Huang S, He R, et al. Image Classification Based on Fuzzy Support Vector Machine [C]. In: Proceedings of the 2008 International Symposium on Computational Intelligence and Design, Wuhan, China. 2008: 68-71.
[4] Kundu M K, Chowdhury M. Image Retrieval Using NN Based Pre-classification and Fuzzy Relevance Feedback [C]. In: Proceedings of the 2010 Annual IEEE India Conference (INDICON), Kolkata, India. 2010: 1-4.
[5] 杨栋, 周秀玲, 郭平.基于贝叶斯通用背景模型的图像标注[J]. 自动化学报, 2013, 39(10): 1674-1680. (Yang Dong, Zhou Xiuling, Guo Ping. Image Annotation with Bayesian Universal Background Model [J]. Acta Automatica Sinica, 2013, 39(10): 1674-1680.)
[6] Manjunath B S, Ohm J R, Vasudevan V V, et al. Color and Texture Descriptors [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(6): 703-715.
[7] Alexandre L A, Embrechts M J, Linton J. Benchmarking Reservoir Computing on Time-independent Classification Tasks [C]. In: Proceedings of the 2009 International Joint Conference on Neural Networks, Atlanta, GA, USA. 2009: 89-93.
[8] 郭嘉, 雷苗, 彭喜元. 基于相应簇回声状态网络静态分类方法[J]. 电子学报, 2011, 39(3): 14-18. (Guo Jia, Lei Miao, Peng Xiyuan. Echo State Networks for Static Classification with Corresponding Clusters [J]. Acta Electronica Sinica, 2011, 39(3): 14-18.)
[9] Stricker M A, Orengo M. Similarity of Color Images [C]. In: Proceedings of the SPIE Storage and Retrieval for Image and Video Databases III, 1995: 381-392.
[10] Haralick R M, Shangmugam K, Dinstein Its'Hak. Texture Feature for Image Classification [J]. IEEE Transactions on Systems, Man and Cybernetics, 1973, SMC-3(6): 610-621.
[11] Gabor D. Theory of Communication [J]. IEE, 1946, 93(3): 429-457.
[12] Jaeger H. The “Echo State” Approach to Analysing and Training Recurrent Neural Networks [R]. German National Reasearch Center for Information Technology, 2001.
[13] 郭嘉. 回声状态网络分类方法及其应用研究[D]. 哈尔滨: 哈尔滨工业大学, 2011. (Guo Jia. Research on Echo State Networks Classification Algorithm and Application [D]. Harbin: Harbin Institute of Technology, 2011. )
[14] 彭喜元, 郭嘉, 王建民.基于随机子空间与多储备池的分类方法[J]. 仪器仪表学报, 2011, 32(11): 2487-2492. (Peng Xiyuan, Guo Jia, Wang Jianmin. Random Subspace and Multiple Reservoirs Based Classifier [J]. Chinese Journal of Scientific Instrument, 2011, 32(11): 2487-2492.)
[15] 唐耀华, 高静怀, 包乾宗. 一种新的选择性支持向量机集成学习算法[J]. 西安交通大学学报, 2008, 42(10): 1221-1225. (Tang Yaohua, Gao Jinghuai, Bao Qianzong. Novel Selective Support Vector Machine Ensemble Learning Algorithm [J]. Journal of Xi'an Jiaotong University, 2008, 42(10): 1221-1225.)
[16] 张春霞, 张讲社. 选择性集成学习算法综述[J]. 计算机学报, 2011, 34(8): 1399-1410. (Zhang Chunxia, Zhang Jiangshe. A Survey of Selective Ensemble Learning Algorithms [J]. Chinese Journal of Computers, 2011, 34(8): 1399-1410.)
[17] Jaeger H, Lukoevicius M, Popovici D, et al. Optimization and Applications of Echo State Networks with Leaky-Integrator Neurons [J]. Neural Networks, 2007, 20(3): 335-352.
[18] Image Rank Machine [DB/OL]. [2014-09-15]. http://www. ci.gxnu.cn/cbir.
