Please wait a minute...
Data Analysis and Knowledge Discovery
Current Issue | Archive | Adv Search |
Research on context awareness-based scene mobile visual search model for narrative murals
Sun shouqiang,Li Qingqing,Xiao Shuyue
School of Information Management, Wuhan University, Wuhan, 430072, China
Download:
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] Narrative murals contain rich story scenes, which are important for users to understand the content of murals. However, traditional search methods focus on the retrieval of association semantics and similar images, ignoring the importance of context information. In order to solve the problem of convenient retrieval and scene perception for narrative murals, this paper constructs a scene mobile visual search model for narrative murals based on context awareness.

[Methods] Combining context awareness theory and information foraging theory, this paper constructs a context graph of murals with contexts as elements. Global and local visual features of murals are extracted by multiple models, and feature matching is conducted through dot-product. In specific contexts, context association is carried out based on the context graph to achieve scene retrieval that is easy for users to perceive and understand.

[Results] When searching for time, place, person and event-associated murals, the mean value of mAP of the proposed model in this paper is 0.840, which is better than models such as VGG16/BOW_KAZE/HOG.

[Limitations] The influence of the scenario the user is in on the search intent is ignored. [Conclusions] A narrative mural-oriented context awareness mobile visual search model was developed, achieving scene-aware mural resource retrieval and exploring the developmental trajectory of scene retrieval.

Key words Context awareness      Context computing      Information foraging theory      Mobile visual search      
Published: 19 April 2024
ZTFLH:  TP391.3  

Cite this article:

Sun shouqiang, Li Qingqing, Xiao Shuyue. Research on context awareness-based scene mobile visual search model for narrative murals . Data Analysis and Knowledge Discovery, 0, (): 1-.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2023.1154     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y0/V/I/1

[1] Qi Yunfei,Zhao Yuxiang,Zhu Qinghua. Linked Data for Mobile Visual Search System of Digital Library[J]. 数据分析与知识发现, 2017, 1(1): 81-90.
[2] Lu Xiaoming. Research on a Lightweight Academic Library Context-aware Recommendation Service Platform Based on GimbalTM[J]. 现代图书情报技术, 2015, 31(3): 101-107.
[3] Yang Yang,Zhang Xinmin. Advance in Information Foraging Theory[J]. 现代图书情报技术, 2009, 3(1): 73-79.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn