Image retrieval based on micro-structure descriptor

1 Pattern Recognition 44 (2011) 2123 2133. Contents lists available at ScienceDirect Pattern Recognition journal homepage: Image retrieval based on micro - structure descriptor Guang-Hai Liu a,n, Zuo-Yong Li b, Lei Zhang c, Yong Xu d a College of Computer Science and Information Technology, Guangxi Normal University, Guilin 541004, China b Department of Computer Science, Minjiang University, Fuzhou 350108, China c Department of Computing, the Hong Kong Polytechnic University, Hong Kong, China d Bio-Computing Research Center, Shenzhen Graduate School, Harbin Institute of Technology.

2 China a r t i c l e i n f o abstract Article history: This paper presents a simple yet ef cient Image retrieval approach by proposing a new Image feature Received 12 October 2010 detector and descriptor , namely the micro - structure descriptor (MSD). The micro -structures are de ned Received in revised form based on an edge orientation similarity, and the MSD is built based on the underlying colors in micro - 30 January 2011. structures with similar edge orientation. With micro -structures serving as a bridge, the MSD extracts Accepted 2 February 2011.

3 Available online 7 February 2011. features by simulating human early visual processing and it effectively integrates color, texture, shape and color layout information as a whole for Image retrieval . The proposed MSD algorithm has high Keywords: indexing performance and low dimensionality. Speci cally, it has only 72 dimensions for full color Image retrieval images, and hence it is very ef cient for Image retrieval . The proposed method is extensively tested on HSV color space Corel datasets with 15,000 natural images.

4 The results demonstrate that it is much more ef cient and Edge orientation effective than representative feature descriptors, such as Gabor features and multi-textons histogram, micro - structure micro - structure descriptor for Image retrieval . Crown Copyright & 2011 Published by Elsevier Ltd. All rights reserved. 1. Introduction and shape features cannot suf ciently represent Image semantics, recently semantic- based Image retrieval techniques have been Images and graphics are among the most important media explored [1].

5 Nonetheless, due to the limitations of current formats for human communication and they provide a rich arti cial intelligence and related techniques, semantic- based amount of information for people to understand the world. With Image retrieval is still an open problem. So far, CBIR is the most the rapid development of digital imaging techniques and internet, important and effective Image retrieval method and CBIR systems more and more images are available to public. Consequently, are being widely studied in both academia and industry.

6 There is an increasingly high demand for effective and ef cient It is known that human visual attention is enhanced through a Image indexing and retrieval methods, and Image retrieval has process of competing interactions among neurons, which selects a become one of the most popular topics in the eld of pattern few elements of attention and suppresses irrelevant materials [2]. recognition and arti cial intelligence. An Image retrieval system There are close relationships between low-level visual features is a computer system for browsing, searching and retrieving and human visual attention system, and hence the research on images from a large volume of digital images.

7 Generally speaking, how to use visual perception mechanism for Image retrieval is an there are three categories of Image retrieval methods, , text- important yet challenging problem. In order to extract features based , content- based and semantic- based methods. via simulating visual processing procedures and effectively inte- The origin of text- based approaches for Image retrieval can be grate color, texture, shape features and Image color layout traced back to 1970s. However with the widely spread digital information as a whole for Image retrieval , in this paper we imaging devices, textual annotation of images becomes imprac- propose a novel feature detector and descriptor , namely micro - tical and inef cient for Image representation and retrieval .

8 Con- structures descriptors (MSD), to describe Image features via tent- based Image retrieval (CBIR) was then emerging in 1980s [1]. micro -structures. In the past three decades, researchers have successfully devel- The micro -structures are de ned by computing edge orienta- oped many CBIR systems, including QIBC, MARS, Virage, Photo- tion similarity and the underlying colors, which can effectively book, FIDS, Web Seek, Netra and SIMPLI city. Since color, texture represent Image local features. The underlying colors refer to those colors that have similar edge orientation, and they can mimic human color perception well.

9 With micro -structures ser- n Corresponding author. : + 86 0773 5811621. ving as a bridge, the MSD can extract and describe color, texture E-mail addresses: ( Liu), and shape features simultaneously. The MSD has advantages of (L. Zhang). both statistical and structural texture description approaches. 0031-3203/$ - see front matter Crown Copyright & 2011 Published by Elsevier Ltd. All rights reserved. 2124 Liu et al. / Pattern Recognition 44 (2011) 2123 2133. In addition, the MSD algorithm simulates human visual percep- The idea of applying visual attention mechanism to Image tion mechanism to some extent.

10 Our experiments on large-scale retrieval and pattern recognition has been receiving increasing datasets show that the MSD achieves higher retrieval precision attention over the past 30 years. Treisman [26] proposed a than representative texture feature descriptors, such as Gabor hypothesis about the role of focused attention, and the feature- feature [3] and our previous work called multi-textons histogram integration theory of attention suggests that attention must be (MTH) [4], for Image retrieval . directed serially to each stimulus in a display whenever conjunc- The rest of this paper is organized as follows.