S.V.university, MTech , S.V.University,
Tirupathi . Tirupathi
[email protected] [email protected]
Abstract- In content-based image retrieval (CBIR), color and texture are the most intuitive image features and it is widely used. But the current color feature can describe the semantics of the whole image effectively, but does not reflect characteristics of the color salience objects in an image. For the purpose of giving paper proposes a new color feature description model is proposed at first. This model integrates the intensity, the color contrast and self-saliency, sparsity and centricity saliency to describe human color visual perception of the image. Then, the new color feature descriptor is calculated by weighting the significant bit-plane histograms with color perception map. Finally, similarity measure is presented for the new color feature. Then for more efficient retrieval again the retrieved images are then compared for texture .Now because of the texture of salience retrieved image more accurate images can be retrieved. Experiment results show that the proposed color feature and texture feature is more accurate and efficient in retrieving images with user-interested color objects. Here a typical query can be a region of interest provided by the user, such as outlining patch in satellite image. Compared with the other retrieval methods, the proposed technique improves the retrieval accuracy effectively.
Firstly,the color at present, with the rapid expansion of the digital images amount, users want to be able to find images quickly and accurately from a large number of digital images. For this purpose, content- based image retrieval (CBIR, Content-Based Image Retrieval) has become one of the hot research fields in image databases. Image features extraction and expression are the basis of content –based image retrieval technology. Image features include color, texture, shape and spatial relations, etc. color feature not only closely related to objects and scenes in an image, but also are less dependent on image size, orientation, and camera angle. Color feature has a high robustness. Common representation of color features include color histogram , color moment  and dominant color  etc. Among them, the color histogram feature extraction and similarity calculation is simple, and it is insensitive to the image scale and rotation. Therefore, the color histogram became the most widely used color features in images retrieval system. However, the traditional color histogram’s problems are susceptible to noise interference, high feature dimensions, lack of color spatial distribution information. For these problems,proposed a color block-histogram to fuse color spatial distribution information . This method divides the image into several blocks, and calculates the color histogram of each block. It is simple and can reflect some color spatial information. But it does not have the translation and rotation invariance. Reference presents the image significant bit-plane color histogram method to solve problems of susceptible to noise interference and high feature dimensions. But the significant bit-planes is global characteristic of an image that associated with the entire image, it lack color local spatial information and does not reflect the significant objects in image. Therefore, the current color feature effectively describes the semantics of the whole image, but does not reflect the human color salience objects in an image. According to visual physiology and visual psychology theories, the human visual perceptual system tends to show different sensitivity to different colors. So  presents color visual function to improve retrieval accuracy. But color visual function is also for the entire image, it can’t inhibit the effects of background characteristics in retrieval accuracy effectively. In order to emphasis color characteristics and inhibit background in image. It will greatly improve the image retrieval accuracy.
This paper analyzes the process of human color visual perception model based on visual saliency. Integrated color perception model based on visual saliency. Integrated color perception map is calculated and weighted for static significant bit-plane histograms. New color feature to represent the image content. The proposed feature is not only insensitive to noise interference, image scale and rotation, but also describes the color spatial distribution information of salience objects. It closes to distribution information of the image and can improve the retrieval performance effectively.
Secondly, the saliency color information is obtained and then the texture pattern focuses on a multiresolution representation based on gabor filters. The use of gabor filters in extracting textured image features is motivated by various factors. The gabor representation has been shown to be optimal in the sense of minimizing the joint two-dimensional uncertainty in space and frequency .These filters can be considered as orientation and scale tunable edge and line(bar) detectors and the statistics of these microfeatures in a given region are often used to characterize the underlying texture information. Gabor features have been used in several image analysis applications including texture classification and segmentation,, image recognition, image registration, and motion tracking.
The rest of the paper is organized as follows. A color visual perception model for image retrieval is introduced in section 2. In section 3, color visual perception calculation is presented in detail including features saliency calculation, normalization and synthesis. Section 4 and 5 give the new color feature descriptor and the similarity measurement respectively. Texture Feature extraction in section6 The experiment results and analysis are presented in section 7. Conclusions are drawn in section 8.
II.COLOR VISUAL PERCEPTION MODEL
Visual psychology research shows that when people observe an image, not all of all of the ingredients of which have the same interest. Those who can produce a strong stimulation and stimulation of people look forward to the scene area prone to observer’s attention. The classic is the Koch and Ullman’s neurobiology structural framework on the basis of feature integration theory . Based on this framework, some simulation models have been proposed to quantify the human visual perception characteristics. The most representative model is the Itti’s visual saliency model. Itti’s model uses color, direction and intensity to measure visual saliency. It generates an integrated visual salience map- to represent the stimulation of an image to eyes in case of no available prior information exists. And then it quantifies the salience of each pixel of the image under the combination of various properties. The model is robust when dealing with noise, fuzzy, contrast and intensity ,. In color respect, it uses the color contrast of RG, BY channels in the RGB space to describe color perception characteristics. But the RG, BY channels cannot fully describe the color stimulation of the human eyes.
Previous research shows that the HSV color space has much better visual consistency than traditional RGB space. The intensity component of HSV space has nothing to do with the color information. Hue component and saturation component approach human observation. Based on human color vision theory, color visual saliency can be divided into contrast saliency and self-saliency. Self-saliency describes the internal advantage of features which can individually generate stimulation to the human eyes. Contrast saliency describes the difference between the object and back ground. Accordingly, the color features of image are also divided into contrast and self-saliency. Considering the following six factors , we propose a color visual perception model based on Itti’s.
1) Intensity contrast
The change of image brightness makes the stronger contrast.
2) Hue contrast
Different hues in different color ring of the image can stimulate human’s eyes. Obviously, a big hue angle difference can form stronger color contrast. In hue ring, the biggest difference is 1800.
3) Saturation contrast
Different saturation of an image forms contrast. Color saturation difference determines the contrast strength.
4) Warm color self-saliency
For the warm colors such as red, yellow and orange, etc., the human eyes can produce more stimulation than the other colors. These colors angles are less than 450.
5) Intensity and saturation self-saliency
High brightness and high saturation more easily attract the attention of eyes .
Intensity contrast, hue contrast and saturation contrast are called color contrast saliency. Warm color self-saliency, intensity and saturation self-saliency are called color self-saliency.
6) sparsity and centricity
Taking into account the general case, a complex area in the image should be the attention focus. However, if the image is full of complex textures, a simple goal should be the attention focus. The area of the image center easily attracts human's attention. These are called sparsity and centricity.
The proposed color visual perception model is showed in Fig.1.This model calculates color features in terms of contrast and self-saliency, integrates the color, intensity, sparsity and centricity saliency to describe the human color visual perception in the image.
III.COLOR VISUAL PERCEPTION CALCULATION
A.Features saliency calculation
The intensity, hue and saturation features of image cannot be used to describe contrast saliency directly. In order to strengthen novel stimulus and weaken the ordinary stimulus, the pixel’s global saliency can be described by calculating the mean difference of each pixel with other pixels in the entire image. For the novel stimulus, there are more pixels which have large difference. Thus, the average of difference is large. For the ordinary stimulus, there are more pixels which have small difference. So, the average of difference is small. The global color contrast saliency is calculated as follows:
(i=1, 2,3) ….(2)
iWhere F ( x, y) (i = 1, 2, 3) denote intensity, hue, saturation features of the ( x, y) in the image. DS (x, y) is the global feature difference, M and N respectively is the row number
And the column number of image. is the mean of global feature difference. Si(x,y) is the global color contrast saliency of feature Fi (x,y).
Global color self-saliency is described by the following
Where A is the amplification factor, F1 and F3 normalize to [0,1].F2 normalizes to [0.2∏].Let sparsity saliency is S6(g), where g is the image intensity value . The specific formula is as follows:
where f(g) is the frequency of intensity value g in image ,d(g) is calculated as follows :
Where max(g) is maximum brightness of the image . If the difference of the gray value g between pixels in the image is larger, d(g) is smaller. Therefore, sparsity saliency is greater.
Centricity saliency is calculated as follows:
Where () is the image center coordinates.If pixel is close to the center position of the image, its centricity saliency is big.
B.Normalized and synthesis
Because the range of saliencies is different, saliencies values must be normalized to the same range. We regularize those saliency features by the normalization operator N(x). Seven saliency features are normalized by the normalization operator N(x) and combined into the final global integrated color vision perception map S(x,y). Linear weighting is used for different features. The specific formulas are as follows:
Where CNum is the number of the saliency feature categories (CNum=7 in our approch), Wi is the weight of the feature and it meets the constraint formula (9).
IV.COLOR RETRIEVAL FEATURE EXTRACTION
Taking into account the image subjected to noise attacks such as light, sharpen, blur, etc., its low bit-planes changed little. Therefore, uses significant bit-planes to solve problems that the traditional color histogram feature dimension is too high, cannot effectively retrieve images with noise. So the color histogram feature dimension is too high, cannot effectively retrieve images with noise. So the color histograms based on significant bit-planes are used in the proposed new color feature. First, image’s highest 5 bit-planes(these are significant bit-planes) are extracted in RGB space , total of 15 significant bit-planes. Significant bit planes integrated into new color value (in the range of 0 to 7). Through statistic frequency of each new color value, the significant bit-plane image color histogram is calculated. Then, weighting the significant bit-plane histograms with color visual perption map, the new color feature descriptor integrates the color spatial distribution, local correlation, frequency information and the object saliency to express the image’s content. It is calculated as follows:
Where hk(c)(c=0,1,…..7) denotes the frequency which colors c appears in significant bit-plane k.Vk(x,y)
Is the pixel (x,y) color value in significant bit-plane k. To make the new color feature does not change with scale, it needs to be normalized by formula (11).
V. THE SIMILARITY MEASUREMENT
A typical objective measure reflects similarity degree between the query example image and an image in database. The distance formula  between histograms is often used to represent similarity. Obviously, the small distance represents the similarity. There are many formulas which represent the similarity of histograms. For the new color feature descriptor, distance Dist.(Q,I) is used for similarity measure. The formula is as follows:
Where Q is query example image, and an image in database is I. are the normalized new color features in significant bit-plane k of image Q and I respectively. is the weight of bit-plane reflects the outlines information of objects in image, so the larger weight is assigned to the higher bit-plane. In our experiments, are assigned as 0.1, 0.1, 0.25, 0.25, and 0.3. We sums distances of bit-planes features to express new color feature distance. Image retrieval results are returned in accordance with the descending order of similarity.
VI. TEXTURE FEATURE EXTRACTION
Now the color retrieved images from the database are again gone through the texture retrieval by using following technic
A.Gabor functions and wavelets
A two dimensional Gabor function g(x,y) and its Fourier transform G(u,v)can be written as:
Gabor functions form a complete but nonorthogonal basis set.Expanding a signal using this basis provides a localized frequency description.A class of self-similar functions, reffered to as Gabor wavelets in the following discussion, is now considered . Let g(x,y) be the mother Gabor wavlet, then this self-similar filter dictionary can be obtained by appropriate dilations and rotations of g(x,y) though the generating function:
Where and k is the total nu,ber of orientations. The scale factor in (16) is meant to ensure that the energy is independent of m.
B.Gabor filter Dictionary Design
The non orthogonality of the Gabor wavelets implies that there is redundant information in the filtered images, and the following strategy is used to reduce this redundancy. Let ul and uh denote the lower and upper center frequencies of interest. Let K be the number of orientations and S be the number of scales in the multiresolution decomposition. Then design strategy is to ensure that the half-peak magnitude support of the filter responses in the frequency spectrum touch each other as shown in fig2. This results in the following formulas for computing the filter parameters σu and σv (and thus σx and σy).
Where W=Uh and m=0,1,…,S-1. In order to eliminate sensitivity of the filter response to absolute intesity values, the real(even) components of the 2D Gabor filters are biased by addding a constant to make them zero mean(This can also be done by setting G(0,0) in (15) to zero).
Fig(2). The contours indicate the half-peak magnitude of the filter resposes in the gobar filter dictionary. The filter parameters used are Uh= 04, Ul= 0.05, K=6 and S=4.
Given an image I(x,y), its Gabor wavelet transform is then defined to be
Where * indicates the complex conjugate. It is assumed that the local texture regions are spatially homogeneous, and the mean µmn and the standard deviation σmn of the magnitude of the transform coefficients are used to represent the region for classification and retrieval purposes:
A feature vector is now constructed using µmn and σmn as feature components. In the experiments, we use four scales S=4 and six orientations k=6, resulting in a feature vector
Consider two image patterns I and j, and let and represent the corresponding feature vectors. Then the distance between the two patterns in the feature space is defined to be
α(μmn) and α(σmn) are the standard deviations of the respective features over the entire database, and are used to normalize the individual feature components.
D.1 Texture Database
The texture database used in the experiments consists of different texture classes. Each image is nonoverlapping subimages, thus creating a database of different texture images. This pattern is then processed to compute the feature vector as in (20). The distance d(i,j), where I is the query pattern and j is a pattern from the database, is computed. The distances are then sorted in increasing order and the closest set of patterns are then retrieved. In the ideal case all the top 15 retrievals are from the same large image. The performance is measured in terms of the average retrieval rate which is defined as the average percentage number of patterns belonging to the same image as the query pattern in the top 15 matches.
We observe that the use of σmn feature in addition to the mean improves the retrieval performance considerably. This perhaps explains the low classification rate of the Gabor filters reported in  where only the mean value was used. On the average 74.37% of the correct patterns are in the top 15 retrieved images. The performance increases to 92% if the top 100(about 6% of the entire database) retrievals are considered instead(ie., more than 13 of the correct patterns are present).
fig(3) (a)query image (b)images retrieved after color visual perception map. (c)images retrieved after applying texture retrieval by gabor filter to color retrieved.
This paper analyses the process of human color visual perception. The color visual perception model is presented based on visual saliency. It integrates the color, intensity, sparsity and centricity saliency to form a color perception map. A new color feature descriptor based on color visual perception is proposed. It can highlight the significant objects, inhibit background characteristics in image, and a texture then applied to the saliency color retrieved image which effectively improves retrieval precision ratio. The experiment results show that the proposed approach has a good performance and it is particularly applicable to retrieving the image with salience color objects such as in large images in internet to remove unwanted images, satellite patches for finding percentage of vegetation in world and also in knowing the presence of rear species of animals present in the surface of the earth and so on. Retrieval results can be closer to human color visual perception effectively.