Recent years, the efficiency and accuracy of content based on image retrieval (CBIR) are two research directions. In order to improve retrieval precision, firstly, we use a fusion framework, combined with Color Difference Histogram (CDH) and Micro-structure Descriptor (MSD) which are two kinds of image descriptors to calculate distances between all images and transform the distances between images into similarities. Then we utilize the similarities to construct a similarity matrix. Secondly, by using the similarity matrix, we construct a hypergraph, the hypergraph combined with relevance feedback technique is exploited to rank images and get similar images. Extensive experiments are carried out on the Corel-5K dataset and get a very good performance.