| This dissertation presents the results of research that led to the development of a complete, fully functional, image search and retrieval system with relevance feedback capabilities, called MUSE (MUltimedia SEarch and Retrieval Using Relevance Feedback).; Two different models for searching for a target image using relevance feedback have been proposed, implemented, and tested. The first model uses a color-based feature vector and employs a Bayesian learning algorithm that updates the probability of each image in the database being the target based on the user's actions. The second model uses cluster analysis techniques, a combination of color-, texture-, and edge(shape)-based features, and a novel approach to learning the user's goals and the relevance of each feature for a particular search.; Both models follow a purely content-based image retrieval paradigm. The search process is based exclusively on image contents automatically extracted during the (off-line) feature extraction stage. Moreover, they minimize the number and complexity of required user's actions, in contrast with the complexity of the underlying search and retrieval engine. Results of experiments show that both models exhibit good performance for moderate-size, unconstrained databases and that a combination of the two outperforms any of them individually, which is encouraging.; In the process of developing this dissertation, we also implemented and tested several image features and similarity measurement combinations. The result of these tests—performed under the query-by-example (QBE) paradigm—served as a reference in the choice of which features to use in the relevance feedback mode and confirmed the difficulty in encoding the understanding of image similarity into a combination of features and distances without human assistance.; Most of the code written during the development of this dissertation has been encapsulated into a multifunctional prototype that combines image searching (with or without an example), browsing, and viewing capabilities and serves as a framework for future research in the subject. |
