QUEST: towards a multi-modal CBIR framework combining query-by-example, query-by-sketch, and text search

Al Kabary, Ihab and Giangreco, Ivan and Schuldt, Heiko and Matulic, Fabrice and Norrie, Moira. (2013) QUEST: towards a multi-modal CBIR framework combining query-by-example, query-by-sketch, and text search. In: 2013 IEEE international symposium on multimedia (ISM). pp. 433-438.

[img] PDF - Accepted Version

Official URL: http://edoc.unibas.ch/dok/A6183931

Downloads: Statistics Overview


The enormous increase of digital image collections urgently necessitates effective, efficient, and in particular highly flexible approaches to image retrieval. Different search paradigms such as text search, query-by-example, or query-by-sketch need to be seamlessly combined and integrated to support different information needs and to allow users to start (and subsequently refine) queries with any type of object. In this paper, we present QUEST (Query by Example, Sketch and Text), a novel flexible multi-modal content-based image retrieval (CBIR) framework. QUEST seamlessly integrates and blends multiple modes of image retrieval, thereby accumulating the strengths of each individual mode. Moreover, it provides several implementations of the different query modes and allows users to select, combine and even superimpose the mode(s) most appropriate for each search task. The combination of search paradigms is by itself done in a very flexible way: either sequentially, where one query mode starts with the result set of the previous one (i.e., for incrementally refining and/or extending a query) or by supporting different paradigms at the same time (e.g., creating an artificial query image by superimposing a query image with a sketch, thereby directly integrating query-by-example and query-by-sketch). We present the overall architecture of QUEST and the dynamic combination and integration of the query modes it supports. Furthermore, we provide first evaluation results that show the effectiveness and the gain in efficiency that can be achieved with the combination of different search modes in QUEST.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Informatik > Databases and Information Systems (Schuldt)
UniBasel Contributors:Schuldt, Heiko and El-Kabary, Ihab and Giangreco, Ivan
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Publisher:IEEE Computer Society
Note:Publication type according to Uni Basel Research Database: Conference paper
Identification Number:
edoc DOI:
Last Modified:04 May 2018 12:23
Deposited On:25 Apr 2014 08:00

Repository Staff Only: item control page