edoc

Query by Semantic Sketch

Rossetto, Luca and Gasser, Ralph and Schuldt, Heiko. (2019) Query by Semantic Sketch. arXiv cs.MM.

Full text not available from this repository.

Official URL: https://edoc.unibas.ch/73835/

Downloads: Statistics Overview

Abstract

Sketch-based query formulation is very common in image and video retrieval as these techniques often complement textual retrieval methods that are based on either manual or machine generated annotations. In this paper, we present a retrieval approach that allows to query visual media collections by sketching concept maps, thereby merging sketch-based retrieval with the search for semantic labels. Users can draw a spatial distribution of different concept labels, such as "sky", "sea" or "person" and then use these sketches to find images or video scenes that exhibit a similar distribution of these concepts. Hence, this approach does not only take the semantic concepts themselves into account, but also their semantic relations as well as their spatial context. The efficient vector representation enables efficient retrieval even in large multimedia collections. We have integrated the semantic sketch query mode into our retrieval engine vitrivr and demonstrated its effectiveness.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Informatik > Datenbanken (Schuldt)
UniBasel Contributors:Schuldt, Heiko and Rossetto, Luca and Gasser, Ralph
Item Type:Other
Publisher:arXiv
Number of Pages:11
Note:Publication type according to Uni Basel Research Database: Other publications
Related URLs:
Last Modified:10 Jun 2020 12:15
Deposited On:10 Jun 2020 12:15

Repository Staff Only: item control page