edoc

Competitive Interactive Video Retrieval in Virtual Reality with vitrivr-VR

Spiess, Florian and Gasser, Ralph and Heller, Silvan and Rossetto, Luca and Sauter, Loris and Schuldt, Heiko. (2021) Competitive Interactive Video Retrieval in Virtual Reality with vitrivr-VR. In: MultiMedia Modeling, 12573. Cham, pp. 441-447.

[img] PDF - Accepted Version
260Kb

Official URL: https://edoc.unibas.ch/87079/

Downloads: Statistics Overview

Abstract

Virtual Reality (VR) has emerged and developed as a new modality to interact with multimedia data. In this paper, we present vitrivr-vr, a prototype of an interactive multimedia retrieval system in VR based on the open source full-stack multimedia retrieval system vitrivr. We have implemented query formulation tailored to VR: Users can use speech-to-text to search collections via text for concepts, OCR and ASR data as well as entire scene descriptions through a video-text co-embedding feature that embeds sentences and video sequences into the same feature space. Result presentation and relevance feedback in vitrivr-VR leverages the capabilities of virtual spaces.
Faculties and Departments:05 Faculty of Science > Departement Mathematik und Informatik > Informatik > Databases and Information Systems (Schuldt)
UniBasel Contributors:Schuldt, Heiko and Spiess, Florian and Gasser, Ralph and Heller, Silvan and Rossetto, Luca and Sauter, Loris
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Publisher:Springer
ISBN:978-3-030-67834-0
e-ISBN:978-3-030-67835-7
Series Name:Lecture Notes in Computer Science
ISSN:0302-9743
e-ISSN:1611-3349
Note:Publication type according to Uni Basel Research Database: Conference paper
Language:English
Identification Number:
edoc DOI:
Last Modified:20 Apr 2022 09:03
Deposited On:20 Apr 2022 09:03

Repository Staff Only: item control page