Video2Sentence and Vice Versa

Open Access
Authors
Publication date 2013
Book title MM '13
Book subtitle proceedings of the 2013 ACM Multimedia Conference : October 21-25, 2013, Barcelona, Spain
ISBN
  • 9781450324045
Event 2013 ACM Multimedia Conference
Volume | Issue number 1
Pages (from-to) 419-420
Publisher New York: ACM
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
In this technical demonstration, we showcase a multimedia search engine that retrieves a video from a sentence, or a sentence from a video. The key novelty is our machine translation capability that exploits a cross-media representation for both the visual and textual modality using concept vocabularies. We will demonstrate the translations using arbitrary web videos and sentences related to everyday events. What is more, we will provide an automatically generated explanation, in terms of concept detectors, on why a particular video or sentence has been retrieved as the most likely translation.
Document type Conference contribution
Language English
Published at https://doi.org/10.1145/2502081.2502249
Other links http://www.science.uva.nl/research/publications/2013/HabibianICM2013
Downloads
p419-habibian (Final published version)
Permalink to this page
Back