Project information
Centrum pro multi-modální interpretaci dat velkého rozsahu
- Project Identification
- GBP103/12/G084 (kod CEP: GBP103/12/G084)
- Project Period
- 1/2012 - 12/2018
- Investor / Pogramme / Project type
-
Czech Science Foundation
- Projects to promote excellence in basic research
- MU Faculty or unit
-
Faculty of Informatics
- prof. Ing. Pavel Zezula, CSc.
- RNDr. Michal Batko, Ph.D.
- doc. RNDr. Vlastislav Dohnal, Ph.D.
- RNDr. David Novák, Ph.D.
- Cooperating Organization
-
Charles University
- Responsible person RNDr. Pavel Pecina, Ph.D.
- Responsible person prof. Ing. Josef Psutka, CSc.
- Responsible person prof. Ing. Jiří Matas, Ph.D.
The project aims at exploiting large collections of unlabeled multi-modal data, mainly video footage, to further state-of-the-art in video, audio and natural language understanding, interpretation, annotation and retrieval by combining unsupervised and semi-supervised learning. It will address problems that are very difficult (some probably impossible) to solve in a single modality by adopting an interdisciplinary approach. Progress in individual research areas - vision, natural language processing and speech will be achieved by co-training and by exploiting results of other modalities as cross-training data. For efficient processing of large data collections appearing in all modalities, the project will also concern generic problems of organization, indexing, and searching based on similarity that is fundamental for building real-life applications.
Publications
Total number of publications: 49
2015
-
Improving Kinect-Skeleton Estimation
Advanced Concepts for Intelligent Vision Systems (ACIVS 2015), LNCS 9386, year: 2015
-
Improving Sketches for Similarity Search
Tenth Doctoral Workshop on Mathematical and Engineering Methods in Computer Science (MEMICS'15), year: 2015
-
MDPV - Metric Distance Permutation Vocabulary
Information Retrieval, year: 2015, volume: 18, edition: 1, DOI
-
Model for Performance Analysis of Distributed Stream Processing Applications
Database and Expert Systems Applications, year: 2015
-
Motion Images: An Effective Representation of Motion Capture Data for Similarity Search
Proceedings of 8th International Conference on Similarity Search and Applications (SISAP 2015), LNCS 9371, year: 2015
-
Multi-modal Similarity Retrieval with a Shared Distributed Data Store
Scalable Information Systems: 5th International Conference, INFOSCALE 2014, Seoul, South Korea, September 25-26, 2014, Revised Selected Papers, year: 2015
-
Scalable Similarity Search for Big Data - Challenges and Research Objectives
Scalable Information Systems - 5th International Conference, year: 2015
-
Search-based image annotation: Extracting semantics from similar images
Experimental IR Meets Multilinguality, Multimodality, and Interaction - 6th International Conference of the CLEF Association, CLEF 2015, year: 2015
-
Similarity Searching for the Big Data Challenges and Research Objectives
MOBILE NETWORKS & APPLICATIONS, year: 2015, volume: 20, edition: 4, DOI
2014
-
CLAN Photo Presenter: Multi-modal Summarization Tool for Image Collections
Proceedings of ICMR 2014, year: 2014