Concept-based video retrieval [electronic resource] / by Cees G.M. Snoek and Marcel Worring.

Hanover, Mass. : Now Publishers, c2009.

1 electronic text (p. [215]-322 : col. ill.) : digital file.

Access is available to the Yale community.

Title from PDF (viewed on July 23, 2009).

Access restricted by licensing agreement.

In this paper, we review 300 references on video retrieval, indicating when text-only solutions are unsatisfactory and showing the promising alternatives which are in majority concept-based. Therefore, central to our discussion is the notion of a semantic concept: an objective linguistic description of an observable entity. Specifically, we present our view on how its automated detection, selection under uncertainty, and interactive usage might solve the major scientific problem for video retrieval: the semantic gap. To bridge the gap, we lay down the anatomy of a concept-based video search engine. We present a component-wise decomposition of such an interdisciplinary multimedia system, covering influences from information retrieval, computer vision, machine learning, and human-computer interaction. For each of the components we review state-of-the-art solutions in the literature, each having different characteristics and merits. Because of these differences, we cannot understand the progress in video retrieval without serious evaluation efforts such as carried out in the NIST TRECVID benchmark. We discuss its data, tasks, results, and the many derived community initiatives in creating annotations and baselines for repeatable experiments. We conclude with our perspective on future challenges and opportunities.

Also available in print.

Books / Online

English

July 21, 2010

Includes bibliographical references (p. 302-322).

Cees G. M. Snoek and Marcel Worring (2009) "Concept-Based Video Retrieval", Foundations and Trends in Information Retrieval: Vol. 2: No 4, pp 215-322.

Cees G. M. Snoek and Marcel Worring (2009) "Concept-Based Video Retrieval", Foundations and Trends in Information Retrieval: Vol. 2: No 4, pp 215-322.