A Unified Framework for Video Summarization, Browsing & Retrieval

with Applications to Consumer and Surveillance Video


  • Ziyou Xiong, United Technologies Research Center, East Hartford, CT, USA
  • Regunathan Radhakrishnan, Mitsubishi Electric Research Labs, Cambridge, MA, USA
  • Ajay Divakaran, Mitsubishi Electric Research Labs, Cambridge, MA, USA
  • Yong Rui, Microsoft Research, Redmond, WA, USA
  • Thomas Huang, Beckman Institute for Advanced Science and Technology, University of Illinois, Urbana, IL, USA

Large volumes of video content can only be easily accessed by the use of rapid browsing and retrieval techniques. Constructing a video table of contents (ToC) and video highlights to enable end users to sift through all this data and find what they want, when they want are essential. This reference puts forth a unified framework to integrate these functions supporting efficient browsing and retrieval of video content. The authors have developed a cohesive way to create a video table of contents, video highlights, and video indices that serve to streamline the use of applications in consumer and surveillance video applications. The authors discuss the generation of table of contents, extraction of highlights, different techniques for audio and video marker recognition, and indexing with low-level features such as color, texture, and shape. Current applications including this summarization and browsing technology are also reviewed. Applications such as event detection in elevator surveillance, highlight extraction from sports video, and image and video database management are considered within the proposed framework. This book presents the latest in research and readers will find their search for knowledge completely satisfied by the breadth of the information covered in this volume.
View full description


Electrical & computer engineers, computer scientists (especially computer graphics; SIGGRAPH), internet engineers, web developers, digital cinematographers. R&D engineers at companies addressing multimedia (consumer) market, e.g., IBM, Mitsubishi, Hewlett-Packard, Intel, Microsoft, Apple, etc.


Book information

  • Published: December 2005
  • ISBN: 978-0-12-369387-7

Table of Contents

ContentsForewordChapter 1: IntroductionChapter 2: Literature SurveyChapter 3: Video Table-of-content GenerationChapter 4: Video Highlights ExtractionChapter 5: Video Structure Discovery using Unsupervised LearningChapter 6: Video IndexingChapter 7: A Unified Framework for Video Summarization, Browsing, and RetrievalChapter 8: ApplicationsChapter 9: Conclusions