Video Synopsis and Indexing

Yael Pritch, Alex Rav-Acha, Shmuel Peleg

Abstract

The amount of captured video is growing with the increased numbers of video cameras, especially the increase of millions of surveillance cameras that operate 24 hours a day. Since video browsing and retrieval is time consuming, most captured video is never watched or examined. Video synopsis is an effective tool for browsing and indexing such video. It provides a short video representation, while preserving the essential activities in the original video. The activity in the video is condensed into a shorter period by simultaneously showing multiple activities, even when they originally occurred at different times. The synopsis video is also an index into the original video by pointing to the original time of each activity.

Video Synopsis can be applied to create a synopsis of an endless video streams, as generated by webcams and by surveillance cameras. It can address queries like ``Show in one minute the synopsis of this camera broadcast during the past day''. This process includes two major phases: (i) An online conversion of the endless video stream into a database of objects and activities (rather than frames). (ii) A response phase, generating the video synopsis as a response to the user's query.


Project Publications (PDF)


  • Y. Pritch, S. Ratovitch, A. Hendel, and S. Peleg, Clustered Synopsis of Surveillance Video, 6th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS'09), Genoa, Italy, Sept. 2-4, 2009. in press.
  • Y. Pritch, A. Rav-Acha, and S. Peleg, Nonchronological Video Synopsis and Indexing, IEEE Trans. PAMI, Vol 30, No 11, Nov. 2008, pp. 1971-1984.
  • Y. Pritch, A. Rav-Acha, A. Gutman, and S. Peleg, Webcam Synopsis: Peeking Around the World, ICCV'07, October 2007. 8p.
  • A. Rav-Acha, Y. Pritch, and S. Peleg, Making a Long Video Short: Dynamic Video Synopsis, CVPR'06, June 2006, pp. 435-441.
  • Patents (PDF)

    Press Coverage


    TheMarker (Hebrew), 3 June 2010. 2010 Red Herring Top 100 Europe Winners (pdf). Direct link to themarker.com.

    The Wall Street Journal, 27 Sept 2010. Technology Innovation Winners 2010 (pdf). Direct link to wsj.com. Search for "Shmuel" in the long article...

    New Scientist, 9 November 2010. All-seeing eye for CCTV surveillance (pdf). Direct link to www.newscientist.com.

    The Economist, 15 February 2011. Searching security video: Just the interesting bits (pdf). Direct link to www.economist.com.
                            Print Edition on June 4, 2011 (pdf). Direct link to www.economist.com

    Technology
    Licensed To

    .