Video Synopsis and Indexing

Video Synopsis and Indexing

Yael Pritch, Alex Rav-Acha, Shmuel Peleg


        News: April 2015:     Video Synopsis Camera by FLIR is on sale!       GIZMODO Review     FLIR Page

      July 2016:       Briefcam at Rio Olympics.       CNN;       YouTube;       中華電視公司

Abstract

The amount of captured video is growing with the increased numbers of video cameras, especially the increase of millions of surveillance cameras that operate 24 hours a day. Since video browsing and retrieval is time consuming, most captured video is never watched or examined. Video synopsis is an effective tool for browsing and indexing such video. It provides a short video representation, while preserving the essential activities in the original video. The activity in the video is condensed into a shorter period by simultaneously showing multiple activities, even when they originally occurred at different times. The synopsis video is also an index into the original video by pointing to the original time of each activity.

Video Synopsis can be applied to create a synopsis of an endless video streams, as generated by webcams and by surveillance cameras. It can address queries like ``Show in one minute the synopsis of this camera broadcast during the past day''. This process includes two major phases: (i) An online conversion of the endless video stream into a database of objects and activities (rather than frames). (ii) A response phase, generating the video synopsis as a response to the user's query.


Project Publications (PDF)


  • Y. Pritch, S. Ratovitch, A. Hendel, and S. Peleg, Clustered Synopsis of Surveillance Video, 6th IEEE Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS'09), Genoa, Italy, Sept. 2-4, 2009. in press.
  • Y. Pritch, A. Rav-Acha, and S. Peleg, Nonchronological Video Synopsis and Indexing, IEEE Trans. PAMI, Vol 30, No 11, Nov. 2008, pp. 1971-1984.
  • Y. Pritch, A. Rav-Acha, A. Gutman, and S. Peleg, Webcam Synopsis: Peeking Around the World, ICCV'07, October 2007. 8p.
  • A. Rav-Acha, Y. Pritch, and S. Peleg, Making a Long Video Short: Dynamic Video Synopsis, CVPR'06, June 2006, pp. 435-441.
  • Patents (PDF)

    Press Coverage


    TheMarker (Hebrew), 3 June 2010. 2010 Red Herring Top 100 Europe Winners (pdf). Direct link to themarker.com.

    The Wall Street Journal, 27 Sept 2010. Technology Innovation Winners 2010 (pdf). Direct link to wsj.com. Search for "Shmuel" in the long article...

    New Scientist, 9 November 2010. All-seeing eye for CCTV surveillance (pdf). Direct link to www.newscientist.com.

    The Economist, 15 February 2011. Searching security video: Just the interesting bits (pdf). Direct link to www.economist.com.
                            Print Edition on June 4, 2011 (pdf). Direct link to www.economist.com

    The World (BBC & Public Radio), 28 May 2013. Video Software Compresses Time, Aids Police.

    Popular Science, August 2014. An Article in Popular Science about Video Synopsis

    Technology
    Licensed To

    .