Fast Non-Linear Video Synopsis

Project Team : Alparslan Yildiz, Ulas Vural and Dr. Yusuf Sinan Akgul.

The aim of this project is to develop a novel real-time surveillance video summarization system that employs the eye-gaze positions of the surveillance operator. The system output can be used to efficiently view the overlooked sections of the surveillance video, which can be used to increase the reliability of the surveillance system. The summary of the operator-monitored actions can also be obtained for efficient reexamination of the surveillance videos. The system employs a novel non-linear video abstraction method that can mix actions from different frames into the same summary frame for more compact videos. The video summaries are done in real time on average hardware thanks to the improved dynamic programming based techniques. We performed several experiments using synthetic and real world surveillance videos, which showed the practical applicability of our system.

Basic Results

Basic video synopsis, presented in this paper. ( .avi )

Eye-gaze Based Real-time Surveillance Video Synopsis

A novel real-time surveillance video summarization system that employs the eye-gaze positions of the surveillance operator is presented. The system output can be used to efficiently review the overlooked sections of the surveillance video, which can be used to increase the reliability of the surveillance system. The summary of the operator-monitored actions can also be obtained for efficient reexamination of the surveillance videos. The system employs a novel non-linear video abstraction method that can mix actions from different frames into the same summary frame for more compact videos. The video summaries are performed in real time on average hardware thanks to our improved dynamic programming based summary techniques. We performed several experiments using synthetic and real world surveillance videos, which showed the practical applicability of our system.

Results

Synthetic movies for analyzing the relationship between eye-movements and motions. ( .pdf ) ( .avi )

Experiments using eye gazer hardware:

• Experiment I. ( .avi )
• Experiment II. ( .avi )

Publications

• Ulas Vural and Yusuf Sinan Akgul. "Eye-gaze Based Real-time Surveillance Video Synopsis", the Special Issue of Pattern Recognition Letters Image/Video-based Pattern Analysis and HCI Applications, doi:10.1016 /j.patrec.2009.03.002. ( .pdf )
• Alpaslan Yildiz, Adem Ozgur and Yusuf Sinan Akgul. "Fast Non-Linear Video Synopsis", International Symposium on Computer and Information Sciences, 2008.