Video Stabilization and Performance Evaluation

Li Song, Hui Qu, Tong Ke, Yi Dong, Xusheng Zhang

Introduction

Video stabilization seeks to create stable versions of casually shot video, which can not only improve people’s visual comfort but also be a preprocessing of some other procedures, such as object tracking, object detection, video compression and so on, resulting in increas- ed precision and robustness. The project focuses on improving the efficiency of video stabilization algorithms as well as developing bet- ter deshaking assessment tools to identify shaking and evaluate the exsiting algorithms.


We have proposed a video stabilization algorithm based on L1-L2 optimization, which can remove unwanted camera movements as well as keep the original video information to the greatest extent, and a video stabilization algorithm based on attitude sensors, which can stabilize shaky videos using gyroscope sensors. We also designed a shaking video synthesis method for performance evaluation. We have applied our stabilization algorithm into cloud-based stabilization, in which the stabilization process is on the server, and users only need to upload their shaky videos and download the stabilized ones after a while.

Online Demo

Demo for video stabilization


Software

Software available for cloud based stabilization


Download link: VideoStab_v1.0 for Android (apk,1.17MB)

Download QP code:


Results

Results of video stabilization based on attitude sensors


Results of video stabilization based on L1-L2 optimization

"sidewalk" comparison

"gleicher1" comparison


More results are available on the website http://www.youku.com/playlist_show/id_18891274.html



Shaking video synthesis Results

"bank": synthetic shaking videos

comparison between synthetic and real shaking videos


More results are available on the website http://www.youku.com/playlist_show/id_19274439.html

Publications

[1] Hui Qu, Li Song, Gengjian Xue, "Shaking Video Synthesis for Video Stabilization Performance Assessment", IEEE Visual Communications and Image Processing (VCIP 2013), Kuching, Malaysia, Nov. 12-20, 2013. (PDF, Project)
[2] Hui Qu, Li Song, "Video stabilization with L1-L2 optimization", 2013 20th IEEE International Conference on Image Processing (ICIP2013), Melbourne, Australia, Sep. 15-18, 2013. (PDF, Project, Slides)