Digital Image Stabilization

1.

Digital Image Stabilization
老師 : 楊士萱
學生 : 鄭馥銘

2.

Outline
Introduction
Basic architecture of DIS
MVI method for DIS
Future work

3.

Introduction
An image stabilization system manages
to remove unwanted movement form
an image sequence
Previous image stabilization system
accelerometers, gyros, mechanical dampers ,
angular velocity sensors…………..
We prefer to use DIS

4.

Basic architecture of DIS
Input
Pre-processing
Stabilization
Stabilized
Input
Video Encoder
Video Decoder
Output

5.

Basic architecture of DIS
stabilization-aided encoder
Stabilization
Input
Video Encoder
Video Decoder
Output

6.

Basic architecture of DIS
stabilization-aided decoder
Stabilization
Input
Video Encoder
Video Decoder
Output

7.

MVI Method for DIS
MVI : Motion Vector Integration
Basic idea :
Using some propose method to find reliable local
motion vector(LMV)
Calculate the global motion vector(GMV) form LMV.
Integrating the previous frame GMV and current
frame GMV to calculate AMV.
Using AMV to compensate current frame to be
stabilized frame.
Reference paper [1-4]

8.

New Algorithm and Architecture of Digital
Image stabilization System
CCD
A/D
DIS for
FM
Video
Encoder
Block diagram of a digital video camera with DIS
system.

9.

New Algorithm and Architecture of Digital
Image stabilization System
Lack of features
Existence of moving objects
Intentional panning
Existence of repeated patterns
Intentional zooming
Low signal-to-noise ratio
Large movement out of the searching range of
block matching
Complicated Motion (e.g. rotatory motion)

10.

A general structure of DIS system with
frame memory
Preprocessing
Motion
Estimation
Motion
Decision
Motion
Compensation
Frame
Register
Frame
Memory
Stabilized
images

11.

Pre-Processing
Preprocessing
Motion
Estimation
Motion
Decision
Motion
Compensation
Frame
Register
Frame
Memory
Stabilized
images

12.

Pre-Processing
Block Matching over Bit-Planes

13.

14.

Pre-Processing
Block Matching over Gray-Code BitPlanes

15.

16.

Motion Estimation
Preprocessing
Motion
Estimation
Motion
Decision
Motion
Compensation
Frame
Register
Frame
Memory
Stabilized
images

17.

Motion Estimation

18.

Motion Estimation

19.

Motion Decision
Preprocessing
Motion
Estimation
Motion
Decision
Motion
Compensation
Frame
Register
Frame
Memory
Stabilized
images

20.

Motion Decision
(Lack-of-Feature Condition)

21.

Motion Decision
(Lack-of-Feature Condition)

22.

Motion Decision
(Lack-of-Feature Condition)

23.

Motion Decision
(Existence of Moving Objects)
Random-like motion
temporally correlated motion

24.

Motion Decision
(Existence of Moving Objects)

25.

Motion Decision
(Intentional Panning Condition)
If 80% of the VALID_LMV are detected as
temporally correlated motion, we consider
that the camera is under a panning condition
and no motion compensation is needed
Otherwise, we assume that these temporally
correlated motion vectors are caused by
some moving objects in the image.

26.

Motion Decision
(Optical Zooming Condition)

27.

Motion Decision
(Spatial Noise Checking of Noise Level)

28.

Procedure of Motion Decision

29.

Procedure of Motion Decision

30.

Motion Compensation
Frame Motion Vector (FMV)
Accumulated Motion Vector (AMV)
Motion Compensation

31.

Simulation
Result

32.

Future work
Understanding mpeg4 framework in
order to write my propose method
program in it.
stabilization-aided encoder
Stabilization
Input
Video Encoder
Video Decoder
Output