We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Video frame rate up conversion under inconsistent camera motion.
- Authors
Jinsong Wang; Nilesh Patel; William Grosky; Farshad Fotouhi
- Abstract
Abstract In this paper, we address the problem of video frame rate up-conversion (FRC) in the compressed domain. FRC is often recognized as video temporal interpolation. This problem is very challenging when targeted for video sequences with inconsistent camera and object motion, such as sports videos. A novel compressed domain motion compensation scheme is presented and applied in this paper, aiming at up-sampling frame rates in sports videos. MPEG-2 encoded motion vectors (MVs) are utilized as inputs in the proposed algorithm. The decoded MVs undergo a cumulative spatiotemporal interpolation. An iterative rejection scheme based on the dense motion vector field (MVF) and the generalized affine motion model is exploited to detect global camera motion. Subsequently, the foreground object separation is performed by additionally examining the temporal consistency of the output of iterative rejections. This consistency check process helps coalesce the resulting foreground blocks and weed out the unqualified blocks. Finally, different compensation strategies for the camera and object motions are applied to interpolate the new frames. Illustrative examples are provided to demonstrate the efficacy of the proposed approach. Experimental results are compared with the popular block and non-block based frame interpolation approaches.
- Subjects
VIDEOS; CAMERA operators; INTERPOLATION; SEQUENCES (Motion pictures); ALGORITHMS; VECTOR fields; VECTOR analysis
- Publication
Multimedia Tools & Applications, 2008, Vol 39, Issue 3, p329
- ISSN
1380-7501
- Publication type
Article
- DOI
10.1007/s11042-007-0162-3