IEEE Trans Image Process. 2013 Sep;22(9):3517-27. doi: 10.1109/TIP.2013.2266580. Epub 2013 Jun 12.

High efficiency 3D video coding using new tools based on view synthesis.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society

Marek Dománski, Olgierd Stankiewicz, Krzysztof Wegner, Maciej Kurc, Jacek Konieczny, Jakub Siast, Jakub Stankowski, Robert Ratajczak, Tomasz Grajek

PMID: 23771335 DOI: 10.1109/TIP.2013.2266580

Abstract

We propose a new coding technology for 3D video represented by multiple views and the respective depth maps. The proposed technology is demonstrated as an extension of the recently developed high efficiency video coding (HEVC). One base views are compressed into a standard bitstream (like in HEVC). The remaining views and the depth maps are compressed using new coding tools that mostly rely on view synthesis. In the decoder, those views and the depth maps are derived via synthesis in the 3D space from the decoded baseview and from data corresponding to small disoccluded regions. The shapes and locations of those disoccluded regions can be derived by the decoder without any side information transmitted. To achieve high compression efficiency, we propose several new tools such as depth-based motion prediction, joint high frequency layer coding, consistent depth representation, and nonlinear depth representation. The experiments show high compression efficiency of the proposed technology. The bitrate needed for transmission of two side views with depth maps is mostly less than 50% than that of the bitrate for a single-view video.

Publication Types

• Journal Article
• Research Support, Non-U.S. Gov't