Skip to main navigation Skip to search Skip to main content

Light field image compression with sub-apertures reordering and adaptive reconstruction

  • Chuanmin Jia
  • , Yekang Yang
  • , Xinfeng Zhang
  • , Shiqi Wang
  • , Shanshe Wang
  • , Siwei Ma*
  • *Corresponding author for this work
  • Peking University
  • Nanyang Technological University
  • City University of Hong Kong

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Light field (LF) attracts tremendous attention due to its capability of recording the intensity of scene objects as well as the direction of the light ray, which also dramatically increases the amount of redundant data. In this paper, we explore the structure of the light field images, and propose a pseudo-sequence based light field image compression with sub-aperture reordering and adaptive reconstruction to efficiently improve the coding performances. In the proposed method, we firstly decompose the lenslet image into sub-aperture images, and then design an optimized sub-aperture scan order to rearrange them sequentially as a pseudo-sequence. Third, we take advantage of the state-of-the-art video codec to compress the pseudo-sequence by leveraging both intra- and inter-view correlations. Considering the interpolation and transform induced by the reconstruction procedure from sub-aperture images to lenslet image, we propose an enhanced reconstruction method by applying region-based non-local adaptive filters which extracts the non-local similarities for collaborative filtering to promote the quality of reconstructed lenslet images. Extensive experimental results show that the proposed method achieves up to 15.7% coding gain in terms of BD-rate.

Original languageEnglish
Title of host publicationAdvances in Multimedia Information Processing – PCM 2017 - 18th Pacific-Rim Conference on Multimedia, Revised Selected Papers
EditorsBing Zeng, Hongliang Li, Abdulmotaleb El Saddik, Xiaopeng Fan, Shuqiang Jiang, Qingming Huang
PublisherSpringer Verlag
Pages47-55
Number of pages9
ISBN (Print)9783319773797
DOIs
StatePublished - 2018
Externally publishedYes
Event18th Pacific-Rim Conference on Multimedia, PCM 2017 - Harbin, China
Duration: 28 Sep 201729 Sep 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10735 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th Pacific-Rim Conference on Multimedia, PCM 2017
Country/TerritoryChina
CityHarbin
Period28/09/1729/09/17

Keywords

  • Adaptive reconstruction
  • Image compression
  • Light field
  • Sub-apertures arrangement

Fingerprint

Dive into the research topics of 'Light field image compression with sub-apertures reordering and adaptive reconstruction'. Together they form a unique fingerprint.

Cite this