IEEE Trans Vis Comput Graph. 2018 Sep;24(9):2559-2572. doi: 10.1109/TVCG.2017.2759265. Epub 2017 Oct 04.

Narrative Collage of Image Collections by Scene Graph Recombination.

IEEE transactions on visualization and computer graphics

Fei Fang, Miao Yi, Hui Feng, Shenghong Hu, Chunxia Xiao

PMID: 28981417 DOI: 10.1109/TVCG.2017.2759265

Abstract

A narrative collage is an interesting image editing method for summarizing the main theme or storyline behind an image collection. We present a novel method to generate narrative images with plausible semantic scene structures. To achieve this goal, we introduce a layer graph and a scene graph to represent the relative depth order and semantic relationship between image objects, respectively. We first cluster the input image collection to select representative images, and then we extract a group of semantic salient objects from each representative image. Both layer graphs and scene graphs are constructed and combined according to our specific rules for reorganizing the extracted objects in every image. We design an energy model to appropriately locate every object on the final canvas. The experimental results show that our method can produce competitive narrative collage results and that it performs well on a wide range of image collections.

Publication Types

• Journal Article
• Research Support, Non-U.S. Gov't