Display options
Share it on

ACM Trans Graph. 2013 Jul 04;32(4). doi: 10.1145/2461912.2461971.

Perception of Perspective Distortions in Image-Based Rendering.

ACM transactions on graphics

Peter Vangorp, Christian Richardt, Emily A Cooper, Gaurav Chaurasia, Martin S Banks, George Drettakis

Affiliations

  1. REVES/INRIA Sophia-Antipolis ; University of Giessen ; MPI Informatik.

PMID: 24273376 PMCID: PMC3833453 DOI: 10.1145/2461912.2461971

Abstract

Image-based rendering (IBR) creates realistic images by enriching simple geometries with photographs, e.g., mapping the photograph of a building façade onto a plane. However, as soon as the viewer moves away from the correct viewpoint, the image in the retina becomes distorted, sometimes leading to gross misperceptions of the original geometry. Two hypotheses from vision science state how viewers perceive such image distortions, one claiming that they can compensate for them (and therefore perceive scene geometry reasonably correctly), and one claiming that they cannot compensate (and therefore can perceive rather significant distortions). We modified the latter hypothesis so that it extends to street-level IBR. We then conducted a rigorous experiment that measured the magnitude of perceptual distortions that occur with IBR for façade viewing. We also conducted a rating experiment that assessed the acceptability of the distortions. The results of the two experiments were consistent with one another. They showed that viewers' percepts are indeed distorted, but not as severely as predicted by the modified vision science hypothesis. From our experimental results, we develop a predictive model of distortion for street-level IBR, which we use to provide guidelines for acceptability of virtual views and for capture camera density. We perform a confirmatory study to validate our predictions, and illustrate their use with an application that guides users in IBR navigation to stay in regions where virtual views yield acceptable perceptual distortions.

Keywords: Image-based rendering; human vision; perception

References

  1. Nat Neurosci. 2005 Oct;8(10):1401-10 - PubMed
  2. Perception. 2008;37(1):106-25 - PubMed
  3. Atten Percept Psychophys. 2009 Jan;71(1):183-93 - PubMed
  4. J Vis. 2005 Dec 15;5(10):834-62 - PubMed
  5. Inf Disp (1975). 2009 Jan;25(1):12-16 - PubMed
  6. Percept Psychophys. 1999 Apr;61(3):456-67 - PubMed
  7. J Exp Psychol. 1961 Sep;62:223-33 - PubMed
  8. J Vis. 2012 May 25;12(5):8 - PubMed
  9. Behav Res Methods. 2005 Aug;37(3):379-84 - PubMed
  10. Nature. 2002 Jan 24;415(6870):429-33 - PubMed
  11. Percept Psychophys. 1980 Dec;28(6):521-6 - PubMed
  12. J Exp Psychol Hum Percept Perform. 1987 May;13(2):256-66 - PubMed
  13. Percept Psychophys. 1983 Feb;33(2):177-82 - PubMed
  14. Percept Psychophys. 1986 Apr;39(4):233-5 - PubMed

Publication Types

Grant support