Display options
Cite
Hazenberg SJ, van Lier R. Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition. Iperception. 2016;7(4):2041669516664530doi: 10.1177/2041669516664530.
Hazenberg, S. J., & van Lier, R. (2016). Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition. i-Perception, 7(4), 2041669516664530. https://doi.org/10.1177/2041669516664530
Hazenberg, Simon J, and van Lier, Rob. "Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition." i-Perception vol. 7,4 (2016): 2041669516664530. doi: https://doi.org/10.1177/2041669516664530
Hazenberg SJ, van Lier R. Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition. Iperception. 2016 Aug 23;7(4):2041669516664530. doi: 10.1177/2041669516664530. eCollection 2016. PMID: 27698985; PMCID: PMC5030757.
Copy Download .nbib Format: NLM
Share it on

Iperception. 2016 Aug 23;7(4):2041669516664530. doi: 10.1177/2041669516664530. eCollection 2016.

Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition.

i-Perception

Simon J Hazenberg, Rob van Lier

Affiliations

  1. Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands.

PMID: 27698985 PMCID: PMC5030757 DOI: 10.1177/2041669516664530

Abstract

In three experiments, we investigated the influence of object-specific sounds on haptic scene recognition without vision. Blindfolded participants had to recognize, through touch, spatial scenes comprising six objects that were placed on a round platform. Critically, in half of the trials, object-specific sounds were played when objects were touched (bimodal condition), while sounds were turned off in the other half of the trials (unimodal condition). After first exploring the scene, two objects were swapped and the task was to report, which of the objects swapped positions. In Experiment 1, geometrical objects and simple sounds were used, while in Experiment 2, the objects comprised toy animals that were matched with semantically compatible animal sounds. In Experiment 3, we replicated Experiment 1, but now a tactile-auditory object identification task preceded the experiment in which the participants learned to identify the objects based on tactile and auditory input. For each experiment, the results revealed a significant performance increase only after the switch from bimodal to unimodal. Thus, it appears that the release of bimodal identification, from audio-tactile to tactile-only produces a benefit that is not achieved when having the reversed order in which sound was added after having experience with haptic-only. We conclude that task-related factors other than mere bimodal identification cause the facilitation when switching from bimodal to unimodal conditions.

Keywords: haptics; multisensory integration; scene recognition; spatial updating

References

  1. Brain Cogn. 2007 Nov;65(2):184-94 - PubMed
  2. Trends Cogn Sci. 2008 Nov;12(11):411-7 - PubMed
  3. Cognition. 1999 Mar 1;70(2):191-210 - PubMed
  4. Nature. 1999 Jul 8;400(6740):162-6 - PubMed
  5. Psychol Sci. 2004 Jan;15(1):60-4 - PubMed
  6. Mem Cognit. 2004 Apr;32(3):399-415 - PubMed
  7. Curr Biol. 1998 Mar 12;8(6):R190 - PubMed
  8. J Exp Psychol Learn Mem Cogn. 2011 May;37(3):621-34 - PubMed
  9. Perception. 2007;36(10):1513-21 - PubMed
  10. Exp Brain Res. 2002 Sep;146(2):161-71 - PubMed
  11. Cereb Cortex. 2004 Apr;14(4):452-65 - PubMed
  12. Exp Brain Res. 2005 Oct;166(3-4):481-8 - PubMed
  13. Brain. 2014 Jan;137(Pt 1):288-93 - PubMed
  14. Curr Biol. 2006 Jul 25;16(14):1422-7 - PubMed
  15. Cereb Cortex. 2005 Jul;15(7):963-74 - PubMed
  16. Atten Percept Psychophys. 2012 Aug;74(6):1260-7 - PubMed
  17. Cognition. 2013 Sep;128(3):363-79 - PubMed
  18. Exp Brain Res. 2005 Feb;161(2):233-42 - PubMed
  19. Trends Cogn Sci. 2006 Dec;10(12):551-7 - PubMed
  20. Curr Biol. 2004 Feb 3;14(3):R115-7 - PubMed
  21. Hear Res. 2009 Dec;258(1-2):165-74 - PubMed
  22. Nature. 2000 Dec 14;408(6814):788 - PubMed

Publication Types