Display options
Share it on

Front Psychol. 2014 Jul 17;5:730. doi: 10.3389/fpsyg.2014.00730. eCollection 2014.

Visuo-haptic multisensory object recognition, categorization, and representation.

Frontiers in psychology

Simon Lacey, K Sathian

Affiliations

  1. Department of Neurology, Emory University School of Medicine Atlanta, GA, USA.
  2. Department of Neurology, Emory University School of Medicine Atlanta, GA, USA ; Department of Rehabilitation Medicine, Emory University School of Medicine Atlanta, GA, USA ; Department of Psychology, Emory University School of Medicine Atlanta, GA, USA ; Rehabilitation Research and Development Center of Excellence, Atlanta Veterans Affairs Medical Center Decatur, GA, USA.

PMID: 25101014 PMCID: PMC4102085 DOI: 10.3389/fpsyg.2014.00730

Abstract

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.

Keywords: cross-modal; effective connectivity; fMRI; face processing; viewpoint dependence; visual imagery

References

  1. Neurosci Res. 1996 Jun;25(2):173-81 - PubMed
  2. Neuroimage. 2007 Sep 1;37(3):890-903 - PubMed
  3. J Neurosci. 2012 Feb 15;32(7):2442-52 - PubMed
  4. Front Hum Neurosci. 2013 Dec 27;7:885 - PubMed
  5. Percept Psychophys. 1995 Nov;57(8):1111-23 - PubMed
  6. Memory. 2006 Apr;14(3):307-15 - PubMed
  7. Exp Brain Res. 2005 Oct;166(3-4):559-71 - PubMed
  8. Exp Brain Res. 1997 Oct;116(3):551-5 - PubMed
  9. J Cogn Neurosci. 2011 Dec;23(12):4174-84 - PubMed
  10. Psychol Bull. 2009 May;135(3):380-406 - PubMed
  11. Behav Brain Sci. 2007 Apr;30(2):189-201; discussion 201-39 - PubMed
  12. Neuroimage. 2010 Feb 1;49(3):1991-2000 - PubMed
  13. Neuroimage. 2009 Apr 1;45(2):522-36 - PubMed
  14. Prog Brain Res. 2001;134:427-45 - PubMed
  15. Exp Brain Res. 2007 Jun;179(4):595-606 - PubMed
  16. Neuron. 1999 Sep;24(1):187-203 - PubMed
  17. Perception. 2004;33(3):339-53 - PubMed
  18. Neuropsychologia. 2007 Feb 1;45(3):506-13 - PubMed
  19. Cereb Cortex. 2007 Mar;17(3):713-31 - PubMed
  20. Cogn Affect Behav Neurosci. 2004 Jun;4(2):260-9 - PubMed
  21. Philos Trans R Soc Lond B Biol Sci. 1976 Oct 19;275(942):483-519 - PubMed
  22. Q J Exp Psychol (Hove). 2006 Feb;59(2):361-76 - PubMed
  23. Eur J Neurosci. 2006 Apr;23(7):1919-30 - PubMed
  24. Atten Percept Psychophys. 2009 May;71(4):910-23 - PubMed
  25. J Neurophysiol. 2008 Oct;100(4):2038-47 - PubMed
  26. Neuroreport. 1997 Dec 22;8(18):3877-81 - PubMed
  27. Brain Res Cogn Brain Res. 2003 Jun;17(1):14-25 - PubMed
  28. Exp Brain Res. 2005 Oct;166(3-4):583-91 - PubMed
  29. Trends Cogn Sci. 2007 Jul;11(7):280-9 - PubMed
  30. Cereb Cortex. 2002 Nov;12(11):1202-12 - PubMed
  31. Proc Natl Acad Sci U S A. 2004 Apr 13;101(15):5658-63 - PubMed
  32. Psychol Sci. 2013 Oct;24(10):2088-98 - PubMed
  33. Neuropsychologia. 2011 Jun;49(7):1807-15 - PubMed
  34. J Neurosci. 2005 Apr 27;25(17):4294-306 - PubMed
  35. Cereb Cortex. 2010 Sep;20(9):2027-42 - PubMed
  36. Mem Cognit. 2005 Jun;33(4):710-26 - PubMed
  37. Dev Psychobiol. 2005 Apr;46(3):279-86 - PubMed
  38. Cogn Psychol. 1989 Apr;21(2):233-82 - PubMed
  39. Perception. 2009;38(9):1355-76 - PubMed
  40. Exp Brain Res. 2009 Sep;198(2-3):329-37 - PubMed
  41. J Neurophysiol. 2006 Jul;96(1):27-39 - PubMed
  42. Perception. 2008;37(12):1867-78 - PubMed
  43. Psychon Bull Rev. 2014 Aug;21(4):976-85 - PubMed
  44. Neurology. 1986 Jun;36(6):864-7 - PubMed
  45. Neuroimage. 2001 Sep;14(3):617-31 - PubMed
  46. J Exp Psychol Hum Percept Perform. 2011 Feb;37(1):23-37 - PubMed
  47. Atten Percept Psychophys. 2014 Feb;76(2):541-58 - PubMed
  48. Can J Exp Psychol. 2007 Sep;61(3):254-64 - PubMed
  49. Eur J Neurosci. 2010 May;31(10):1882-8 - PubMed
  50. Perception. 1991;20(2):167-77 - PubMed
  51. Neuropsychologia. 2007 Feb 1;45(3):484-95 - PubMed
  52. Int J Psychophysiol. 2003 Oct;50(1-2):41-9 - PubMed
  53. Nat Neurosci. 2001 Mar;4(3):324-30 - PubMed
  54. Psychol Sci. 2001 Jan;12(1):37-42 - PubMed
  55. Proc Natl Acad Sci U S A. 1995 Aug 29;92(18):8135-9 - PubMed
  56. Neuroimage. 2005 Jun;26(2):573-80 - PubMed
  57. Iperception. 2012;3(2):97-100 - PubMed
  58. Brain Cogn. 2005 Dec;59(3):246-57 - PubMed
  59. Neuroimage. 2013 Jan 15;65:59-68 - PubMed
  60. Annu Rev Psychol. 2007;58:75-96 - PubMed
  61. Percept Psychophys. 1985 Apr;37(4):299-302 - PubMed
  62. J Exp Psychol Hum Percept Perform. 1999 Dec;25(6):1867-81 - PubMed
  63. Neuroimage. 2001 Jul;14(1 Pt 1):129-39 - PubMed
  64. Trends Neurosci. 1992 Jan;15(1):20-5 - PubMed
  65. Annu Rev Neurosci. 2005;28:377-401 - PubMed
  66. J Cogn Neurosci. 2014 May;26(5):1154-67 - PubMed
  67. Psychon Bull Rev. 2014 Aug;21(4):995-1002 - PubMed
  68. PLoS One. 2009 Nov 24;4(11):e8009 - PubMed
  69. Cereb Cortex. 2004 Nov;14(11):1256-65 - PubMed
  70. Cereb Cortex. 2009 Aug;19(8):1806-19 - PubMed
  71. Brain Res. 2008 Jun 27;1217:110-8 - PubMed
  72. Neuroimage. 2005 Apr 15;25(3):718-26 - PubMed
  73. Hum Brain Mapp. 2010 Nov;31(11):1813-21 - PubMed
  74. Neuroimage. 2002 Dec;17(4):1729-41 - PubMed
  75. Perception. 2012;41(11):1289-98 - PubMed
  76. Neuron. 2002 Aug 15;35(4):793-801 - PubMed
  77. Neuroimage. 2011 Jul 15;57(2):462-75 - PubMed
  78. PLoS One. 2007 Sep 12;2(9):e890 - PubMed
  79. J Vis. 2012 Jan 10;12(1): - PubMed
  80. J Exp Psychol Learn Mem Cogn. 1997 Jan;23(1):153-63 - PubMed
  81. Atten Percept Psychophys. 2010 Oct;72(7):1975-80 - PubMed
  82. J Vis. 2010 Sep 02;10(11):2 - PubMed
  83. Brain Cogn. 2012 Oct;80(1):33-44 - PubMed
  84. Eur J Neurosci. 2010 Jul;32(1):165-71 - PubMed
  85. Seeing Perceiving. 2011;24(3):293-314 - PubMed
  86. Neuroimage. 2001 Apr;13(4):632-45 - PubMed
  87. Neurosci Lett. 2006 Apr 24;397(3):269-73 - PubMed
  88. Cognition. 2013 Feb;126(2):135-48 - PubMed
  89. Trends Cogn Sci. 2002 Jun 1;6(6):255-260 - PubMed
  90. Hum Brain Mapp. 2008 Oct;29(10):1123-38 - PubMed
  91. Scand J Psychol. 2007 Aug;48(4):281-8 - PubMed
  92. Atten Percept Psychophys. 2011 Feb;73(2):521-30 - PubMed
  93. Psychol Sci. 2010 May;21(5):667-75 - PubMed
  94. Nat Neurosci. 1999 Nov;2(11):1019-25 - PubMed
  95. Trends Neurosci. 2006 May;29(5):250-6 - PubMed
  96. Neuropsychologia. 2004;42(8):1079-87 - PubMed
  97. J Exp Psychol Hum Percept Perform. 2009 Aug;35(4):911-30 - PubMed
  98. Exp Brain Res. 2012 Jan;216(1):123-34 - PubMed
  99. Scand J Psychol. 1973;14(3):203-6 - PubMed
  100. Cognition. 1998 Jan;65(2-3):167-96 - PubMed
  101. Prog Brain Res. 2006;154:315-25 - PubMed
  102. Exp Brain Res. 2011 Sep;213(2-3):267-73 - PubMed
  103. Nat Neurosci. 2007 Jun;10(6):687-9 - PubMed
  104. Psychon Bull Rev. 2008 Jun;15(3):574-80 - PubMed
  105. Percept Psychophys. 2008 Oct;70(7):1350-65 - PubMed
  106. Neuroimage. 2010 Feb 1;49(3):1977-90 - PubMed
  107. Perception. 2006;35(10):1351-66 - PubMed
  108. J Cogn Neurosci. 2008 Feb;20(2):356-70 - PubMed
  109. Perception. 2006;35(7):921-31 - PubMed
  110. Acta Psychol (Amst). 2011 Sep;138(1):219-30 - PubMed
  111. Exp Brain Res. 2005 Oct;166(3-4):481-8 - PubMed
  112. J Neurosci. 2013 Mar 20;33(12):5387-98 - PubMed
  113. Front Psychol. 2014 Feb 14;5:109 - PubMed
  114. Cogn Psychol. 1987 Jul;19(3):342-68 - PubMed
  115. Neuroimage. 2007;36 Suppl 2:T87-93 - PubMed
  116. Curr Opin Neurobiol. 2006 Oct;16(5):593-9 - PubMed
  117. Exp Brain Res. 2009 Jan;192(3):391-405 - PubMed
  118. Nature. 1999 Oct 7;401(6753):587-90 - PubMed
  119. Brain Topogr. 2009 May;21(3-4):269-74 - PubMed
  120. Mem Cognit. 1987 Nov;15(6):531-43 - PubMed
  121. Curr Biol. 2009 Jun 23;19(12):1044-9 - PubMed
  122. Brain Res Cogn Brain Res. 2005 May;23(2-3):235-46 - PubMed
  123. Neuroimage. 2005 Oct 15;28(1):268-79 - PubMed
  124. Neuropsychologia. 2002;40(10):1706-14 - PubMed
  125. Exp Brain Res. 2009 Sep;198(2-3):165-82 - PubMed
  126. Neuropsychologia. 2004;42(6):707-12 - PubMed
  127. Percept Psychophys. 2002 Apr;64(3):339-52 - PubMed
  128. Trends Cogn Sci. 2006 Jan;10(1):14-23 - PubMed
  129. Percept Psychophys. 1992 Dec;52(6):661-70 - PubMed
  130. J Neurosci. 2006 Jul 26;26(30):7962-73 - PubMed
  131. Neuroimage. 2013 Jul 15;75:123-135 - PubMed
  132. Neuroreport. 2013 Mar 27;24(5):254-8 - PubMed
  133. Cereb Cortex. 2007 Jan;17(1):9-17 - PubMed
  134. Neuroimage. 2012 Apr 2;60(2):1063-72 - PubMed
  135. Psychol Sci. 2010 Sep;21(9):1248-53 - PubMed
  136. Neuropsychologia. 2014 Jul;60:144-58 - PubMed
  137. Cogn Process. 2011 Feb;12(1):33-9 - PubMed
  138. Neuroimage. 2014 May 1;91:300-10 - PubMed
  139. PLoS One. 2012;7(8):e43062 - PubMed
  140. Neuropsychologia. 2006;44(2):218-28 - PubMed
  141. Prog Brain Res. 2011;191:165-76 - PubMed
  142. Brain Cogn. 2007 Nov;65(2):184-94 - PubMed
  143. Nature. 2002 Jan 24;415(6870):429-33 - PubMed
  144. Neuron. 2002 Mar 28;34(1):161-71 - PubMed
  145. Scand J Psychol. 2005 Jul;46(3):247-51 - PubMed
  146. Nat Rev Neurosci. 2009 May;10(5):360-72 - PubMed
  147. Cereb Cortex. 2001 Feb;11(2):114-21 - PubMed
  148. Cogn Affect Behav Neurosci. 2004 Jun;4(2):251-9 - PubMed

Publication Types