Display options
Cite
Malaia EA, Borneman SC, Krebs J, et al. Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension. IEEE Trans Neural Syst Rehabil Eng. 2021;29:2456-2463doi: 10.1109/TNSRE.2021.3127724.
Malaia, E. A., Borneman, S. C., Krebs, J., & Wilbur, R. B. (2021). Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society, 292456-2463. https://doi.org/10.1109/TNSRE.2021.3127724
Malaia, E A, et al. "Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension." IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society vol. 29 (2021): 2456-2463. doi: https://doi.org/10.1109/TNSRE.2021.3127724
Malaia EA, Borneman SC, Krebs J, Wilbur RB. Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension. IEEE Trans Neural Syst Rehabil Eng. 2021;29:2456-2463. doi: 10.1109/TNSRE.2021.3127724. Epub 2021 Dec 03. PMID: 34762589; PMCID: PMC8720261.
Copy Download .nbib Format: NLM
Share it on

IEEE Trans Neural Syst Rehabil Eng. 2021;29:2456-2463. doi: 10.1109/TNSRE.2021.3127724. Epub 2021 Dec 03.

Low-Frequency Entrainment to Visual Motion Underlies Sign Language Comprehension.

IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society

E A Malaia, S C Borneman, J Krebs, R B Wilbur

PMID: 34762589 PMCID: PMC8720261 DOI: 10.1109/TNSRE.2021.3127724

Abstract

When people listen to speech, neural activity tracks the entropy fluctuation in the acoustic envelope of the signal. This signal-based entrainment has been shown to be the basis of speech parsing and comprehension. In this electroencephalography (EEG) study, we compute sign language users' cortical tracking of changes in visual dynamics of the communicative signal in the time-direct videos of sign language, and their time-reversed counterparts, and assess the relative contribution of response frequencies between.2 and 12.4 Hz to comprehension using a machine learning approach to brain state classification. Lower frequencies of EEG response (.2-4 Hz) yield 100% classification accuracy, while information about cortical tracking of the visual envelope in higher frequencies is less informative. This suggests that signers rely on lower visual frequency data, such as envelope of visual signal, for sign language comprehension. In the context of real-time language processing, given the speed of comprehension responses, this suggests that fluent signers employ a predictive processing heuristic based on sign language knowledge.

References

  1. J Cogn Neurosci. 2012 Dec;24(12):2321-33 - PubMed
  2. Lang Learn Dev. 2018;14(2):130-148 - PubMed
  3. Dev Psychobiol. 2014 Feb;56(2):274-91 - PubMed
  4. Nat Neurosci. 2016 Jan;19(1):158-64 - PubMed
  5. J Neurosci. 2020 Jul 1;40(27):5283-5299 - PubMed
  6. J Vis. 2019 May 1;19(5):22 - PubMed
  7. Eur J Neurosci. 2018 Oct;48(7):2566-2584 - PubMed
  8. Lang Speech. 2018 Mar;61(1):97-112 - PubMed
  9. Proc Natl Acad Sci U S A. 2010 Jul 6;107(27):12387-92 - PubMed
  10. Wiley Interdiscip Rev Cogn Sci. 2019 Mar;10(2):e1484 - PubMed
  11. Neuroimage. 2021 Feb 1;226:117545 - PubMed
  12. Electroencephalogr Clin Neurophysiol. 1983 Apr;55(4):468-84 - PubMed
  13. PLoS One. 2016 Aug 10;11(8):e0161001 - PubMed
  14. Neuroimage. 2018 May 15;172:206-216 - PubMed
  15. Dev Psychobiol. 2014 Feb;56(2):154-78 - PubMed
  16. Proc Natl Acad Sci U S A. 2017 Jun 13;114(24):6352-6357 - PubMed
  17. J Exp Psychol Learn Mem Cogn. 2021 Jun;47(6):998-1011 - PubMed
  18. Brain Lang. 2009 Mar;108(3):145-58 - PubMed
  19. Cereb Cortex. 2013 Jun;23(6):1378-87 - PubMed
  20. Curr Biol. 2018 Mar 5;28(5):803-809.e3 - PubMed

Publication Types

Grant support