Display options
Cite
Schmidt P, Reiss A, Dürichen R, et al. Wearable-Based Affect Recognition-A Review. Sensors (Basel). 2019;19(19)doi: 10.3390/s19194079.
Schmidt, P., Reiss, A., Dürichen, R., & Laerhoven, K. V. (2019). Wearable-Based Affect Recognition-A Review. Sensors (Basel, Switzerland), 19(19), . https://doi.org/10.3390/s19194079
Schmidt, Philip, et al. "Wearable-Based Affect Recognition-A Review." Sensors (Basel, Switzerland) vol. 19,19 (2019). doi: https://doi.org/10.3390/s19194079
Schmidt P, Reiss A, Dürichen R, Laerhoven KV. Wearable-Based Affect Recognition-A Review. Sensors (Basel). 2019 Sep 20;19(19). doi: 10.3390/s19194079. PMID: 31547220; PMCID: PMC6806301.
Copy Download .nbib Format: NLM
Share it on

Sensors (Basel). 2019 Sep 20;19(19). doi: 10.3390/s19194079.

Wearable-Based Affect Recognition-A Review.

Sensors (Basel, Switzerland)

Philip Schmidt, Attila Reiss, Robert Dürichen, Kristof Van Laerhoven

Affiliations

  1. Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, Germany. [email protected].
  2. University Siegen , Hölderlinstr. 3, 57076 Siegen, Germany. [email protected].
  3. Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, Germany. [email protected].
  4. Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, Germany. [email protected].
  5. University Siegen , Hölderlinstr. 3, 57076 Siegen, Germany. [email protected].

PMID: 31547220 PMCID: PMC6806301 DOI: 10.3390/s19194079

Abstract

Affect recognition is an interdisciplinary research field bringing together researchers from natural and social sciences. Affect recognition research aims to detect the affective state of a person based on observables, with the goal to, for example, provide reasoning for the person's decision making or to support mental wellbeing (e.g., stress monitoring). Recently, beside of approaches based on audio, visual or text information, solutions relying on wearable sensors as observables, recording mainly physiological and inertial parameters, have received increasing attention. Wearable systems enable an ideal platform for long-term affect recognition applications due to their rich functionality and form factor, while providing valuable insights during everyday life through integrated sensors. However, existing literature surveys lack a comprehensive overview of state-of-the-art research in wearable-based affect recognition. Therefore, the aim of this paper is to provide a broad overview and in-depth understanding of the theoretical background, methods and best practices of wearable affect and stress recognition. Following a summary of different psychological models, we detail the influence of affective states on the human physiology and the sensors commonly employed to measure physiological changes. Then, we outline lab protocols eliciting affective states and provide guidelines for ground truth generation in field studies. We also describe the standard data processing chain and review common approaches related to the preprocessing, feature extraction and classification steps. By providing a comprehensive summary of the state-of-the-art and guidelines to various aspects, we would like to enable other researchers in the field to conduct and evaluate user studies and develop wearable systems.

Keywords: affect recognition; affective computing; data collection; machine learning; physiological feature; physiological signals; review; sensors; wearables

References

  1. Hypertension. 2000 Apr;35(4):880-6 - PubMed
  2. Comput Math Methods Med. 2013;2013:573734 - PubMed
  3. Psychosom Med. 2001 Jul-Aug;63(4):668-78 - PubMed
  4. Am Psychol. 1981 Feb;36(2):129-48 - PubMed
  5. Psychiatry Res. 1989 May;28(2):193-213 - PubMed
  6. Cogn Emot. 2016 Aug;30(5):827-56 - PubMed
  7. Behav Res Methods. 2005 Nov;37(4):626-30 - PubMed
  8. Psychophysiology. 2001 Jan;38(1):22-34 - PubMed
  9. Eur J Appl Physiol. 2012 Jan;112(1):309-15 - PubMed
  10. Healthcare (Basel). 2014 May 06;2(2):220-33 - PubMed
  11. Physiol Meas. 2012 Sep;33(9):1491-501 - PubMed
  12. Sci Rep. 2018 Sep 12;8(1):13657 - PubMed
  13. Stress. 2007 Jun;10(2):109-20 - PubMed
  14. Eur Heart J. 1996 Mar;17(3):354-81 - PubMed
  15. IEEE Trans Pattern Anal Mach Intell. 2008 Dec;30(12):2067-83 - PubMed
  16. IEEE Trans Inf Technol Biomed. 2010 Mar;14(2):410-7 - PubMed
  17. J Health Soc Behav. 1983 Dec;24(4):385-96 - PubMed
  18. Proc ACM Int Conf Ubiquitous Comput. 2015 Sep;2015:493-504 - PubMed
  19. Cyberpsychol Behav. 2007 Feb;10(1):45-56 - PubMed
  20. Psychophysiology. 1990 Jul;27(4):363-84 - PubMed
  21. Conf Proc IEEE Eng Med Biol Soc. 2015;2015:5948-51 - PubMed
  22. Conf Proc IEEE Eng Med Biol Soc. 2015;2015:6796-9 - PubMed
  23. Bionanoscience. 2013;3:172-183 - PubMed
  24. Sensors (Basel). 2015 Dec 23;16(1):null - PubMed
  25. Metabolism. 1998 Oct;47(10):1187-93 - PubMed
  26. IEEE Trans Biomed Eng. 2016 Apr;63(4):797-804 - PubMed
  27. IEEE Trans Inf Technol Biomed. 2012 Mar;16(2):279-86 - PubMed
  28. Biol Psychol. 2010 Jul;84(3):394-421 - PubMed
  29. Sensors (Basel). 2019 Jul 12;19(14):null - PubMed
  30. Biomed Sci Instrum. 2006;42:495-500 - PubMed
  31. Med Biol Eng Comput. 2004 May;42(3):419-27 - PubMed
  32. Psychophysiology. 2010 Jul 1;47(4):647-58 - PubMed
  33. Am J Pharm Educ. 2007 Aug 15;71(4):78 - PubMed
  34. J Electromyogr Kinesiol. 2012 Jun;22(3):485-93 - PubMed
  35. Perspect Psychol Sci. 2012 May;7(3):221-37 - PubMed
  36. J Pers Assess. 1996 Feb;66(1):20-40 - PubMed
  37. Sensors (Basel). 2016 Jan 18;16(1):null - PubMed
  38. Sci Data. 2017 Aug 15;4:170110 - PubMed
  39. Int J Psychophysiol. 2006 Jul;61(1):5-18 - PubMed
  40. Sci Rep. 2014 May 21;4:4998 - PubMed
  41. Psychosom Med. 1968 Sep-Oct;30(5):Suppl:631-53 - PubMed
  42. IEEE Trans Biomed Eng. 2013 Jun;60(6):1660-6 - PubMed
  43. Nat Commun. 2016 May 23;7:11650 - PubMed
  44. ScientificWorldJournal. 2014;2014:627892 - PubMed
  45. IEEE Trans Biomed Eng. 1985 Mar;32(3):230-6 - PubMed
  46. Am J Psychiatry. 1997 Nov;154(11):1571-5 - PubMed
  47. Arch Intern Med. 1993 Sep 27;153(18):2093-101 - PubMed
  48. Psychol Rev. 2003 Jan;110(1):145-72 - PubMed
  49. Int J Neural Syst. 2017 Mar;27(2):1650041 - PubMed
  50. Brain Cogn. 2007 Dec;65(3):209-37 - PubMed
  51. Int J Chronobiol. 1976;4(2):97-110 - PubMed
  52. Conf Proc IEEE Eng Med Biol Soc. 2008;2008:682-5 - PubMed
  53. JAMA. 1992 Mar 4;267(9):1244-52 - PubMed
  54. Physiol Meas. 2010 Dec;31(12):1585-603 - PubMed
  55. J Biomed Inform. 2017 Sep;73:159-170 - PubMed
  56. ACS Appl Mater Interfaces. 2018 Sep 19;10(37):31061-31068 - PubMed
  57. Neuropsychobiology. 1993;28(1-2):76-81 - PubMed
  58. IEEE J Biomed Health Inform. 2015 Jan;19(1):140-8 - PubMed
  59. Int J Psychophysiol. 1997 Feb;25(2):97-109 - PubMed
  60. Nature. 2016 Jan 28;529(7587):509-514 - PubMed
  61. Emotion. 2002 Dec;2(4):412-7 - PubMed
  62. Curr Cardiol Rev. 2012 Feb;8(1):14-25 - PubMed
  63. Biol Psychol. 2010 Jul;84(3):383-93 - PubMed
  64. J Gen Intern Med. 2001 Sep;16(9):606-13 - PubMed
  65. Conf Proc IEEE Eng Med Biol Soc. 2007;2007:1511-4 - PubMed
  66. Psychophysiology. 1971 Sep;8(5):656-72 - PubMed

MeSH terms

Publication Types