Display options
Cite
Lloyd DR, Medina DJ, Hawk LW, et al. Habituation of reinforcer effectiveness. Front Integr Neurosci. 2014;7:107doi: 10.3389/fnint.2013.00107.
Lloyd, D. R., Medina, D. J., Hawk, L. W., Fosco, W. D., & Richards, J. B. (2014). Habituation of reinforcer effectiveness. Frontiers in integrative neuroscience, 7107. https://doi.org/10.3389/fnint.2013.00107
Lloyd, David R, et al. "Habituation of reinforcer effectiveness." Frontiers in integrative neuroscience vol. 7 (2014): 107. doi: https://doi.org/10.3389/fnint.2013.00107
Lloyd DR, Medina DJ, Hawk LW, Fosco WD, Richards JB. Habituation of reinforcer effectiveness. Front Integr Neurosci. 2014 Jan 09;7:107. doi: 10.3389/fnint.2013.00107. PMID: 24409128; PMCID: PMC3885986.
Copy Download .nbib Format: NLM
Share it on

Front Integr Neurosci. 2014 Jan 09;7:107. doi: 10.3389/fnint.2013.00107.

Habituation of reinforcer effectiveness.

Frontiers in integrative neuroscience

David R Lloyd, Douglas J Medina, Larry W Hawk, Whitney D Fosco, Jerry B Richards

Affiliations

  1. Research Institute on Addictions, State University of New York at Buffalo Buffalo, NY, USA ; School of Medicine and Biomedical Sciences, State University of New York at Buffalo Buffalo, NY, USA.
  2. Research Institute on Addictions, State University of New York at Buffalo Buffalo, NY, USA.
  3. Department of Psychology, State University of New York at Buffalo Buffalo, NY, USA.

PMID: 24409128 PMCID: PMC3885986 DOI: 10.3389/fnint.2013.00107

Abstract

In this paper we propose an integrative model of habituation of reinforcer effectiveness (HRE) that links behavioral- and neural-based explanations of reinforcement. We argue that HRE is a fundamental property of reinforcing stimuli. Most reinforcement models implicitly suggest that the effectiveness of a reinforcer is stable across repeated presentations. In contrast, an HRE approach predicts decreased effectiveness due to repeated presentation. We argue that repeated presentation of reinforcing stimuli decreases their effectiveness and that these decreases are described by the behavioral characteristics of habituation (McSweeney and Murphy, 2009; Rankin etal., 2009). We describe a neural model that postulates a positive association between dopamine neurotransmission and HRE. We present evidence that stimulant drugs, which artificially increase dopamine neurotransmission, disrupt (slow) normally occurring HRE and also provide evidence that stimulant drugs have differential effects on operant responding maintained by reinforcers with rapid vs. slow HRE rates. We hypothesize that abnormal HRE due to genetic and/or environmental factors may underlie some behavioral disorders. For example, recent research indicates that slow-HRE is predictive of obesity. In contrast ADHD may reflect "accelerated-HRE." Consideration of HRE is important for the development of effective reinforcement-based treatments. Finally, we point out that most of the reinforcing stimuli that regulate daily behavior are non-consumable environmental/social reinforcers which have rapid-HRE. The almost exclusive use of consumable reinforcers with slow-HRE in pre-clinical studies with animals may have caused the importance of HRE to be overlooked. Further study of reinforcing stimuli with rapid-HRE is needed in order to understand how habituation and reinforcement interact and regulate behavior.

Keywords: ADHD; behavioral regulation; dopamine; drug addiction; obesity; operant conditioning; psychomotor stimulant; sensory reinforcement

References

  1. Psychopharmacologia. 1973 Jul 19;31(3):239-51 - PubMed
  2. Behav Processes. 1995 Sep;34(3):285-92 - PubMed
  3. Psychopharmacology (Berl). 2003 Aug;169(1):68-76 - PubMed
  4. Physiol Behav. 2007 Jun 8;91(2-3):250-4 - PubMed
  5. Pharmacol Biochem Behav. 1993 May;45(1):131-41 - PubMed
  6. Health Psychol. 2008 Jan;27(1S):S10-9 - PubMed
  7. Front Integr Neurosci. 2007 Nov 30;1:9 - PubMed
  8. Appetite. 2010 Feb;54(1):23-9 - PubMed
  9. J Pharmacol Exp Ther. 1999 Oct;291(1):19-30 - PubMed
  10. Psychon Bull Rev. 1995 Jun;2(2):234-8 - PubMed
  11. Psychol Rev. 1953 Jul;60(4):257-68 - PubMed
  12. Behav Processes. 1994 Apr;31(2-3):207-17 - PubMed
  13. Drug Alcohol Depend. 2012 Aug 1;124(3):216-22 - PubMed
  14. Nebr Symp Motiv. 2009;55:91-109 - PubMed
  15. Physiol Behav. 1992 Jul;52(1):21-6 - PubMed
  16. Am J Psychiatry. 2004 Jul;161(7):1173-80 - PubMed
  17. Philos Trans R Soc Lond B Biol Sci. 2009 Apr 12;364(1519):1005-20 - PubMed
  18. Behav Processes. 1996 Feb;36(1):67-75 - PubMed
  19. Behav Processes. 2009 Sep;82(1):95-9 - PubMed
  20. Behav Processes. 1995 Jul;34(2):141-52 - PubMed
  21. Brain Res Rev. 2008 Aug;58(2):322-39 - PubMed
  22. J Exp Anal Behav. 1995 Sep;64(2):237-46 - PubMed
  23. Psychopharmacologia. 1973 Sep 28;32(3):285-92 - PubMed
  24. Am J Clin Nutr. 2007 Feb;85(2):355-61 - PubMed
  25. Psychopharmacology (Berl). 2007 Feb;190(3):353-62 - PubMed
  26. Neuropsychology. 2006 Jul;20(4):420-9 - PubMed
  27. J Exp Anal Behav. 1983 Sep;40(2):113-22 - PubMed
  28. J Exp Anal Behav. 1992 Jul;58(1):19-36 - PubMed
  29. Res Autism Spectr Disord. 2008;2(3):469-479 - PubMed
  30. Behav Brain Res. 2012 Oct 1;234(2):312-22 - PubMed
  31. J Exp Anal Behav. 1996 Nov;66(3):369-90 - PubMed
  32. Psychon Bull Rev. 1996 Sep;3(3):372-5 - PubMed
  33. J Appl Behav Anal. 1987 Spring;20(1):45-68 - PubMed
  34. J Exp Anal Behav. 1996 Sep;66(2):205-18 - PubMed
  35. J Exp Anal Behav. 1995 Jul;64(1):75-94 - PubMed
  36. Res Dev Disabil. 2005 Nov-Dec;26(6):527-47 - PubMed
  37. Psychol Rev. 2009 Apr;116(2):384-407 - PubMed
  38. Psychophysiology. 1997 Jan;34(1):116-23 - PubMed
  39. Psychopharmacology (Berl). 2006 Nov;189(1):27-36 - PubMed
  40. JAMA. 2009 Sep 9;302(10):1084-91 - PubMed
  41. Front Neurorobot. 2013 Mar 12;7:4 - PubMed
  42. Exp Clin Psychopharmacol. 2012 Feb;20(1):16-27 - PubMed
  43. Behav Brain Sci. 2005 Jun;28(3):397-419; discussion 419-68 - PubMed
  44. Psychol Rev. 1966 Jan;73(1):16-43 - PubMed
  45. J Comp Physiol Psychol. 1961 Feb;54:59-62 - PubMed
  46. Appetite. 2003 Dec;41(3):283-9 - PubMed
  47. Neurobiol Learn Mem. 2009 Sep;92(2):135-8 - PubMed
  48. Psychopharmacology (Berl). 2006 Mar;184(3-4):353-66 - PubMed
  49. J Neurochem. 1997 May;68(5):2032-7 - PubMed
  50. Psychopharmacology (Berl). 2006 Mar;184(3-4):391-400 - PubMed
  51. Behav Processes. 2011 Feb;86(2):295-304 - PubMed
  52. NCHS Data Brief. 2012 Jan;(82):1-8 - PubMed
  53. Nat Rev Neurosci. 2006 Dec;7(12):967-75 - PubMed
  54. Neurosci Biobehav Rev. 2010 Apr;34(5):744-54 - PubMed
  55. J Exp Anal Behav. 1994 Jul;62(1):109-32 - PubMed
  56. Physiol Behav. 1995 Apr;57(4):675-80 - PubMed
  57. Res Dev Disabil. 2005 Nov-Dec;26(6):548-64 - PubMed
  58. J Exp Anal Behav. 1974 Jan;21(1):159-64 - PubMed
  59. Appetite. 2013 Jan;60(1):40-50 - PubMed
  60. Neurosci Biobehav Rev. 2006;30(7):1045-64 - PubMed
  61. Learn Motiv. 2008 Aug;39(3):243-255 - PubMed
  62. Obes Res. 2004 Feb;12(2):224-32 - PubMed
  63. J Exp Anal Behav. 2013 Jul;100(1):61-78 - PubMed
  64. Pharmacol Biochem Behav. 1986 Jul;25(1):17-22 - PubMed
  65. J Comp Physiol Psychol. 1958 Oct;51(5):575-9 - PubMed
  66. Am J Psychiatry. 2012 Feb;169(2):160-6 - PubMed
  67. Neuroscience. 2011 Dec 15;198:138-51 - PubMed
  68. J Comp Physiol Psychol. 1966 Aug;62(1):143-6 - PubMed
  69. Psychol Res. 2011 Sep;75(5):384-92 - PubMed
  70. Psychopharmacology (Berl). 2002 Sep;163(2):230-7 - PubMed
  71. Behav Processes. 2012 Oct;91(2):184-91 - PubMed
  72. J Am Diet Assoc. 2007 Mar;107(3):441-7 - PubMed
  73. J Comp Physiol Psychol. 1966 Aug;62(1):35-42 - PubMed
  74. Biol Psychiatry. 2005 Jun 1;57(11):1410-5 - PubMed
  75. Eat Behav. 2011 Aug;12(3):214-8 - PubMed
  76. Pharmacol Biochem Behav. 2001 Dec;70(4):515-30 - PubMed
  77. J Abnorm Psychol. 2012 May;121(2):360-71 - PubMed
  78. Psychol Bull. 1963 Nov;60:509-29 - PubMed
  79. Exp Clin Psychopharmacol. 2014 Apr;22(2):166-75 - PubMed
  80. Physiol Behav. 2002 Dec;77(4-5):683-7 - PubMed
  81. Neurotherapeutics. 2012 Jul;9(3):622-34 - PubMed
  82. J Exp Anal Behav. 2000 Nov;74(3):347-61 - PubMed
  83. Behav Brain Res. 2012 May 1;230(2):380-8 - PubMed
  84. Cognition. 2011 Mar;118(3):439-43 - PubMed
  85. J Comp Physiol Psychol. 1962 Aug;55:438-44 - PubMed
  86. Neurobiol Learn Mem. 2009 Sep;92(2):189-98 - PubMed
  87. Clin Psychol Rev. 2005 Feb;25(2):183-213 - PubMed
  88. J Am Acad Child Adolesc Psychiatry. 1987 May;26(3):356-62 - PubMed
  89. Psychol Bull. 1972 May;77(5):319-39 - PubMed
  90. Synapse. 2002 Nov;46(2):79-82 - PubMed
  91. Physiol Behav. 2012 Jun 6;106(3):394-9 - PubMed
  92. J Child Psychol Psychiatry. 2011 Sep;52(9):917-8 - PubMed
  93. Psychopharmacologia. 1974 Jan 14;34(3):199-208 - PubMed
  94. J Exp Anal Behav. 1993 Nov;60(3):621-40 - PubMed
  95. Appetite. 2002 Jun;38(3):224-34 - PubMed
  96. Appetite. 2008 Mar-May;50(2-3):390-6 - PubMed
  97. Psychopharmacology (Berl). 2008 May;197(4):649-60 - PubMed

Publication Types

Grant support