Department of Psychology, University of Kentucky
Michael T. Bardo
Department of Psychology, University of Kentucky;
Acknowledgement: Michael T. Bardo,
The data presented in the current manuscript were collected as part of Justin R. Yates’ doctoral dissertation. The research was funded by NIH Grants P50 DA05312 and T32 DA007304.
Understanding the neurobiological basis of impulsive choice is important for designing effective treatment options for those with disorders characterized by increased impulsivity, such as attention-deficit/hyperactivity disorder (ADHD) and substance use disorders. Dopamine (DA) has received considerable attention because drugs that are efficacious in treating ADHD exert their effects by increasing DA, as well as norepinephrine, levels (see
In addition to DA, recent evidence has implicated glutamate (Glu) dysfunction in impulse-control disorders, including ADHD (
Although there is evidence to support a role for DA and Glu in impulsive choice using systemic injections, few studies have examined the neuroanatomical regions that control the effects of DA on impulsive decision making. To date, research has shown that direct infusions of D1 receptor antagonists (
One important neural mediator of impulsive choice, specifically delay discounting, is the nucleus accumbens core (NAcc). Lesions to NAcc increase preference for a small, immediate reinforcer relative to a larger, delayed reinforcer (
The goal of the present study was to determine the contribution of NAcc DA and Glu receptors to delay discounting. Because sensitivity to delayed reinforcement and sensitivity to reinforcer magnitude independently influence discounting of a reinforcer (
A total of 24 male, individually housed Sprague–Dawley rats (Harlan Industries; Indianapolis, IN) were used in the experiments. Rats weighed approximately 250–275g (approximately postnatal Day 60) upon arrival to the laboratory. Rats were acclimated to a colony room held at a constant temperature and were handled for 5 days upon arrival. Light and dark phases were on a 12-hr light–dark cycle, and each experiment occurred during the light phase. Rats were food restricted (approximately 80% of free feed body weight) 3 days before the beginning of behavioral training, and rats remained on food restriction during the remainder of the study, unless otherwise noted. Rats were cared for in accordance with the Guide for the Care and Use of Laboratory Animals (
The following were purchased from Sigma Aldrich (St. Louis, MO): (±)-SKF-38393 hydrochloride, (±)-SCH-23390 hydrochloride, (-)-quinpirole hydrochloride, S-(-)-eticlopride hydrochloride, (+)-MK-801 hydrogen maleate, D(-)-2-amino-5-phosphonopentanoic acid (AP-5), and 6-cyano-7-nitroquinoxaline-2,3-dione disodium salt hydrate (CNQX). Ifenprodil hemitartrate was purchased from Tocris Bioscience (Ellisville, MO). Each drug was prepared in sterile 0.9% NaCl (saline), except for ifenprodil, which was prepared in sterile water. Concentrations were calculated based on salt weight.
Operant conditioning chambers (28 × 21 × 21 cm; ENV-008; MED Associates, St. Albans, VT) located inside sound-attenuating chambers (ENV-018M; MED Associates) were used. The front and back walls of the experimental chambers were made of aluminum, while the side walls were made of Plexiglas. There was a recessed food tray (5 × 4.2 cm) located 2 cm above the floor in the bottom-center of the front wall. An infrared photobeam was used to record head entries into the food tray. A 28-V white cue light was located 6 cm above each response lever. A white house light was mounted in the center of the back wall of the chamber. All responses and scheduled consequences were recorded and controlled by a computer interface. A computer controlled the experimental session using Med-IV software.
Rats were given 2 days of magazine training, in which sucrose-based 45 mg pellets (F0021 dustless precision pellet, Bio-Serve, Frenchtown, NJ) were noncontingently delivered into the food tray. These sessions were used to habituate rats to the operant chamber. Following magazine training, rats were given lever press training. Each session began with illumination of the house light. A head entry into the food hopper resulted in presentation of one lever. Levers were presented semirandomly, with no more than two consecutive presentations of the same lever. A response on either lever resulted in delivery of one sucrose pellet. Pellets were also delivered noncontingently on a random time 100-s schedule of reinforcement. Following a response on either lever, the house light was extinguished, and the lever was retracted for 5 s. After 5 s, the house light was illuminated. Each session lasted 30 min or following completion of 40 trials, whichever occurred first.
After three sessions, rats received reward magnitude discrimination training, which consisted of 40 trials each day. Each trial lasted 40 s and began with illumination of the house light. A head entry into the food hopper extended one of the levers (semirandomly presented, with no more than two consecutive presentations of the same lever). A response on one lever resulted in immediate delivery of one pellet, whereas a response on the other lever resulted in immediate delivery of four pellets (the lever associated with the large reward magnitude was counterbalanced across rats). Following a response, the house light was extinguished, and the lever was retracted for the remainder of the trial. If a response was not made within 10 s, the trial was scored as an omission, and the house light was extinguished for the remainder of the trial. After 7 days of reward magnitude discrimination training, rats were trained in delay discounting sessions.
Delay discounting sessions consisted of five blocks of nine trials, and each trial lasted 60 s. The first four trials in a block were forced-choice trials, in which only one lever was semirandomly presented (no more than two consecutive presentations of the same lever). The last five trials were free-choice trials, in which both levers were extended. As in reward magnitude discrimination training, a response on one lever always resulted in immediate delivery of one food pellet. A response on the other lever resulted in delivery of four pellets; however, the delay to the delivery of the large magnitude reward increased across blocks of trials (0, 5, 10, 20, 50 s). Following a response on either lever, the house light was extinguished, and the lever was retracted for the remainder of the trial. If a response was not made within 10 s, the trial was scored as an omission, and the house light was extinguished for the remainder of the trial.
After 32 sessions of delay discounting, rats were treated with the nonopioid analgesic carprofen (5 mg/kg, s.c.) 1 day prior to and on the day of surgery. Rats were anesthetized with a mixture of ketamine, xylazine, and acepromazine (75, 7.5, and 0.75 mg/kg, i.p., respectively) and were secured into a stereotaxic frame. Cannulas were implanted bilaterally into NAcc (+1.6 AP, ±1.5 ML, −5.5 DV) at the 10° angle off the midline (
Rats recovered for 3–5 days and were food restricted before receiving 12 additional training sessions in the delay-discounting task. This additional training was important to ensure that surgery did not alter discounting. For intracranial infusions, rats were gently restrained by the experimenter, and a stainless steel injection cannula (33 gauge; Small Parts, Inc, Miramar, FL) was inserted 2 mm below the tip of the guide cannulas. Each cannula was connected to a 10 μl syringe (Hamilton, Reno, NV) via PE10 tubing (Small Parts, Inc, Miramar, FL). The Hamilton syringes were mounted on an infusion pump (KDS Scientific, Holliston, MA). Half of the rats (n = 12) received direct infusions of SKF 38393 (D1-like agonist; 0.03, 0.1 μg;
Following the last day of infusions, rats were euthanized, and brains were removed and flash-frozen in chromasolv (Sigma, St. Louis, MO) on dry ice and stored at −80 °C until sectioning was completed. Brain sections (40 μm) were sliced to determine the location of guide cannulas. Probe placements were evaluated according to the atlas of
For baseline data (averaged across final four sessions before surgery and averaged across final four sessions before first infusion), two analyses were used to determine if discounting differed across rats assigned to receive DA or Glu infusions, as well as to determine if surgery had an effect on discounting. First, a mixed factor ANOVA was used, with experiment (DA vs. Glu) as a between-subjects factor and surgery (Pre vs. Post) and delay as within-subjects factors. To probe a significant interaction, separate independent-samples t tests (with Bonferroni correction) were used. Because ANOVAs do not specify how sensitivity to reinforcer magnitude and/or sensitivity to delayed reinforcement have been altered, the exponential discounting function was fit to each subject’s data via nonlinear mixed effects modeling (NLME;
To determine if intracranial infusions significantly altered omissions, separate Friedman tests were conducted for each drug, and Wilcoxon’s signed-ranked tests (with Bonferroni correction) were used to probe significant main effects, when appropriate. To determine if intracranial infusions of each drug altered discounting, two analyses were used. First, two-way repeated measures ANOVAs were used, with delay and drug concentration as within-subjects factors. Dunnet’s post hoc tests were used to probe a main effect of drug concentration. If there was a significant interaction, separate paired-samples t tests (with Bonferroni correction) were used. Second, separate NLME analyses for each drug were conducted, which defined A and b as free parameters, delay as a continuous, within-subjects factor, drug concentration as a nominal, within-subjects factor, and subject as a random factor. Main effects and interactions were probed using contrasts in R.
To determine if A and b parameter estimates changed across each baseline period (averaged across the two sessions between infusions, as well as across the two sessions before the first infusion and the two sessions following the final infusion), linear trend analyses were conducted for each parameter.
Statistical significance was defined as p < .05 in all cases, with the exception of the Wilcoxon’s signed-ranked tests and independent/paired-samples t tests, in which a Bonferroni correction was applied to control for Type I error. For all ANOVA analyses, degrees of freedom were corrected using Greenhouse-Geisser corrections when sphericity was violated. Additionally, partial eta squared (ηp
For baseline data, results of the ANOVA revealed a significant main effect of delay, F(2.088, 25.053) = 36.612, p < .001, ηp
Administration of AP-5 increased omissions, χ
The goal of the current study was to determine how accumbal DA receptors and ionotropic glutamate receptors, primarily the NMDA receptor subtype, mediate two distinct features of delay discounting: (a) sensitivity to reinforcer magnitude (A parameter); and (b) sensitivity to delayed reinforcement (b parameter). Results showed that SCH-23390 (0.3 μg) decreased sensitivity to a large magnitude reinforcer, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement. These results show that DA and Glu receptors within NAcc differentially mediate two dissociable aspects of discounting performance.
DA D1 and D2 receptors are widely expressed in NAcc (
An unexpected finding from this study is that the lower concentration of SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude, whereas the higher concentration (1.0 μg) did not. One possible explanation for this finding is that SCH 23390 may have lost its selectivity for D1 antagonism at the higher concentration. For example, in addition to blocking D1 receptors, SCH 23390 inhibits the 5-HT transporter (SERT;
Regarding the lack of effect of D2 antagonism on discounting in the current study, one important consideration is that D2 receptor antagonists can be mediated by cues that signal the delay to reinforcement. Specifically,
Whereas blocking D1 receptors decreased sensitivity to reinforcer magnitude, ifenprodil (1.0 μg), which blocks NR2B-containing NMDA receptors, decreased sensitivity to delayed reinforcement. Caution needs to be taken because differences between the highest dose (1.0 μg) of ifenprodil and vehicle only approached statistical significance when all rats were included in the analyses. However, one rat had a b parameter estimate that was 143% higher than the average value following vehicle treatment; additionally, this rat responded for the large reinforcer 60% of the time, even when its delivery was immediate. When this rat was excluded from data analyses, results showed that ifenprodil (1.0 μg) significantly decreased sensitivity to delayed reinforcement. This result is consistent with a previous report showing that Ro 63–1908, a highly selective antagonist for NR2B-containing NMDA receptors, decreases impulsive choice (
The finding that ifenprodil decreased sensitivity to delayed reinforcement is somewhat at odds with previous work from our laboratory showing that systemic administration of ifenprodil decreases sensitivity to reinforcer magnitude without altering impulsive choice (
Although systemic administration of MK-801 has been shown to decrease impulsive choice (
Similar to previous studies (
One procedural limitation to the current study is related to the number of repeated intracranial infusions into the NAcc. Each rat received either nine (DA experiment) or 10 (Glu experiment) infusions. To control for any possible order effects, we counterbalanced the order in which infusions were administered. Because of the small sample sizes (DA experiment: n = 6; Glu experiment: n = 8), we could not conduct statistical analyses to determine if drug infusion order altered the effects of each ligand on discounting, although visual inspection of
Another limitation is the use of a discounting procedure in which delays were only increased across the session. Previous research has shown that the order in which delays are presented can modulate drug effects in discounting procedures (
Despite these limitations, the results of this study show an apparent dissociation in the role of NAcc DA and Glu receptors on delay discounting. Whereas DA D1 receptors appear to mediate sensitivity to reinforcer magnitude, blocking NR2B-containing NMDA receptors decreases sensitivity to delayed reinforcement (i.e., impulsive choice). Overall, these results provide additional evidence for the utility in applying quantitative analyses to discounting data.
Adlersberg, M., Arango, V., Hsiung, S., Mann, J. J., Underwood, M. D., Liu, K., . . .Tamir, H. (2000). In vitro autoradiography of serotonin 5-HT2A/2C receptor-activated G protein: Guanosine-5′-(γ-[
Adriani, W., Boyer, F., Gioiosa, L., Macrì, S., Dreyer, J. L., & Laviola, G. (2009). Increased impulsive behavior and risk proneness following lentivirus-mediated dopamine transporter over-expression in rats’ nucleus accumbens. Neuroscience, 159, 47–58.
Baarendse, P. J. J., & Vanderschuren, L. J. M. J. (2012). Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology, 219, 313–326. 10.1007/s00213-011-2576-x
Bakshi, V. P., & Geyer, M. A. (1998). Multiple limbic regions mediate the disruption of prepulse inhibition produced in rats by the noncompetitive NMDA antagonist dizocilpine. The Journal of Neuroscience, 18, 8394–8401.
Baldwin, A. E., Holahan, M. R., Sadeghian, K., & Kelley, A. E. (2000). N-methyl-D-aspartate receptor-dependent plasticity within a distributed corticostriatal network mediates appetitive instrumental learning. Behavioral Neuroscience, 114, 84–98. 10.1037/0735-7044.114.1.84
Beninger, R. J., Cheng, M., Hahn, B. L., Hoffman, D. C., Mazurski, E. J., Morency, M. A., . . .Stewart, R. J. (1987). Effects of extinction, pimozide, SCH 23390, and metoclopramide on food-rewarded operant responding of rats. Psychopharmacology, 92, 343–349. 10.1007/BF00210842
Ben-Shahar, O. M., Szumlinski, K. K., Lominac, K. D., Cohen, A., Gordon, E., Ploense, K. L., . . .Woodward, N. (2012). Extended access to cocaine self-administration results in reduced glutamate function within the medial prefrontal cortex. Addiction Biology, 17, 746–757. 10.1111/j.1369-1600.2011.00428.x
Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Bradshaw, C. M., Szabadi, E., . . .Deakin, J. F. W. (2008). Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: A quantitative analysis. Behavioural Brain Research, 191, 272–279. 10.1016/j.bbr.2008.03.041
Bezzina, G., Cheung, T. H., Asgari, K., Hampson, C. L., Body, S., Bradshaw, C. M., . . .Anderson, I. M. (2007). Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: A quantitative analysis. Psychopharmacology, 195, 71–84. 10.1007/s00213-007-0882-0
Bezzina, G., Cheung, T. H., Body, S., Deakin, J. F., Anderson, I. M., Bradshaw, C. M., & Szabadi, E. (2009). Quantitative analysis of the effect of lesions of the subthalamic nucleus on intertemporal choice: Further evidence for enhancement of the incentive value of food reinforcers. Behavioural Pharmacology, 20, 437–446. 10.1097/FBP.0b013e3283305e4d
Bidwell, L. C., McClernon, F. J., & Kollins, S. H. (2011). Cognitive enhancers for the treatment of ADHD. Pharmacology, Biochemistry, and Behavior, 99, 262–274. 10.1016/j.pbb.2011.05.002
Broos, N., Diergaarde, L., Schoffelmeer, A. N. M., Pattij, T., & De Vries, T. J. (2012). Trait impulsive choice predicts resistance to extinction and propensity to relapse to cocaine seeking: A bidirectional investigation. Neuropsychopharmacology, 37, 1377–1386. 10.1038/npp.2011.323
Cardinal, R. N., Pennicott, D. R., Sugathapala, C. L., Robbins, T. W., & Everitt, B. J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science, 292, 2499–2501. 10.1126/science.1060818
Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology, 152, 362–375. 10.1007/s002130000536
Chenard, B. L., Shalaby, I. A., Koe, B. K., Ronau, R. T., Butler, T. W., Prochniak, M. A., . . .Fox, C. B. (1991). Separation of α 1 adrenergic and N-methyl-D-aspartate antagonist activity in a series of ifenprodil compounds. Journal of Medicinal Chemistry, 34, 3085–3090. 10.1021/jm00114a018
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Cottone, P., Iemolo, A., Narayan, A. R., Kwak, J., Momaney, D., & Sabino, V. (2013). The uncompetitive NMDA receptor antagonists ketamine and memantine preferentially increase the choice for a small, immediate reward in low-impulsive rats. Psychopharmacology, 226, 127–138. 10.1007/s00213-012-2898-3
da Costa Araújo, S., Body, S., Hampson, C. L., Langley, R. W., Deakin, J. F., Anderson, I. M., . . .Szabadi, E. (2009). Effects of lesions of the nucleus accumbens core on inter-temporal choice: Further observations with an adjusting-delay procedure. Behavioural Brain Research, 202, 272–277. 10.1016/j.bbr.2009.04.003
Dar, M. S. (2002). Mouse cerebellar adenosine-glutamate interactions and modulation of ethanol-induced motor incoordination. Alcoholism: Clinical and Experimental Research, 26, 1395–1403.
Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F. S., & Bannerman, D. M. (2005). Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology, 179, 587–596. 10.1007/s00213-004-2059-4
Dubois, A., Savasta, M., Curet, O., & Scatton, B. (1986). Autoradiographic distribution of the D1 agonist [
Evenden, J. L., & Ryan, C. N. (1996). The pharmacology of impulsive behaviour in rats: The effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology, 128, 161–170. 10.1007/s002130050121
Feja, M., Hayn, L., & Koch, M. (2014). Nucleus accumbens core and shell inactivation differentially affects impulsive behaviours in rats. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 54, 31–42. 10.1016/j.pnpbp.2014.04.012
Floresco, S. B., Tse, M. T. L., & Ghods-Sharifi, S. (2008). Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology, 33, 1966–1979. 10.1038/sj.npp.1301565
Galtress, T., & Kirkpatrick, K. (2010). The role of the nucleus accumbens core in impulsive choice, timing, and reward processing. Behavioral Neuroscience, 124, 26–43. 10.1037/a0018464
Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nature Neuroscience, 13, 25–27. 10.1038/nn.2460
Griffin, W. C., III, Haun, H. L., Hazelbaker, C. L., Ramachandra, V. S., & Becker, H. C. (2014). Increased extracellular glutamate in the nucleus accumbens promotes excessive ethanol drinking in ethanol dependent mice. Neuropsychopharmacology, 39, 707–717. 10.1038/npp.2013.256
Higgins, G. A., Silenieks, L. B., MacMillan, C., Sevo, J., Zeeb, F. D., & Thevarkunnel, S. (2016). Enhanced attention and impulsive action following NMDA receptor GluN2B-selective antagonist pretreatment. Behavioural Brain Research, 311, 1–14. 10.1016/j.bbr.2016.05.025
Hitchcott, P. K., & Phillips, G. D. (1997). Amygdala and hippocampus control dissociable aspects of drug-associated conditioned rewards. Psychopharmacology, 131, 187–195. 10.1007/s002130050283
Ho, M. Y., Mobini, S., Chiang, T. J., Bradshaw, C. M., & Szabadi, E. (1999). Theory and method in the quantitative analysis of “impulsive choice” behaviour: Implications for psychopharmacology. Psychopharmacology, 146, 362–372. 10.1007/PL00005482
Homberg, J. R. (2012). Serotonin and decision making processes. Neuroscience and Biobehavioral Reviews, 36, 218–236. 10.1016/j.neubiorev.2011.06.001
Jensen, V., Rinholm, J. E., Johansen, T. J., Medin, T., Storm-Mathisen, J., Sagvolden, T., . . .Bergersen, L. H. (2009). N-methyl-D-aspartate receptor subunit dysfunction at hippocampal glutamatergic synapses in an animal model of attention-deficit/hyperactivity disorder. Neuroscience, 158, 353–364. 10.1016/j.neuroscience.2008.05.016
Kheramin, S., Body, S., Mobini, S., Ho, M.-Y., Velázquez-Martinez, D. N., Bradshaw, C. M., . . .Anderson, I. M. (2002). Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: A quantitative analysis. Psychopharmacology, 165, 9–17. 10.1007/s00213-002-1228-6
Koffarnus, M. N., Newman, A. H., Grundt, P., Rice, K. C., & Woods, J. H. (2011). Effects of selective dopaminergic compounds on a delay-discounting task. Behavioural Pharmacology, 22, 300–311. 10.1097/FBP.0b013e3283473bcb
Laurent, V., & Westbrook, R. F. (2008). Distinct contributions of the basolateral amygdala and the medial prefrontal cortex to learning and relearning extinction of context conditioned fear. Learning & Memory, 15, 657–666. 10.1101/lm.1080108
Loos, M., Pattij, T., Janssen, M. C., Counotte, D. S., Schoffelmeer, A. N., Smit, A. B., . . .van Gaalen, M. M. (2010). Dopamine receptor D1/D5 gene expression in the medial prefrontal cortex predicts impulsive choice in rats. Cerebral Cortex, 20, 1064–1070. 10.1093/cercor/bhp167
Maguire, D. R., Henson, C., & France, C. P. (2014). Effects of amphetamine on delay discounting in rats depend upon the manner in which delay is varied. Neuropharmacology, 87, 173–179. 10.1016/j.neuropharm.2014.04.012
Mesches, M. H., Bianchin, M., & McGaugh, J. L. (1996). The effects of intra-amygdala infusion of the AMPA receptor antagonist CNQX on retention performance following aversive training. Neurobiology of Learning and Memory, 66, 324–340. 10.1006/nlme.1996.0073
Miller, E. M., Pomerleau, F., Huettl, P., Gerhardt, G. A., & Glaser, P. E. (2014). Aberrant glutamate signaling in the prefrontal cortex and striatum of the spontaneously hypertensive rat model of attention-deficit/hyperactivity disorder. Psychopharmacology, 231, 3019–3029. 10.1007/s00213-014-3479-4
Miyazaki, K. W., Miyazaki, K., & Doya, K. (2012). Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards. The Journal of Neuroscience, 32, 10451–10457. 10.1523/JNEUROSCI.0915-12.2012
Moschak, T. M., & Mitchell, S. H. (2014). Partial inactivation of nucleus accumbens core decreases delay discounting in rats without affecting sensitivity to delay or magnitude. Behavioural Brain Research, 268, 159–168. 10.1016/j.bbr.2014.03.044
National Research Council. (2011). Guide for the care and use of laboratory animals. Washington, DC: National Academies Press.
Pardey, M. C., Kumar, N. N., Goodchild, A. K., & Cornish, J. L. (2013). Catecholamine receptors differentially mediate impulsive choice in the medial prefrontal and orbitofrontal cortex. Journal of Psychopharmacology, 27, 203–212. 10.1177/0269881112465497
Parkes, S. L., & Balleine, B. W. (2013). Incentive memory: Evidence the basolateral amygdala encodes and the insular cortex retrieves outcome values to guide choice between goal-directed actions. The Journal of Neuroscience, 33, 8753–8763. 10.1523/JNEUROSCI.5071-12.2013
Paxinos, G., & Watson, C. (1998). The rat brain in stereotaxic coordinates (4th ed.). San Diego, CA: Academic Press.
Perlov, E., Philipsen, A., Hesslinger, B., Buechert, M., Ahrendts, J., Feige, B., . . .Tebartz van Elst, L. (2007). Reduced cingulate glutamate/glutamine-to-creatine ratios in adult patients with attention deficit/hyperactivity disorder—A magnet resonance spectroscopy study. Journal of Psychiatric Research, 41, 934–941. 10.1016/j.jpsychires.2006.12.007
Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., & R Core Team. (2017). nlme: Linear and nonlinear mixed effects models (R package, Version 3.1–131) [Computer software]. Retrieved from
Pothuizen, H. H., Jongen-Rêlo, A. L., Feldon, J., & Yee, B. K. (2005). Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats. European Journal of Neuroscience, 22, 2605–2616. 10.1111/j.1460-9568.2005.04388.x
Ramos, M., Goñi-Allo, B., & Aguirre, N. (2005). Administration of SCH 23390 into the medial prefrontal cortex blocks the expression of MDMA-induced behavioral sensitization in rats: An effect mediated by 5-HT2C receptor stimulation and not by D1 receptor blockade. Neuropsychopharmacology, 30, 2180–2191. 10.1038/sj.npp.1300735
Savasta, M., Dubois, A., & Scatton, B. (1986). Autoradiographic localization of D1 dopamine receptors in the rat brain with [
Sharf, R., Lee, D. Y., & Ranaldi, R. (2005). Microinjections of SCH 23390 in the ventral tegmental area reduce operant responding under a progressive ratio schedule of food reinforcement in rats. Brain Research, 1033, 179–185. 10.1016/j.brainres.2004.11.041
Sombers, L. A., Beyene, M., Carelli, R. M., & Wightman, R. M. (2009). Synaptic overflow of dopamine in the nucleus accumbens arises from neuronal activity in the ventral tegmental area. The Journal of Neuroscience, 29, 1735–1742. 10.1523/JNEUROSCI.5562-08.2009
Sukhotina, I. A., Dravolina, O. A., Novitskaya, Y., Zvartau, E. E., Danysz, W., & Bespalov, A. Y. (2008). Effects of mGlu1 receptor blockade on working memory, time estimation, and impulsivity in rats. Psychopharmacology, 196, 211–220. 10.1007/s00213-007-0953-2
Tanno, T., Maguire, D. R., Henson, C., & France, C. P. (2014). Effects of amphetamine and methylphenidate on delay discounting in rats: Interactions with order of delay presentation. Psychopharmacology, 231, 85–95. 10.1007/s00213-013-3209-3
Tsukada, H., Nishiyama, S., Fukumoto, D., Sato, K., Kakiuchi, T., & Domino, E. F. (2005). Chronic NMDA antagonism impairs working memory, decreases extracellular dopamine, and increases D1 receptor binding in prefrontal cortex of conscious monkeys. Neuropsychopharmacology, 30, 1861–1869. 10.1038/sj.npp.1300732
Valencia-Torres, L., Olarte-Sánchez, C. M., da Costa Araújo, S., Body, S., Bradshaw, C. M., & Szabadi, E. (2012). Nucleus accumbens and delay discounting in rats: Evidence from a new quantitative protocol for analyzing inter-temporal choice. Psychopharmacology, 219, 271–283. 10.1007/s00213-011-2459-1
van Gaalen, M. M., van Koten, R., Schoffelmeer, A. N. M., & Vanderschuren, L. J. M. J. (2006). Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biological Psychiatry, 60, 66–73. 10.1016/j.biopsych.2005.06.005
Wade, T. R., de Wit, H., & Richards, J. B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology, 150, 90–101. 10.1007/s002130000402
Wenzel, A., Scheurer, L., Künzi, R., Fritschy, J. M., Mohler, H., & Benke, D. (1995). Distribution of NMDA receptor subunit proteins NR2A, 2B, 2C and 2D in rat brain. Neuroreport, 7, 45–48. 10.1097/00001756-199512000-00010
Winstanley, C. A., Theobald, D. E. H., Dalley, J. W., & Robbins, T. W. (2005). Interactions between serotonin and dopamine in the control of impulsive choice in rats: Therapeutic implications for impulse control disorders. Neuropsychopharmacology, 30, 669–682.
Yates, J. R., Batten, S. R., Bardo, M. T., & Beckmann, J. S. (2015). Role of ionotropic glutamate receptors in delay and probability discounting in the rat. Psychopharmacology, 232, 1187–1196. 10.1007/s00213-014-3747-3
Yates, J. R., Breitenstein, K. A., Gunkel, B. T., Hughes, M. N., Johnson, A. B., Rogers, K. K., & Shape, S. M. (2016). Effects of NMDA receptor antagonists on probability discounting depend on the order of probability presentation. Pharmacology, Biochemistry, and Behavior, 150–151, 31–38. 10.1016/j.pbb.2016.09.004
Yates, J. R., Gunkel, B. T., Rogers, K. K., Hughes, M. N., & Prior, N. A. (2017). Effects of N-methyl-D-aspartate receptor ligands on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting procedure. Psychopharmacology, 234, 461–473. 10.1007/s00213-016-4469-5
Yates, J. R., Perry, J. L., Meyer, A. C., Gipson, C. D., Charnigo, R., & Bardo, M. T. (2014). Role of medial prefrontal and orbitofrontal monoamine transporters and receptors in performance in an adjusting delay discounting procedure. Brain Research, 1574, 26–36. 10.1016/j.brainres.2014.06.004
Yates, J. R., Rogers, K. K., Gunkel, B. T., Prior, N. A., Hughes, M. N., Sharpe, S. M., . . .Shults, H. N. (2017). Effects of Group I metabotropic glutamate receptor antagonists on sensitivity to reinforcer magnitude and delayed reinforcement in a delay-discounting task in rats: Contribution of delay presentation order. Behavioural Brain Research, 322, 29–33. 10.1016/j.bbr.2017.01.015
Zarrindast, M. R., Honardar, Z., Sanea, F., & Owji, A. A. (2011). SKF 38393 and SCH 23390 inhibit reuptake of serotonin by rat hypothalamic synaptosomes. Pharmacology, 87, 85–89. 10.1159/000323232
Zeeb, F. D., Floresco, S. B., & Winstanley, C. A. (2010). Contributions of the orbitofrontal cortex to impulsive choice: Interactions with basal levels of impulsivity, dopamine signaling, and reward-related cues. Psychopharmacology, 211, 87–98. 10.1007/s00213-010-1871-2
Zhang, W.-N., Bast, T., & Feldon, J. (2000). Microinfusion of the non-competitive N-methyl-D-aspartate receptor antagonist MK-801 (dizocilpine) into the dorsal hippocampus of Wistar rats does not affect latent inhibition and prepulse inhibition, but increases startle reaction and locomotor activity. Neuroscience, 101, 589–599. 10.1016/S0306-4522(00)00418-8
Submitted: May 17, 2017 Revised: July 6, 2017 Accepted: July 17, 2017