We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Temporal difference models describe higher-order learning in humans.
- Authors
Seymour, Ben; O'Doherty, John P.; Dayan, Peter; Koltzenburg, Martin; Jones, Anthony K.; Dolan, Raymond J.; Friston, Karl J.; Frackowiak, Richard S.
- Abstract
The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.
- Subjects
LEARNING; CLASSICAL conditioning; CONDITIONED response; NEUROBIOLOGY; MAGNETIC resonance imaging; BEHAVIOR
- Publication
Nature, 2004, Vol 429, Issue 6992, p664
- ISSN
0028-0836
- Publication type
Article
- DOI
10.1038/nature02581