edoc

A reinforcement learning diffusion decision model for value-based decisions

Fontanesi, Laura and Gluth, Sebastian and Spektor, Mikhail S. and Rieskamp, Jörg. (2019) A reinforcement learning diffusion decision model for value-based decisions. Psychonomic Bulletin & Review, 26 (4). pp. 1099-1121.

[img] PDF - Published Version
Available under License CC BY (Attribution).

2505Kb

Official URL: https://edoc.unibas.ch/72267/

Downloads: Statistics Overview

Abstract

Psychological models of value-based decision-making describe how subjective values are formed and mapped to single choices. Recently, additional efforts have been made to describe the temporal dynamics of these processes by adopting sequential sampling models from the perceptual decision-making tradition, such as the diffusion decision model (DDM). These models, when applied to value-based decision-making, allow mapping of subjective values not only to choices but also to response times. However, very few attempts have been made to adapt these models to situations in which decisions are followed by rewards, thereby producing learning effects. In this study, we propose a new combined reinforcement learning diffusion decision model (RLDDM) and test it on a learning task in which pairs of options differ with respect to both value difference and overall value. We found that participants became more accurate and faster with learning, responded faster and more accurately when options had more dissimilar values, and decided faster when confronted with more attractive (i.e., overall more valuable) pairs of options. We demonstrate that the suggested RLDDM can accommodate these effects and does so better than previously proposed models. To gain a better understanding of the model dynamics, we also compare it to standard DDMs and reinforcement learning models. Our work is a step forward towards bridging the gap between two traditions of decision-making research.
Faculties and Departments:07 Faculty of Psychology > Departement Psychologie > Forschungsbereich Sozial-, Wirtschafts- und Entscheidungspsychologie > Decision Neuroscience (Gluth)
07 Faculty of Psychology > Departement Psychologie > Forschungsbereich Sozial-, Wirtschafts- und Entscheidungspsychologie > Economic Psychology (Rieskamp)
UniBasel Contributors:Gluth, Sebastian and Rieskamp, Jörg and Fontanesi, Laura and Spektor, Mikhail Sergeevic
Item Type:Article, refereed
Article Subtype:Research Article
Publisher:Springer
ISSN:1069-9384
e-ISSN:1531-5320
Note:Publication type according to Uni Basel Research Database: Journal article
Language:English
Related URLs:
Identification Number:
Last Modified:28 Sep 2020 10:55
Deposited On:11 Nov 2019 08:20

Repository Staff Only: item control page