edoc

The relative merit of empirical priors in non-identifiable and sloppy models: Applications to models of learning and decision-making : Empirical priors

Spektor, Mikhail S. and Kellen, David. (2018) The relative merit of empirical priors in non-identifiable and sloppy models: Applications to models of learning and decision-making : Empirical priors. Psychonomic Bulletin & Review, 25 (6). pp. 2047-2068.

Full text not available from this repository.

Official URL: https://edoc.unibas.ch/64219/

Downloads: Statistics Overview

Abstract

Formal modeling approaches to cognition provide a principled characterization of observed responses in terms of a set of postulated processes, specifically in terms of parameters that modulate the latter. These model-based characterizations are useful to the extent that there is a clear, one-to-one mapping between parameters and model expectations (identifiability) and that parameters can be recovered from reasonably sized data using a typical experimental design (recoverability). These properties are sometimes not met for certain combinations of model classes and data. One suggestion to improve parameter identifiability and recoverability involves the use of "empirical priors", which constrain parameters according to a previously observed distribution of values. We assessed the efficacy of this proposal using a combination of real and artificial data. Our results showed that a point-estimate variant of the empirical-prior method could not improve parameter recovery systematically. We identified the source of poor parameter recovery in the low information content of the data. As a follow-up step, we developed a fully Bayesian variant of the empirical-prior method and assessed its performance. We find that even such a method that takes the covariance structure of the parameter distributions into account cannot reliably improve parameter recovery. We conclude that researchers should invest additional efforts in improving the informativeness of their experimental designs, as many of the problems associated to impoverished designs cannot be alleviated by modern statistical methods alone.
Faculties and Departments:07 Faculty of Psychology > Departement Psychologie > Forschungsbereich Sozial-, Wirtschafts- und Entscheidungspsychologie > Economic Psychology (Rieskamp)
UniBasel Contributors:Spektor, Mikhail Sergeevic
Item Type:Article, refereed
Article Subtype:Research Article
Publisher:Springer
ISSN:1069-9384
e-ISSN:1531-5320
Note:Publication type according to Uni Basel Research Database: Journal article
Identification Number:
Last Modified:28 Nov 2018 16:57
Deposited On:28 Nov 2018 16:57

Repository Staff Only: item control page