Fusing neural networks with process models to aid interpretability
Cognitive models have been limited to operating on researcher-defined feature spaces, but advances in neural networks allow for models that can “see” complex stimuli. However, neural networks trained to map complex stimuli to human responses are difficult to interpret, despite advances in techniques for interpreting network activations. Here I discuss approaches for fusing process models with neural networks to enhance interpretability, including process models that operate on neural-network-defined similarity spaces and in particular on those that train the neural network on the ground truth and add plausible perceptual or decision processes to produce human-like responses.
Adam Sanborn
University of Warwick
Behavioural Science Group
Adam Sanborn is a cognitive scientist interested in the rationality of human behaviour, which he studies with Bayesian models, approximations to Bayesian models, and behavioural experiments. He is interested in developing general-purpose models of cognition that can explain why human behaviour broadly corresponds to Bayesian models, yet also show strong deviations.
In discussion
Greg Cox
University at Albany, SUNY
Laboratory for Integrative Neuro-Cognitive Dynamics
Greg Cox is a cognitive scientist who studies how perception, memory, learning, and decision making unfold together over time to give rise to knowledge and action. In his lab he pairs detailed behavioural measures—response times, speed–accuracy trade-offs, motor trajectories, and eye movements—with mathematical and computational models of how retrieval and decision processes evolve moment to moment. He is broadly interested in the links between episodic and semantic memory and in the principled, invariance-respecting formulation and comparison of cognitive models.
Francis Tuerlinckx
KU Leuven
Quantitative Psychology and Individual Differences
Francis Tuerlinckx is a psychometrician and professor of Quantitative Psychology and Individual Differences at KU Leuven in Belgium. His research deals with the mathematical modeling of various aspects of human behavior. More specifically, he works on item response theory, reaction time modeling, and dynamical systems data analysis.
Andrew Heathcote
University of Amsterdam
Amsterdam Mathematical Psychology Laboratory
Andrew Heathcote is a cognitive scientist whose work centres on evidence accumulation models of rapid decision-making. He is known for developing the Linear Ballistic Accumulator (LBA), a widely used model for understanding how people make choices across laboratory, occupational, and clinical settings. His research integrates mathematical modelling with cognitive science to investigate memory, skill acquisition, and decision control across the lifespan.
Stephen José Hanson
Rutgers University
Department of Psychology
Stephen José Hanson is a professor of psychology at Rutgers University and director of the Rutgers Brain Imaging Center (RUBIC). His research spans learning theory across humans, animals, and machines, including neural network learning algorithms, computational neuroimaging, and deep learning. He was General Chair of NeurIPS (1992) and a founding member of the McDonnell-Pew Cognitive Neuroscience Advisory Board.
Jennifer Trueblood
Indiana University
Profile details coming soon.