• Decision making
  • Conditioning
  • Interval timing
  • Complex cognition
  1. •How do we pick speed-accuracy tradeoffs in simple decisions?

  2. •Is there a generic circuit structure in the brain that is involved in all decisions?

  3. •Does the way we pick speed-accuracy tradeoffs in simple decision making tasks generalize to more complex decisions?


In order to understand the physical basis of human and animal decision making, I focus on developing and testing mathematical/computational decision making models that are extremely simple in terms of an analog, neural circuit-level description. These models are nevertheless capable of implementing ideal, decision-theoretic algorithms that optimize some well-defined measure of performance when appropriately parameterized (e.g., maximizing the rate of rewards earned in a decision-making task with many trials). With less fine-tuning on the part of the circuit designer and more homeostatic feedback control on the part of the circuit, they can also approximate optimal performance heuristically, employing minimally complex circuit structures and diminished parameter sensitivity. Optimized, feedback-controlled versions of these models have explained interesting patterns of reaction times and choice biases by humans that I and my colleagues have predicted and then observed in perceptual/economic decision making, and in patterns of electroencephalographic (EEG) and functional magnetic resonance imaging (fMRI) data in tasks similar to those studied in non-human animals.


These models, which consist of networks of stochastic temporal integration devices (i.e., noisy capacitors, or diffusion processes), make clear predictions that can be tested with simple empirical methods – e.g., classic signal detection and two-alternative forced choice experiments. These models have also clearly shown their ability to emulate, and thereby unify, a variety of existing psychological models of operant/instrumental conditioning (melioration/matching; Simen & Cohen, 2009), interval timing (scalar expectancy theory; Simen, Balci, deSouza, Cohen & Holmes, in press), decision making (sequential probability ratio tests; Balci, Simen, Niyogi, Saxe, Hughes, Holmes & Cohen, 2011; Bogacz, Brown, Moehlis, Holmes & Cohen, 2006; Simen, Cohen & Holmes, 2006; Simen, Contreras, Buck, Hu, Holmes & Cohen, 2009) and even features of  production system models of complex behavior (SOAR, ACT; Polk, Simen, Lewis & Freedman, 2002; Simen & Polk, 2010).


I am currently focusing on extending these stochastic differential equation-based models of two-alternative tasks to decisions with more decision alternatives (McMillen, Simen & Behseta, 2011; Simen, McMillen and Behseta, 2010), and to decisions involving computations on experienced durations of time (Balci, Freestone & Simen, in preparation).

Home

 
 
 

Animation of decision making in action (QuickTime)

Animation of decision making in action

(Flash)