Philosophy lives with a permanently open horizon, leaving unsettled many basic questions regarding morality and mortality. Most people, and all societies, need settled answers to those questions.

Mark Lilla, NYRB 2004-10-21, p.59, col. 4.

Dopamine Activity in Monkeys

January 5th, 2005

Interesting discussion with a friend of mine that led on to subject of addiction. He brought up recent research on dopamine activity in monkeys by Schulz. This was continuing a long line of work which had originally demonstrated a learning effect in the dopamine system as follows. Take a monkey and give it a reward. You see dopamine get released as a form of reward (dopamine is a neurotransmitter that appears to both act as reward and increase plasticity of synapses and neurons). Next you start pairing the reward with a previous signal stimulus such as noise. Gradually over time you see the dopamine release move backwards in time from the point at which the reward is actually received to the point in time when the signal is given. (Aside: interesting parallel with adaptive expectations in economics).

Next you modify the experiment by only giving the monkey a reward with probability p (you have to obviously to quite a bit of training for this). Then what you find is that the surge in dopamine still occurs when the signal is received but the magnitude of this response is an increasing function of the entropy of the signal, given by - Sum (p log p). In this case this = - ( p log(p) + (1-p) log(1-p)) and is maximized at 1/2. This is very interesting. Why would it happen. One obvious reasons presents itself. When entropy is maximal crudely there is the most degree of uncertainty. This would suggest there is most to gain by doing something to try and influence the outcome, it would also suggest there is the most to gain in terms of new information by paying attention and learning from the outcome (dopamine increases plasticity, ie. learning).

This also demonstrates how the learning system gets hijacked by a truly random process. In general experiences are not truly random but will follow some pattern and gradually over time you can learn this pattern and alter your behaviour to take account of it. But in this case the probabilities will never change. This then provides the supposed connection with gambling addiction, with the reinforcement coming from the surge of dopamine in response to uncertainty. However the analogy is not very exact given that in fact gambling generates a very low p and hence low entropy. It is actually pretty certain that you will lose. Gambling seems to exploit something else in us namely that we respond to the structure of the payoff, in particular having a very large payoff but with very small probability. Many fewer people would gamble if there were no jackpot and the same odds were offered but on a payoff of, say, £10.

OPIATE, n. An unlocked door in the prison of Identity. It leads into the jail yard.

From THE DEVIL’S DICTIONARY (1911). Read online at www.dict.org

2.4 Efficiency and Fitts’ Law

“The efficiency of locating and operating screen objects near each other - in this case the navigation menu and scrollbar - as observed by researchers at the NCI and theorized by Nielsen (1999), can be explained by Fitts’ Law, a robust model of human psychomotor behavior developed by psychologist Paul M. Fitts. Essentially, movement time is affected by the distance moved and the precision demanded by the size of the target to which one is moving. Fitts’ Law enables the prediction of human movement and human motion based on rapid, aimed movement, such as found in the use of a computer mouse. Fitts (1954) discovered that movement time is a logarithmic function of distance when target size was held constant, and that movement time is also a logarithmic function of target size when distance was held constant. The time to acquire a target is therefore a function of the distance to and size of the target.

Fitts’ law has been frequently applied to computer interface design (Mackenzie 1992). For all intents and purposes, it simply means that the bigger and closer an item is, the easier it is to click. Position on the screen, then, is a key factor in “ease of click”. In general, shorter mouse movements are better according to Fitts’ law. Therefore, locating the main navigation menu next to the scrollbar on the right side of a Web page should indeed reduce the time required to alternate between the two.” [Source: http://jodi.ecs.soton.ac.uk/Articles/v04/i01/Kalbach/]

Quotes

December 26th, 2004

Quantity changes quality

Engels (source as yet untraced)

For months I have been getting grief from a toshiba laptop problem wherein the screen fades to invisibility after some random period of time (anything from 5s to several hours). Finally, thanks to the wonders of search engines, I’ve discovered the cause of the problem (and the solution): http://www.hardwareanalysis.com/content/topic/13841/.