Clustering illusion
From Wikipedia, the free encyclopedia
| Hidden messages |
|---|
| Audio |
| Numeric |
| Visual |
| See also: |
The clustering illusion refers to the tendency to erroneously perceive small samples from random distributions as having significant "streaks" or "clusters", caused by a human tendency to underpredict the amount of variability likely to appear in a small sample of random or semi-random data due to chance.[1]
Thomas Gilovich found that most people thought that that the sequence
looked non-random, when, in fact, it has several characteristics maximally probable for a "random" stream, such as having an equal number of each result and the number of adjacent results with the same outcome is equal for both possible outcomes. In sequences like this, people seem to expect to see a greater number of alternations than one would predict statistically. The probability of an alternation in a sequence of random binary events is .5, yet people seem to expect an alternation rate of about .7.[3] In fact, in a short number of trials, variability and non-random-looking "streaks" are quite probable.
Daniel Kahneman and Amos Tversky explained this kind of misprediction as being caused by the representativeness heuristic.[4] Gilovich argues that a similar effect occurs for other types of random dispersions, including 2-dimensional data such as seeing clusters in the locations of impact of V-1 flying bombs on London during World War II or seeing streaks in stock market price fluctuations over time.[1][4]
The clustering illusion was central to a widely reported study by Gilovich, Robert Vallone and Amos Tversky. They found that the idea that basketball players shoot successfully in "streaks", sometimes called by sportcasters as having a "hot hand" and widely believed by Gilovich et al's subjects, was false. In the data they collected, if anything the success of a previous throw very slightly predicted a subsequent miss rather than another success.[5]
Using this cognitive bias in causal reasoning may result in the Texas sharpshooter fallacy. It may also have a relationship with gambler's fallacy. More general forms of erroneous pattern recognition are pareidolia and apophenia.
Clustering (or the illusion of clustering) is also used in the analysis of CSPRNG and TCP/IP Sequence Numbers:
Strange Attractors and TCP/IP Sequence Number Analysis - One Year Later
[edit] Notes
- ^ a b Gilovich, 1991
- ^ Gilovich, 1991 p. 16
- ^ Tune, 1964; Kahneman & Tversky, 1972; Gilovich, Vallone & Tversky, 1985
- ^ a b Kahneman & Tversky, 1972
- ^ Gilovich, Vallone & Tversky, 1985
[edit] References
- Gilovich, T. (1991). How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life. New York: The Free Press. ISBN 0-02-911706-2
- Gilovich, T., Vallone, R. & Tversky, A. (1985). The hot hand in basketball: On the misperception of random sequences. Cognitive Psychology 17, 295-314.
- Kahneman, D. & Amos, T. (1972) "Subjective probability: A judgment of representativeness." Cognitive Psychology, 3 (3), 430-454.
- Tune, G. S. (1964). "Response preference: A review of some relevant literature." Psychological Bulletin, 61, 286-302.
