Clicker training

From Wikipedia, the free encyclopedia

Jump to: navigation, search
 This article needs additional citations for verification. Please help improve this article by adding reliable references (ideally, using inline citations). Unsourced material may be challenged and removed. (November 2008)
Clicker-training a dog.

Clicker training is the process of training an animal using a clicker simultaneously as a conditioned reinforcer for the behavior just performed, and a cue that a reinforcer can now be acquired. The name "clicker training" is used because the primary tool is a small mechanical noisemaker called a clicker. The timing of the click indicates to the animal ("marks") the precise behavior that should be repeated in order to receive another reinforcer. Clicker training came about when Marian Kruse and Keller Breland, while studying as graduate students of Psychologist B.F. Skinner, taught wild-caught pigeons to bowl while participating in military research ([1], and later was used in training at least 140 species including whales, bears, lions and domestic dogs and cats ... and humans. [2][3]. [4] [5]It is a technology derived from the study of operant conditioning in behavior analysis. Properly applied the clicker is only used during the acquisition phase of training a new behavior. Once the behavior is sufficiently reliable a cue(ex. verbal "SIT","DOWN") is added. At this point the clicker is no longer needed for this behavior(ie stimulus control is attained). A clicker is just one example of a conditioned reinforcer (secondary reinforcer). Technically a stimulus from any sensory mode may become a conditioned reinforcer (ex. light, smells).

Contents

[edit] Co-founders

B. F. Skinner first identified and described the principles of operant conditioning [6][7] But it was Marian and Keller Breland, two of Skinner’s first students, who saw the possibilities for animal training as a business.

After participating as research students with Skinner in pigeon behavior and training projects during World War II [8] the Brelands left graduate school and formed the first company to intentionally use operant conditioning, Animal Behavior Enterprises (ABE) [9]. They created the first free-flying bird shows, and a host of commercial animal exhibits, from piglet races to chickens playing tic-tac-toe, to an entire “IQ Zoo.” [10]

Bob Bailey was the US Navy's first Director of Training [11] and later came to work at ABE in 1965. Keller Breland died in 1965 and Marian married Bob Bailey in 1976. Together they continued the pioneering work at ABE. Radio-carrying cats were steered through cities and into buildings under a contract with the CIA. Dolphins located targets many miles from their trainers, at sea. Ravens and other birds, carrying cameras and directed by lasers, could fly to a specific window of a skyscraper and photograph the people inside. Gulls, expert sea searchers by nature, could locate and report life rafts and swimmers far offshore.[12].

[edit] Advantages

One of the challenges in training an animal is communicating exactly when the animal has done the behavior that the handler is attempting to reinforce. As a simple example, consider teaching a dog to turn in a circle (spin). At the instant that the dog completes the turn, the handler must let the dog know that it has done the correct thing. However, the traditional "good dog!" takes so long to say that the dog might already have moved on to some other behavior. By the time the dog realizes it is being praised, it might be sitting and scratching or looking for something else to do. In the laboratory behavioral researchers including Norm Guttman, Marian Kruse and Keller Breland, realized that rats always stop what they are doing when they hear the hopper make a sound indicating it was beginning to deliver food, and they tend to do more of what they were doing when the sound occurred. Under the instruction of B.F. Skinner, they decided to try using a sound to mark behavior outside the operant chamber. Toy crickets, the earlier equivalent of today's clicker, were common in those days, and served the purpose very well. The clicker is likened to the surgeon's scalpel; it allows for precise timing and clear communication about what specific behavior is being reinforced, and enables the trainer to teach complex and difficult skills to the animal without the use of force or punishment.

As this type of training was practiced and improved upon, it became apparent that the variability of the human voice, and it's presence during all activities make it a less than salient tool for marking behavior. Besides the imprecision in timing, using the trainer's voice for feedback means that the actual sounds for feedback will vary. A handler's voice, pronunciation, tone, loudness, and emphasis may change even during the same training session. Clicker trainers believe that it is better to use a "click" sound to avoid variations in sound. Many trainers opt to use clickers for training that requires precision and continue to use their voices in the form of praise for behaviors that do not need to be precise.

There is also some circumstantial evidence[13] which suggests that the sound of the clicker is the kind of stimulus — like a bright flash of light or a loud, sudden sound — that reach the amygdala (the center of emotion in the brain) first, before reaching the cortex (the thinking part of the brain). Clicker trainers often see rapid learning, long retention and a "joy" response to the sound of the click in the learning animal. This idea is not universally accepted, and no known research has confirmed it. Any reinforcer can produce joyful behaviors in learners if delivered correctly.

Tasks learned with the clicker are retained even years after the fact and with no additional practice after the initial learning has taken place. This is probably due to the fact that the animal participates fully in the learning process and applies itself to it, learning by trial and error rather than acting out of habit or a momentary response to a situation. Clicker–trained animals become great problem–solvers, develop confidence, and perform their work enthusiastically. This retention of learning is present in positive reinforcement training (including but not exclusive to clicker training), but does not happen with any regularity with correction-based training.

The marker can be any signal that the animal can perceive, so long as the signal is brief (to prevent the problem of imprecise timing) and consistent (to prevent the problem of variations that may confuse the animal). For large sea animals the marker is usually a whistle rather than a clicker. However, not all conditioned reinforcers are sounds. Goldfish and birds such as falcons and hawks can be trained using a quick flash of a flashlight as their "clicker"[14], [15]. Deaf dogs can be trained with a vibrating collar[16]

[edit] Common Misconceptions

There are several common misconceptions about clicker training. Most of these can be a problem for the unskilled clicker trainer, but can be avoided.

-Misconception 1: "The dog will never perform the behavior without the clicker". The clicker should be used to identify correct behavior during training, not to maintain behavior once the behavior has been learned. Once a behavior is performed each time the animal hears a specific cue (known as a command in traditional training), the clicker is discontinued. [17][18]

-Misconception 2: "Dogs will become distracted by the clicks of other trainers in a class or public setting". This is very short-lived problem. Participants in clicker classes find that dogs are easily able to discriminate that only the clicks from their handler pay off. Clicks that don't pay off are soon ignored by animals in learning situations.

-Misconception 3: "Dogs become fat with clicker training because they get too many treats". Part 1 of the solution to this problem is either to use a portion of the dog's regular diet as the training treats or to use reinforcers other than food. Part 2 is to remember that a training treat for a Labrador should be about the size of a pea or an M&M. Smaller dogs get even smaller treats. Larger dogs get only slightly larger treats. Food is not the only reinforcer that can be used in training. A "reinforcer" is anything the animal is willing to work for in the current situation.[19] Common non-food reinforcers include toys, attention, and the opportunity to do something the dog wants.[20] For example, for a dog who wants to go for a walk, putting on the leash can reinforce sitting. Going through the door can reinforce the dog who wants to go outside. Being greeted by someone is the BEST reinforcer for a dog who wants to meet and greet![21]

-Misconception 4: "You can't clicker training in noisy environments". The influence of environmental reinforcers is a challenge sometimes. Training for distractions is done by first training without distractions and then gradually adding complexity to the training environment. [22][23][24]

-Misconception 6: A dog may grow into adulthood and only listen and obey if the owner is carrying treats. If the owner does not have treats, often is the case that the dog is distracted and paying attention to whomever may have treats and food rewards available. This is actually a potential problem with the "Lure Reward" method of training where food is visible. In clicker training the food should not be visible to the animals until the behavior is completed. This could also happen when the trainer uses only one type of reinforcer. If the trainer uses only food, then the dog clearly learns that if food isn't present, then there can be no reinforcement. This is a trainer error. The solution is to use a variety of types of reinforcers and to hold training sessions where food isn't present. Also, you can include running to get the reinforcer into the reinforcement sequence. [25][26][27]

-Misconception 7: "There are some situations where a clicker may not be loud enough, such as in hunting or retrieving when the dog is "working away" from the handler". The clicker is not magic; it is just one type of marker. If the dog can't hear the click, use a different marker such as a whistle or a tone on a collar.[28] Deaf dogs are frequently trained with a flash of light or a hand signal.[29]

- Misconception 8: "Some dogs are sensitive to noise and frightened by a clicker, so clicker training won't work for them". If your dog is afraid of the clicker, then simply choose a different marker -- perhaps even just a word, the clicking of a retractible pen, or a juice cap.[30][31]

[edit] Methodology

The first step in clicker training is to teach the animal that the clicker sound means that they will get a primary reinforcer, usually food. To do this, Some trainers "charge" or "load" the clicker. To do this the trainer clicks the clicker and immediately thereafter gives the animal a reward, usually a tasty treat, one small enough to be consumed almost instantly. Some animals tend to learn the association much more quickly than others. Dogs, for example, often learn the association in one session, with as few as five to 10 repetitions. Progress may be tested by waiting until the dog's attention is elsewhere and then clicking. If the dog immediately looks toward the trainer as though expecting a reward, it is likely that the dog has made the association.

Other trainers, including Bob Bailey and the ABE Trainers, simply start training a behavior and following desired approximations with a click. ABE conducted experiments that demonstrated that for their purposes, where they may be training many animals at the same time, this method was more efficient[32]. Today many clicker trainers use this method of introducing the clicker.

After that, the trainer uses the clicker to mark desired behaviors as they occur. At the exact instant the animal performs the desired behavior, the trainer clicks and promptly delivers a food reward or other reinforcer. One key to clicker training is the trainer's timing; clicking slightly too early or too late rewards and therefore may reinforce whatever behavior is occurring at that instant. The saying goes, ″you get what you click for″.

Clicker trainers often use the process of ″shaping″, which means gradually transforming a specific behavior into the desired behavior by rewarding successive approximations to it. A successive approximation is 'a behavioral term that refers to gradually molding or training an organism to perform a specific [completed] response by [first] reinforcing responses that are similar to the desired response[33]. Clicker trainers learn to "split" behavior instead of "lumping" it, i.e. to look for and reward small steps in the right direction rather than waiting for the whole, ″perfect″ behavior to appear on its own. It is important to create opportunities for the animal to earn rewards very frequently. A reinforcement rate of one click/treat (C/T) every two to three seconds is common among professional dog trainers. Criteria for receiving the click is tightened gradually, at the rate the animal is comfortable with and so that it will remain successful.

[edit] Examples

Alexandra Kurland calls "win-win relationship" the core of horse clicker training. Horses show natural "win-win relationships" among them
First steps of horse clicker training: targeting

Many desired behaviors start with the nose-touch, where the dog learns to touch an identified target, such as a small piece of plastic, with its nose; that behavior can then be transported to perform useful tasks or interesting tricks such as flipping a lightswitch or ringing a bell to go outside.

Training the nose touch begins with getting the dog to touch a target with its nose; trainers sometimes use a guided method, such as placing a dab of peanut butter on a small plate or plastic target; others prefer shaping, where the target is placed in easy reach, such as in the trainer's hand between the trainer and the dog, and the dog is rewarded each time he moves in the target's direction or actually touches it.

When the dog is consistently touching the target, the trainer progresses to a target with and without food and in different positions. Eventually, the trainer can transfer the behavior to a bell, for example by holding the target behind the bell so that the dog has to touch the bell to get at the target, and then rewarding the touching of the bell. When the dog is reliably touching the bell, the trainer now adds the act of opening the door to the reward each time the dog strikes the bell.

Targeting for Horses: For horses, loading or charging the clicker is usually not done. It's best for horses that a clear marker is used so that the horse does not expect "unearned" treats.

[edit] See also

Marian Kruse Breland Bailey

[edit] References

  1. ^ Peterson, G. (2000). The Discovery of Shaping or B.F. Skinner’s Big Surprise. The Clicker Journal: The Magazine for Animal Trainers, 43, 6-13.
  2. ^ http://www.hsnp.com/behavior/page8.html
  3. ^ Burghardt, G.M. (1975). Behavioral research on common animals in small zoos. In Institute of Laboratory Animal Resources (Ed.), Research in zoos and aquariums (pp.103-133). Washington, DC: National Academy of Sciences.
  4. ^ Clicker training aids shelter adoption rates. (1996, August). The Don't Shoot the Dog News, 1(2), 2.
  5. ^ Mellen, J. D., & Ellis, 5. (1996). Animal learning and husbandry training. In D. G. Kleiman, M. E. Allen, K. V. Thompson, & S. Lumpkin (Eds.), Wild mammals in captivity: Principles and techniques (pp.88-99). Chicago: The University of Chicago Press.
  6. ^ Skinner, B.F. (1951). How to teach animals. Scientific American, 185, 26-29.
  7. ^ Skinner, B.F. (1938). The behavior of organisms: An experimental analysis. New York: Appleton-Century-Crofts.
  8. ^ Peterson, G. (2000). The Discovery of Shaping or B.F. Skinner’s Big Surprise. The Clicker Journal: The Magazine for Animal Trainers, 43, 6-13.,
  9. ^ http://www.hsnp.com/behavior/page8.html
  10. ^ PATIENT LIKE THE CHIPMUNKS-Version 2: The Story of Animal Behavior Enterprises. This shorter version PLTC video is especially good for the classroom and for public showings. There are many graphic demonstrations of the power of operant conditioning. Forty-five minutes NTSC $45US PAL $65US (including S&H) ($80 for both NTSC Ver. 1 & 2)
  11. ^ http://www.hsnp.com/behavior/page8.html
  12. ^ The Don’t Shoot the Dog! News, (1996, November), p. 1.
  13. ^ [1]
  14. ^ [2]
  15. ^ [3]
  16. ^ Deaf dog training
  17. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 97
  18. ^ [4]
  19. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 198
  20. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 12-13
  21. ^ [5]
  22. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 100-102
  23. ^ [6]
  24. ^ Barry, Jim (et al). Positive Gun Dogs. Waltham, MA: Sunshine Books, 2007. p. 43
  25. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 37
  26. ^ [7]
  27. ^ [8]
  28. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 12
  29. ^ [9]
  30. ^ Alexander, Melissa. Click for Joy. Waltham, MA: Sunshine Books, 2003. p. 24
  31. ^ [10]
  32. ^ private conversation with Kellie Snider, 2006
  33. ^ http://www.alleydog.com/glossary/definition.cfm?term=Successive%20Approximations

[edit] External links

Retrieved from "http://en.wikipedia.org/wiki/Clicker_training"
Personal tools