Box plot

From Wikipedia, the free encyclopedia

Jump to: navigation, search
Figure 1. Box plot of data from the Michelson-Morley Experiment

In descriptive statistics, a box plot or boxplot (also known as a box-and-whisker diagram or plot) is a convenient way of graphically depicting groups of numerical data through their five-number summaries (the smallest observation (sample minimum), lower quartile (Q1), median (Q2), upper quartile (Q3), and largest observation (sample maximum). A boxplot may also indicate which observations, if any, might be considered outliers.

Boxplots can be useful to display differences between populations without making any assumptions of the underlying statistical distribution: they are non-parametric. The spacings between the different parts of the box help indicate the degree of dispersion (spread) and skewness in the data, and identify outliers. Boxplots can be drawn either horizontally or vertically.

Contents

[edit] Construction

There are a number of conventions used in drawing box plots; the following is a common one.

For a data set, one constructs a horizontal box plot in the following manner:

  • Calculate the first LQ(x.25), the median (x.50) and third quartile (x.75)
  • Calculate the interquartile range (IQR) by subtracting the first quartile from the third quartile. (x.75x.25)
  • Construct a box above the number line bounded on the left by the first quartile (x.25) and on the right by the third quartile (x.75).
  • Indicate where the median lies inside of the box with the presence of a symbol or a line dividing the box at the median value.
  • The mean value of the data can also be labeled with a point.
  • Any data observation which lies more than \scriptstyle 1.5 \cdot\mathrm{IQR} lower than the first quartile or \scriptstyle 1.5 \cdot\mathrm{IQR} higher than the third quartile is considered an outlier. Indicate where the smallest value that is not an outlier is by connecting it to the box with a horizontal line or "whisker". Optionally, also mark the position of this value more clearly using a small vertical line. Likewise, connect the largest value that is not an outlier to the box by a "whisker" (and optionally mark it with another small vertical line).
  • Indicate outliers by open and closed dots. "Extreme" outliers, or those which lie more than three times the IQR (\scriptstyle 3 \cdot\mathrm{IQR}) to the left and right from the first and third quartiles respectively, are indicated by the presence of a closed dot. "Mild" outliers - that is, those observations which lie more than 1.5 times the IQR from the first and third quartile but are not also extreme outliers are indicated by the presence of a open dot. (Sometimes no distinction is made between "mild" and "extreme" outliers.)
  • Add an appropriate label to the number line and title the boxplot.
  • A boxplot may be constructed in a similar manner vertically as opposed to horizontally by merely interchanging "bottom" for "left", "top" for "right" and "vertical" for "horizontal" in the above description.

[edit] Example

A plain-text version might look like this:

                            +-----+-+    
  *           o     |-------|     | |---|
                            +-----+-+    
                                         
+---+---+---+---+---+---+---+---+---+---+---+---+   number line
0   1   2   3   4   5   6   7   8   9  10  11  12

For this data set:

  • smallest non-outlier observation = 5 (left "whisker") (left "whisker" would have been 4 had there been an observation with a value of 4 (Q1 − \scriptstyle 1.5\cdot\mathrm{IQR}))
  • lower quartile (Q1, x.25) = 7
  • median (Med, x.5) = 8.5
  • upper quartile (Q3, x.75) = 9
  • largest non-outlier observation = 10 (right "whisker")
  • interquartile range, IQR = Q3 − Q1 = 2
  • the value 3.5 is a "mild" outlier, between \scriptstyle 1.5 \cdot\mathrm{IQR} and \scriptstyle 3\cdot\mathrm{IQR} below Q1
  • the value 0.5 is an "extreme" outlier, more than \scriptstyle 3\cdot\mathrm{IQR} below Q1
  • the data is skewed to the left (negatively skewed)

The horizontal lines (the "whiskers") extend to at most 1.5 times the box width (the interquartile range) from either or both ends of the box. They must end at an observed value, thus connecting all the values outside the box that are not more than 1.5 times the box width away from the box. Three times the box width marks the boundary between "mild" and "extreme" outliers. In this boxplot, "mild" and "extreme" outliers are differentiated by closed and open dots, respectively.

There are alternative implementations of this detail of the box plot in various software packages, such as the whiskers extending to at most the 5th and 95th (or some more extreme) percentiles. Such approaches do not conform to Tukey's definition, with its emphasis on the median in particular and counting methods in general, and they tend to produce "outliers" for all data sets larger than ten, no matter what the shape of the distribution.[1]

[edit] Alternative forms

Boxplot with whiskers from minimum to maximum
Same Boxplot with whiskers with maximum 1.5 IQR

Box and whisker plots are uniform in their use of the box: the bottom and top of the box are always the 25th and 75th percentile (the lower and upper quartiles, respectively), and the band near the middle of the box is always the 50th percentile (the median). But the ends of the whiskers can represent several possible alternative values, among them:

  • the minimum and maximum of all the data
  • the lowest datum still within 1.5 IQR of the lower quartile, and the highest datum still within 1.5 IQR of the upper quartile
  • one standard deviation above and below the mean of the data
  • the 9th percentile and the 91st percentile
  • the 2nd percentile and the 98th percentile

Any data not included between the whiskers should be plotted as an outlier with a dot, small circle, or star, but occasionally this is not done.

Some box plots include an additional dot or a cross is plotted inside of the box, to represent the mean of the data in addition to the median.

On some box plots a crosshatch is placed on each whisker, before the end of the whisker.

Fairly rarely, box plots can be presented with no whiskers at all.

Because of this variability, it is appropriate to describe the convention being used for the whiskers and outliers in the caption for the plot.

The unusual percentiles 2%, 9%, 91%, 98% are sometimes used for whisker cross-hatches and whisker ends to show the seven-number summary. If the data are normally distributed the locations of the seven marks on the box plot will be equally spaced.

[edit] Visualization

Figure 2. Boxplot and a probability density function (pdf) of a Normal N(0,1σ2) Population

The boxplot is a quick way of examining one or more sets of data graphically. Boxplots may seem more primitive than a histogram or kernel density estimate but they do have some advantages. They take up less space and are therefore particularly useful for comparing distributions between several groups or sets of data (see Figure 1 for an example). Choice of number and width of bins techniques can heavily influence the appearance of a histogram, and choice of bandwidth can heavily influence the appearance of a kernel density estimate.

As looking at a statistical distribution is more intuitive than looking at a boxplot, comparing the boxplot against the probability density function (theoretical histogram) for a normal N(0,1σ2) distribution may be a useful tool for understanding the boxplot (Figure 2).

[edit] See also

[edit] Notes

  1. ^ There are also several minor variations on how to calculate the quartiles (see also quantile), and Tukey (1977) originally proposed instead using another variant that he named "hinges". The difference between the definitions is no more than the difference between two consecutive data values, however, so it is always dwarfed by sampling variability as so is of little practical consequence.

[edit] References

[edit] External links

Personal tools