Next Page Previous Page Home Tools & Aids Search Handbook
7. Product and Process Comparisons
7.4. Comparisons based on data from more than two processes
7.4.7. How can we make multiple comparisons? Bonferroni's method

Simple method The Bonferroni method is a simple method that allows many comparison statements to be made (or confidence intervals to be constructed) while still assuring an overall confidence coefficient is maintained.
Applies for a finite number of contrasts This method applies to an ANOVA situation when the analyst has picked out a particular set of pairwise comparisons or contrasts or linear combinations in advance. This set is not infinite, as in the Scheffé case, but may exceed the set of pairwise comparisons specified in the Tukey procedure.
Valid for both equal and unequal sample sizes The Bonferroni method is valid for equal and unequal sample sizes. We restrict ourselves to only linear combinations or comparisons of treatment level means (pairwise comparisons and contrasts are special cases of linear combinations). We denote the number of statements or comparisons in the finite set by g.
Bonferroni general inequality Formally, the Bonferroni general inequality is presented by:

P{PRODUCT[i=1 to g][A(i)]} >= SUM[i=1 to g][P[Abar(i)]]

where Ai and its complement Abar(i)" are any events.

Interpretation of Bonferroni inequality In particular, if each Ai is the event that a calculated confidence interval for a particular linear combination of treatments includes the true value of that combination, then the left-hand side of the inequality is the probability that all the confidence intervals simultaneously cover their respective true values. The right-hand side is one minus the sum of the probabilities of each of the intervals missing their true values. Therefore, if simultaneous multiple interval estimates are desired with an overall confidence coefficient 1-alpha, one can construct each interval with confidence coefficient (1-alpha/g), and the Bonferroni inequality insures that the overall confidence coefficient is at least 1-alpha.
Formula for Bonferroni confidence interval In summary, the Bonferroni method states that the confidence coefficient is at least 1-alpha that simultaneously all the following confidence limits for the g linear combinations Ci are "correct" (or capture their respective true values):

Chat(i) +/- t(1-alpha/(2*g), N-r)*s(Chat(i))


s(Chat(i)) = sigmahat(e)*SQRT{SUM[i=1 to r][c(i)**2/n(i)]}
Example using Bonferroni method
Contrasts to estimate We wish to estimate, as we did using the Scheffe method, the following linear combinations (contrasts):
C(1) = (mu1 + mu2)/2 - (mu3 + mu4)/2;
  C(2) = (mu1 + mu3)/2 - (mu2 + mu4)/2
and construct 95 % confidence intervals around the estimates.
Compute the point estimates of the individual contrasts The point estimates are:
C(1) = (Ybar1 + Ybar2)/2 - (Ybar3 + Ybar4)/2;
  C(2) = (Ybar1 + Ybar3)/2 - (Ybar2 + Ybar4)/2
Compute the point estimate and variance of C As before, for both contrasts, we have
SUM[i=1 to 4][c(i)**2/n(i)] = 4*(1/2)**2/5 = 0.2

s(Chat)**2 = sigmahat(e)**2*SUM[i=1 to 4][c(i)**2/4]
 = 1.331*0.2 = 0.2661

where sigmahat(e)**2 = 1.331 was computed in our previous example. The standard error is .5158 (the square root of .2661).

Compute the Bonferroni simultaneous confidence interval For a 95 % overall confidence coefficient using the Bonferroni method, the t value is t1-0.05/(2*2),16 = t0.9875,16 = 2.473 (from the t table in Chapter 1). Now we can calculate the confidence intervals for the two contrasts. For C1 we have confidence limits -0.5 ± 2.473 (.5158) and for C2 we have confidence limits 0.34 ± 2.473 (0.5158).

Thus, the confidence intervals are:

-1.776 <= C1 <= 0.776
-0.936 <= C2 <= 1.616
Comparison to Scheffe interval Notice that the Scheffé interval for C1 is:

-2.108 <= C1 <= 1.108

which is wider and therefore less attractive.

Comparison of Bonferroni Method with Scheffé and Tukey Methods
No one comparison method is uniformly best - each has its uses
  1. If all pairwise comparisons are of interest, Tukey has the edge. If only a subset of pairwise comparisons are required, Bonferroni may sometimes be better.

  2. When the number of contrasts to be estimated is small, (about as many as there are factors) Bonferroni is better than Scheffé. Actually, unless the number of desired contrasts is at least twice the number of factors, Scheffé will always show wider confidence bands than Bonferroni.

  3. Many computer packages include all three methods. So, study the output and select the method with the smallest confidence band.

  4. No single method of multiple comparisons is uniformly best among all the methods.
Home Tools & Aids Search Handbook Previous Page Next Page