12 Testing Two Population Means

12.4 (Optional) Effect Size

In Chapter 10 we saw that if a hypothesis test is deemed significant, we then are interested in how significant the result really is. Cohen’s-d can be extended to the case when two independent populations means are being tested. In this case, we can estimate Cohen’s-d using the following formula.

Definition (Cohen’s-d For Two Means).

The Cohen’s-d effect size of a hypothesis test for two population means can be approximated using the formula

d|x¯1-x¯2|sp,

where sp is the pooled standard deviation given by Eq. (12.5).

Since we are estimating the effect from two different samples, we use a poooled standard deviation of the two.5151There are varying estimators of effect size known. Here, we give just a basic treatment of effect sizes. That is to say, this is not a thorough treatment of effect size measures. Judging by the value of Cohen’s-d, we then can determine the importance of the result. As before, we use the following table to determine an appropriate description

Cohen’s-d Effect Size
0.2 Small
0.5 Medium
0.8 Large

12.4.1 Exercises

  1. 1.

    Using Excel, calculate Cohen’s-d for the College Algebra data in Example 12.3.2. Explain how its significance.

  2. 2.

    Create a Python script file that imports two data sets. Have the script output Cohen’s-d. In addition, have Python determine if the value of d is small, medium or large based on where it falls.

  3. 3.

    An alternative to using sp is to use the sample standard deviations of one of the samples. This is called Glass’-Δ. Explain the impact of having sample standard deviations that are relatively different from one another. Which is best to choose?