| Goal: |
|
A hypothesis test is the business of making a decision based on a sample, such as the drug example given earlier. A hypothesis test always contains two competing hypotheses, called the null hypothesis and alternative hypothesis . Both hypotheses will be statements3636A statement evaluates to true or false. about one or more populations, such that one hypothesis is true, and the other false.
In running a hypothesis test, from the sample data a researcher will compute a test statistic. Then, using the test statistic, the researcher will make one of two decisions: Reject or fail to reject The decision of rejecting is made only when the test statistic gives significant evidence against i.e., the test statistic is highly unlikely to be observed if is true. Failing to reject means the observed test statistic is not highly unusual if is true. You can think of as “current” theory, and as the “new” theory to replace the current. In science, a current theory isn’t abandoned in favor of a new theory unless there is strong evidence to do so.3737Willingness to revise thinking based on new data is vital in all of the academic disciplines, as doing otherwise would be extremely stupid.
For example, using the drug example given earlier, and would be as follows:
The pharmaceutical company should not abandon the current drug unless there is strong evidence that the new drug is better, i.e., should not be rejected unless there is strong evidence to do so.
The choice of hypotheses and what constitutes “significant evidence against ” are choices made by the researcher (preferably before collecting data). In making a decision, there are two ways in which a good decision can occur:
is true, and the researcher fails to reject
is false, and the researcher decides to reject
And, there are two ways for a bad decision to occur:
is true, and the researcher decides to reject This is called a Type I error.
is false, and the researcher fails to reject This is called a Type II error.
Note that if is true, then it is impossible to make a Type II error; similarly, if is false, then a Type I error cannot occur. Once the researcher chooses the hypotheses, only two of the four outcomes above are possible, e.g., if is true, then either a good decision is made (fail to reject ) or a Type I error is made (reject ).