Steps and Confidence Intervals in Hypothesis Testing

This section lists four key steps in hypothesis testing and explains the close relationship between confidence intervals and significance tests.

Steps in Hypothesis Testing

Learning Objectives

  1. Be able to state the null hypothesis for both one-tailed and two-tailed tests
  2. Differentiate between a significance level and a probability level
  3. State the four steps involved in significance testing

  1. The first step is to specify the null hypothesis. For a two-tailed test, the null hypothesis is typically that a parameter equals zero although there are exceptions. A typical null hypothesis is \mu_{1}-\mu_{2}=0 which is equivalent to \mu_{1} =\mu_{2}. For a one-tailed test, the null hypothesis is either that a parameter is greater than or equal to zero or that a parameter is less than or equal to zero. If the prediction is that \mu_{1} is larger than \mu_{2}, then the null hypothesis (the reverse of the prediction) is \mu_{2}-\mu_{1} \geq 0. This is equivalent to \mu_{1} \leq \mu_{2}.
  2. The second step is to specify the α level which is also known as the significance level. Typical values are 0.05 and 0.01.
  3. The third step is to compute the probability value (also known as the p value). This is the probability of obtaining a sample statistic as different or more different from the parameter specified in the null hypothesis given that the null hypothesis is true.
  4. Finally, compare the probability value with the α level. If the probability value is lower then you reject the null hypothesis. Keep in mind that rejecting the null hypothesis is not an all-or-none decision. The lower the probability value, the more confidence you can have that the null hypothesis is false. However, if your probability value is higher than the conventional α level of 0.05, most scientists will consider your findings inconclusive. Failure to reject the null hypothesis does not constitute support for the null hypothesis. It just means you do not have sufficiently strong data to reject it.


Source: David M. Lane, https://onlinestatbook.com/2/logic_of_hypothesis_testing/steps.html
Public Domain Mark This work is in the Public Domain.