1 / 16

Hypothesis Testing

Hypothesis Testing. Part I – As a Diagnostic Test. This video is designed to accompany pages 95-116 in Making Sense of Uncertainty Activities for Teaching Statistical Reasoning Van- Griner Publishing Company. Diagnostic Tests .

kaz
Download Presentation

Hypothesis Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hypothesis Testing Part I – As a Diagnostic Test

  2. This video is designed to accompany pages 95-116 in Making Sense of Uncertainty Activities for Teaching Statistical Reasoning Van-Griner Publishing Company

  3. Diagnostic Tests • Diagnostic tests, such as a field sobriety tests and home pregnancy test, have to choose between two outcomes. • A “positive” outcome means the test has uncovered adequate evidence of what it is designed to find. • A “negative” outcome means the test does not have adequate evidence of what it is designed to find.

  4. Experimentation • Many experiments in medicine, social science, education, etc. are designed to make similar bimodal choices. • A “positive” outcome means the experiment has uncovered adequate evidence that the treatment is effective. • A “negative” outcome means the experiment has not found adequate evidence that the treatment is effective.

  5. Flibanserin Study From TIME: The Flibanserinfindings are based on the study of 1,378 premenopausal women who had been in a monogamous relationship for 10 years on average. The women were randomly assigned to take 100 mg of Flibanserinor a placebo daily and to record daily whether they had sex and whether it was satisfying.

  6. The Choice Flibanserin is no better than a Placebo or Flibanserin is better than a Placebo In this case: Treatment is Not Effective or Treatment is Effective Generally:

  7. Hypothesis Testing The paradigm for deciding between “Treatment is Not Effective” and “Treatment is Effective” is an example of what statisticians call “hypothesis testing.” This diagnostic test is not a kit or a physical examination. Rather, it consists of a collection of mathematical steps.

  8. No Surprise Can’t make this decision risk free. There are two potential mistakes:

  9. Diagnostic Due Process Generally, sensitivity and specificity are used to evaluate how well a screening test performs. That evaluation informs our confidence in results produced by the test. Statistical science tends to focus on specificity for a similar role in hypothesis testing. This is partly because the sensitivity of most common hypothesis testing procedures is pretty good.

  10. Typical Screening Scenario Data from Test Subjects Truth from Gold Standard Apply the Test to a Real Person Application of Test in Practice Evaluation of Test Performance Get Yes/ No Result More likely to believe a “Yes” if the Specificity is high; a “No” if the Sensitivity is high. Compute Sensitivity and Specificity

  11. Hypothesis Testing Analogy Data from Experimental Subjects A Truth is Hypothesized Adopt Awkward Rule: “Based on the data from the experiment, say the treatment is effective.” This is like an automatic “YES” If FPR is small enough, accept the “YES” and conclude treatment is effective. Else: don’t trust the recommended “YES” and conclude that the treatment is not effective. Compute False Positive Rate for Awkward Rule.

  12. Statistical Significance If the estimated false positive rate (FPR) for deciding between “Treatment is Not Effective” and “Treatment is Effective” is low enough – typically less than 0.05 - the results of the experiment are said to be statistically significant.

  13. Important Vocabulary Testing a hypothesis in the present context means choosing between H0: Treatment is Not Effective - the “null” hypothesis and HA: Treatment is Effective - the “alternative” hypothesis To make the choice, we have to compute an estimated false positive rate and compare it to 0.05. If the estimated FPR is smaller than 0.05, choose HA. Else, choose H0.

  14. Also Known As … In hypothesis testing the estimated false positive rate is more commonly called a p-value. That stands for “probability value”.

  15. Liberties • Statistical science, particularly statistical inference, is a very complex endeavor. In this presentation we have purposely avoided discussing a few things, including: • The distinction between two very different approaches to hypothesis testing due to Fisher and Neyman-Pearson. • The difference between a p-value and a Type I error rate. • The real and important distinction between “Accepting H0” and “Failing to Reject H0”. • Your instructor may want to offer more details.

  16. One-Sentence Reflection Statistical hypothesis testing amounts to a screening test that chooses between a null hypothesis and an alternative hypothesis based on the size of the estimated false positive rate.

More Related