Sensitivity and Specificity Part I Introduction and Definitions

Sensitivity and Specificity Part I – Introduction and Definitions

This video is designed to accompany pages 81 - 94 in Making Sense of Uncertainty Activities for Teaching Statistical Reasoning Van-Griner Publishing Company

Pregnancy Screening A home pregnancy test (HPT) uses chemistry to bond a particular glycoprotein (h. CG) to an antibody and an indicator. h. CG is secreted by the placenta just after fertilization. There are two ways the test can be wrong. It can say the user is pregnant when she isn’t. Or it can say she is not pregnant when she is.

Yes/No Decisions 1. All screening tests are faced with making a similar decision. 2. Either the test indicates you have what the test is designed to look for (a “positive” or “yes” result) or … 3. The test indicates you don’t have what the test is designed to look for (a “negative” or “no” result). 4. Two decision errors are always possible. .

Naming the Errors Error Can say you do have what the test is looking for, when you really don’t - a false positive - or … Can say you don’t have what the test is looking for, when you really do - a false negative. . These two error rates are a common way to assess how well any screening test is working, not just an HPT. Ideally you want them both to be low.

Important Language Specificity = 1 - false positive rate In generic terms, this is the ability of the screening test to correctly identify “Negatives” as “Negatives” Sensitivity = 1 - false negative rate In generic terms, this is the ability of the screening test to correctly identify “Positives” as “Positives”

Label Claims So just how accurate is an HPT? Clearblue Digital Pregnancy Test • • • No test is more accurate - over 99% accurate from the day of your expected period 2 Results 5 days sooner Unmistakably clear results in words Easy to use with its unique hourglass symbol to show you the test is working Fast – results in just 3 minutes Easy-to-use 1 -step test ----------------------------------------299% accurate at detecting typical hormone levels. Note that hormone levels vary. See product insert.

Say Again? This type of claim relates to a Food and Drug Administration regulation on how these kits have to be screened. 99% means how likely is it that the Clearblue home pregnancy test made by this manufacture shows a positive results when it's testing a non-pregnant woman's urine mixed with a certain amount of commercial h. CG.

Theoretical False Negative Rate The presence of h. CG means you are pregnant. And if there is h. CG present, the HPT will detect it 99% of the time. So the claim is that the Clearblue HPT will fail to say a woman is pregnant when she really is, only 1% of the time. That’s quite good. Most HPTs make that same claim about the sensitivity and false negative rate of HPTs.

False Negative Rate in Practice? Kit Type % Time Kit Didn't Say Subject Was Pregnant, When She Actually Was Ova II Predictor Answer Daisy 2 e. p. t. plus Advance Fact Answer 2 First Response Advance 47. 4 3 22 18 18 10 14 0 0 7. 1 8. 8 Seems to be a lot harder in practice to get just right. These studies used real women, not lab results. From an older study in Arch Fam Med Sept/Oct 1998. A meta-analysis by Bastian, et al.

False Positive Rate in Practice? Kit Type % Time Kit Said Subject Was Pregnant, When She Wasn’t Ova II Predictor Answer Daisy 2 e. p. t. plus Advance Fact Answer 2 First Response Advance 48. 1 4 36 36 25 8 9 6. 5 0 0 Typically claimed to be an error that is less socially problematic. Data from study in Arch Fam Med Sept/Oct 1998. A meta-analysis by Bastian, et al.

Head-to-Head Comparison Kit Type FNR FPR Ova II Predictor Answer Daisy 2 e. p. t. plus Advance Fact Answer 2 First Response Advance 47. 4 3 22 18 18 10 14 0 0 7. 1 8. 8 48. 1 4 36 36 25 8 9 6. 5 0 0 Results are mixed regarding which error is more prevalent. Data from study in Arch Fam Med Sept/Oct 1998. A meta-analysis by Bastian, et al.

One-Sentence Reflection The false positive rate and false negative rate are common numerical assessments of the risks associated with the results of a screening test.