Dichotomous and survival outcomes Brian Healy Ph D

Dichotomous and survival outcomes Brian Healy, Ph. D

Comments from previous class n Book suggestion/practice problems – Fundamentals of Biostatistics by Bernard Rosner – Available in Countway n How do I know when I need help? – When you think your project is more complicated than we have discussed § Correlated observations § Skewed data – This class designed to help you do basic analysis, but also help you communicate with a statistician

Objectives n Dichotomous outcome – Chi-square test – Logistic regression n Survival analysis – Log-rank test

Quick aside n What is the most common proportion to see in the news? – Political polling n Most polls look like this: – 50% of people support Scott Brown – 45% of people support Martha Coakley – Margin of error +/- 3%

Margin of error n What does the margin of error tell us? – The plausible values for the true proportion accounting for sampling variability (chance) n What does the margin of error not tell us? – Sample design § Who was sampled? § How was sampling done? – Was there any missing data? – Were all people treated the same?

Statement regarding accuracy n For confidence interval: n For polling (from http: //www. pollingreport. com/sampling. htm) – We are 95% confident that the true parameter value lies within our confidence bounds – “In theory, with a sample of this size, one can say with 95 percent certainty that the results have a statistical precision of plus or minus __ percentage points of what they would be if the entire adult population had been polled with complete accuracy. Unfortunately, there are several other possible sources of error in all polls or surveys that are probably more serious than theoretical calculations of sampling error. They include refusals to be interviewed (non-response), question wording and question order, interviewer bias, weighting by demographic control data, and screening (e. g. , for likely voters). It is difficult or impossible to quantify the errors that may result from these factors. ”

Review n Steps for hypothesis test – How do we set up a null hypothesis? n Choosing the right test – Continuous outcome/dichotomous predictor: Two sample t-test – Continuous outcome/categorical predictor: ANOVA – Continuous outcome/continuous predictor: Correlation or regression

Types of analysis-independent samples Outcome Explanatory Analysis Continuous Dichotomous Continuous Categorical Continuous Dichotomous Continuous t-test, Wilcoxon test, linear reg ANOVA, linear regression Correlation, linear regression Chi-square test, logistic regression Logistic regression Time to event Dichotomous Log-rank test

Dichotomous outcome n Sustained disease progression in MS is often defined as a one-unit increase on EDSS that lasts for at least six months n This is a common outcome in clinical trials and observational studies n Patients are often classified as progressed or not progressed, which is a dichotomous outcome

Example n MS is known to have a genetic component n Several single nucleotide polymorphisms have been associated with susceptibility to MS n Question: Do patients with susceptibility SNPs experience more sustained progression than patients without susceptibility SNPs?

Data Initially, we will focus on presence vs. absence of SNPs n Among our 190 treated patients, 74 had the SNP and 116 did not n – 12 patients with the SNP experienced sustained progression – 13 patients without the SNP experienced sustained progression

Contingency table A common way to look at this data is a 2 x 2 table n Does the SNP have an effect on whether or not patients progress? n SNP+ SNP- Total Prog 12 13 25 No prog 62 103 165 Total 74 116 190

Question n In our analysis, we assume that the margins are set n Under the null hypothesis of no relationship between the two variables, what would we expect the values in the table be?

Example n As an example, use this table SNP+ Prog No prog Total 50*100/200 =25 50 SNP- Total 150*100/200= 75 100 150*100/200 =75 100 150 200

Expected table n Expected table for our analysis SNP+ Prog No prog Total SNP- Total 25*74/190= 9. 73 25*116/190 =15. 3 25 165*74/190 =64. 3 116*165/ 190=100. 7 165 74 116 190 How different is our observed data compared to the expected table?

Does our data show an effect? n To test for an association between the outcome and the predictor, we would like to know if our observed table was different from the expected table under the null hypothesis n How could we investigate if our table was different? This quantity has a chi-square distribution If it is large, it implies a large difference from the expected

Critical information for c 2 n For 1 degree of freedom, cut-off for a=0. 05 is 3. 84 – For normal distribution, this is 1. 96 – Note 1. 962=3. 84 n Inherently, two-sided since it is squared n Has problems with small cell counts – Fix: Fisher’s exact test

Chi-square distribution Area=0. 05 X 2=3. 84

Hypothesis test with c 2 1) 2) 3) 4) 5) 6) 7) H 0: No association between SNP and progression Dichotomous outcome, dichotomous predictor c 2 test Summary statistic: c 2=0. 99 p-value=0. 32 Since the p-value is greater than 0. 05, we fail to reject the null hypothesis We conclude that there is no significant association between SNP and progression

p-value c 2 statistic

Question: Why 1 degree of freedom? n We used a c 2 distribution with 1 degree of freedom, but there are 4 numbers. Why? – For our analysis, we assume that the margins are fixed. – If we pick one number in the table, the rest of the numbers are known SNP+ Prog No Prog Total SNP- 3 22 71 94 74 116 Total 25 165 190

Estimated effect n When you compare two groups with a dichotomous outcome, there are three common ways to show the difference between the groups – Risk difference § Prob of disease. Group 1 -Prob of disease. Group 2 – Relative risk/risk ratio § Prob of disease. Group 1/Prob of disease. Group 2 – Odds ratio

Odds ratio n Odds: n Odds ratio: – Under the null, what is the OR?

Exposure Disease Y N Total Y a b n 1 N c d n 2 Total m 1 m 2 N This is the estimate of the odds ratio from a cohort study

Exposure Disease Y N Total Y a b n 1 N c d n 2 Total m 1 m 2 N This is the estimate of the odds ratio from a case-control study

Amazing!! n Estimated odds ratio from each kind of study ends up being the same thing!!! n Therefore, we can complete a case control study and get an estimate that we really care about, which is the effect of the exposure on the disease n This relationship is one reason why the odds ratio is so commonly reported

Logistic regression

Types of analysis-independent samples Outcome Explanatory Analysis Continuous Dichotomous Continuous Categorical Continuous Dichotomous Continuous t-test, Wilcoxon test, linear reg ANOVA, linear regression Correlation, linear regression Chi-square test, logistic regression Logistic regression Time to event Dichotomous Log-rank test

Linear regression n When we fit linear regression, we used indicator variables to represent dichotomous predictors – Ex. Effect of gender – Gender=0 if Female – Gender=1 if Male n What is the interpretation of b 1?

Outcome n What if the outcome is dichotomous? – Progression – Y=0 if no progression – Y=1 if progression n Can we just use linear regression with 0/1 as the outcome?

Can we fit a line to this data? Is there another measure?

Better outcome n Rather than investigating the 0/1 value, we focus our attention on the probability of the event n Therefore, we could use the following regression equation n Is there anything wrong with this function?

Technical aside-Probabilities n Probabilities and 1 are required to be between 0 – Does the present equation impose this restriction? – No n We would like a similar equation, but with the restriction that 0<=p<=1 n One option

Logistic regression n The previous function is quite complex to deal with, but we can transform the equation n Note that the right side of the equation looks EXACTLY like our normal regression

Parameter interpretation-review n Let’s think about the following linear regression model for the effect of age on BPF n In linear regression, the meaning of b 1 in this model is that for a one unit increase in age the mean BPF goes up by b 1. n The meaning of b 0 is the mean value of BPF when age=0

Parameter interpretation n How does this change for our logistic model? – Not at all!!! n Logistic model: n The meaning of b 1 in this model is that for a one unit increase in age, the ln(Odds) goes up by b 1 n The meaning of b 0 is the value of ln(Odds) when age=0

Results n When we fit our data, the parameter estimates were n For a one unit increase in age, the estimated log(Odds) increases by 0. 086 n Is this a statistically significant increase?

Hypothesis test If there was no effect of age on the probability of progression, what would the value of b 1 equal? n How could we test the hypothesis that there is no effect? n – H 0: b 1=0 Need an estimate of the variance of the estimated b 1, but this is provided by STATA n Assume approximate normality n

Hypothesis test 1) 2) 3) 4) 5) 6) 7) H 0: b 1=0 Dichotomous outcome with continuous predictor Logistic regression Summary statistic: z=1. 99 p-value=0. 047 Since the p-value is less than 0. 05, we reject the null hypothesis We conclude that there is a significant effect of age at symptom onset on probability of progression

Estimated coefficient for age Estimated intercept coefficient p-value for H 0: b 1=0 p-value for H 0: b 0=0

Conclusions n Logistic regression allows us to investigate the relationship between a continuous predictor and a dichotomous outcome n Interpretation of coefficients is the same as linear regression, but on the log(odds) scale n We can calculate the predicted probability just like we could calculate the predicted mean value

Survival analysis

Types of analysis-independent samples Outcome Explanatory Analysis Continuous Dichotomous Continuous Categorical Continuous Dichotomous Continuous t-test, Wilcoxon test ANOVA, linear regression Correlation, linear regression Chi-square test, logistic regression Logistic regression Time to event Dichotomous Log-rank test

Example n An important marker of disease activity in MS is the occurrence of a relapse – This is the presence of new symptoms that lasts for at least 24 hours n Many clinical trials in MS have demonstrated that treatments increase the time until the next relapse – How does the time to next relapse look in the clinic? n What is the distribution of survival times?

Kaplan-Meier curve Each drop in the curve represents an event

Survival data n To create this curve, patients placed on treatment were followed and the time of the first relapse on treatment was recorded – Survival time If everyone had an event, some of the methods we have already learned could be applied n Often, not everyone has event n – Loss to follow-up – End of study

Censoring n The patients who did not have the event are considered censored – We know that they survived a specific amount of time, but do not know the exact time of the event – We believe that the event would have happened if we observed them long enough n These patients provide some information, but not complete information

Censoring n How could we account for censoring? – Ignore it and say event occurred at time of censoring § Incorrect because this is almost certainly not true – Remove patient from analysis § Potential bias and loss of power – Survival analysis n Our objective is to estimate the survival distribution for patients in the presence of censoring

Comparison of survival curve n One important aspect of survival analysis is the comparison of survival curves n Null hypothesis: survival curve in group 1 is the same as survival curve in group 2 n Method: log-rank test

Example Untreated Treated Patient Time 1 30 2 8+ 2 38 3 15 3 52+ 4 27+ 4 58 5 32 5 66 6 46 6 73+ 7 49 7 77 8 51 8 89 9 55+ 9 107+ 10 70

Technical aside-Log-rank test n To compare survival curves, a log-rank test creates 2 x 2 tables at each event time and combines across the tables – Similar to MH-test a c 2 statistic with 1 degree of freedom (for a two sample comparison) and a p-value n Same procedure for hypothesis testing n Provides

Hypothesis test 1) 2) 3) 4) 5) 6) 7) H 0: Survival distribution in group 1 = survival distribution in group 2 Time to event outcome, dichotomous predictor Log rank test Summary statistic: c 2=4. 4 p-value=0. 036 Since the p-value is less than 0. 05, we reject the null hypothesis We conclude that there is a significant difference in the survival time in the treated compared to untreated

p-value

What we learned n Chi-square test n Logistic regression n Survival analysis