Structural Equation Modeling SEM Some Basic Concepts Kathryn

Structural Equation Modeling (SEM) – Some Basic Concepts Kathryn Sharpe & Wei Zhu

SEM Basics Ø SEM is a statistical technique for testing and estimating causal relationships first proposed in 1921 by the American Geneticist Dr. Sewall Green Wright (18891988) 2

SEM Basics Ø SEM is a set of usually inter-related linear regression equations. Ø SEM without latent variables is called Path Analysis. Ø SEM is a confirmatory analysis procedure although sometimes it can also be used as an exploratory analysis tool. 3

A simple example: Path Diagrams & Equations for Eating Disorder Every variable with an incoming arrow leads to a regression equation. Our regression equation system is as follows: Directional Arrows indicate cause and effect 4

SEM Programs The most popular software packages for SEM are: • LISREL (Karl Gustav Jöreskog & Dag Sörbom) • EQS (Peter Bentler, UCLA) • AMOS • PROC CALIS (and PROC TCALIS) in SAS For this example, we will use PROC CALIS. It takes our linear equations (previous slide) and estimates the parameters for the model. Then it evaluates the goodness of fit of the model. 5

Dr. Karl Gustav Jöreskog (Sweden) & Dr. Peter M. Bentler (USA) Widely viewed as leaders in SEM development in our times 6

SAS Code SAS correlation procedure Proc calis: use cov rather than corr Give the linear equations describing the system Give variances of exogenous variables Suppress Pearson correlations Specifies output Dataset with type Covariance matrix proc corr cov nocorr data=eddata outp=edcova(type=cov); run; proc calis cov mod data=edcova; Lineqs bi = b 1 am + b 2 sw + E 1, sw = b 3 am + b 4 bi + E 2, dt = b 5 bi + b 6 sw + E 3, rd = b 7 dt + E 4 Error ; variances We must set the error Std equal to a parameter E 1 -E 4 = The 1 -The 4 ; value; otherwise it is assumed to be 0 Cov E 1 E 2 = Ps 1; BI and SW are correlated Run; so we must estimate the correlation of their error terms’ variances 7

Results of SAS Analysis: SAS gives us parameter estimates, error estimates, and t-1. 9912 (-4. 02, . 04) values for each path included in the model. We use a t-test to Body Image determine which paths are (BI) significant. In addition, we can. 3341 (. 04, . 63) calculate the confidence intervals. Age of Menstruation (AM) -. 1232 (-. 77, . 52) -. 0525 (-2. 02, 1. 92) -. 1040 (-. 27, . 06) Adolescent Self Worth (SW) -. 2699 (-1. 33, . 79) Drive for Thinness (DT). 8292 (. 72, . 94) Risk for Disorder (RD) 8

Goodness of Fit After reporting the parameter estimates, SAS reports many different measures of fit so we can evaluate it in any way we choose. The more measures we use to evaluate our model, the better. SAS Output: A good fit does not necessarily mean a perfect model. We can still have unnecessary variables or be missing important ones. By convention, a model is “good” if: • GFI >. 90/. 95, • Small Chi-Square value, large p-value, • RMSEA Estimate should be close to zero. 9

Useful Websites Google and Wikipedia have done a good job for searching and summarizing many items including SEM. Type “structural equation modeling” in Google, you will see the SEM wiki site listed as the first item: http: //en. wikipedia. org/wiki/Structural_equation_modeling Looking at the recommended sites towards the end of the SEM wiki page, you will find further useful links such as: 1. A good website for SEM lecture notes: http: //faculty. chass. ncsu. edu/garson/PA 765/structur. htm 2. LISREL: http: //www. ssicentral. com/lisrel/ 3. EQS: http: //www. mvsoft. com/ 4. MPLUS: http: //www. statmodel. com/ 5. GLLAMM: http: //www. gllamm. org/ 6. SEM AFNI (brain functional pathway analysis): http: //afni. nimh. nih. gov/sscc/gangc/Path. Ana. html 7. SAS Proc TCALIS: http: //support. sas. com/documentation/cdl/en/statug/63033/ HTML/default/viewer. htm#statug_tcalis_sect 087. htm 8. The UCLA SAS Web: http: //www. ats. ucla. edu/stat/sas/faq/path_analysis. htm 10

Part II: PCNA and Bootstrap Resampling 1. Partial Correlation Network Analysis

PCNA: Generating a Path Diagram When there is not a hypothesized diagram for a SEM analysis, we can generate a path diagram using partial correlation network analysis. In 2006, Marrelec discussed the concept of detecting an underlying connectivity network in data, and the methods for analysis. He noted the importance of detection without hypothesized relationships, as SEM requires. In 2007, Marrelec et. al. published a work praising the use of Partial Correlation Network Analysis (PCNA) in conjunction with SEM. Partial correlation analysis is a technique that allows us to investigate the relationship between two variables free of influence from other variables. Consider two variables, X and Y. We want to know the correlation of X and Y while controlling for Z. The most intuitive way to understand partial correlation is to consider two regressions. 12

Our PCNA Bootstrap Methodology We have N variables, and we are interested to know which pairs have significant relationships when controlling for all other variables in the system. Additionally, we are interested to know which pairs’ relationships is changed by the disease state of the measured tissue, for example. For each pair of variables, i and j, we regress the two variables individually on all other variables in the system, and calculate the corresponding residuals. This creates two variables, and , representing the original variables free of the influence of all other variables in the system. Then we can evaluate their correlation. is the partial correlation of the variables. However, this is just one number, so we cannot incorporate the influence of covariates into the significance test of this value. This is why we use a bootstrapping procedure. 13

Part II: PCNA and Bootstrap Resampling 2. Bootstrap Resampling

Bootstrap Resampling The idea behind bootstrapping is resampling with replacement. We have our original sample of m subjects. 1 2 3 … i m 1 2 3 … m Select one of them at random, and then replace it before randomly selecting the next. Repeat this m times. Now we have a sample of m subjects consisting of subjects from the original sample. However, some subjects may be repeated, and some subjects from the original sample may not be present in our resample. Use each resample to calculate the partial correlation. Now we have a population of n measurements for each pair of variables. If we perform this analysis on our two datasets individually, we will have 1000 estimates of partial correlation for the normal tissue and 1000 estimates for the diseased tissue. 15

Bootstrap Resampling We will let the significance of the relationships in the normal dataset represent the general significance of partial correlation among variables in the system. We can create a difference variable to estimate the difference of the partial correlation between the normal tissue and diseased tissue. The significance of the differences represents the influence of disease on the partial correlation between variables. The results we must evaluate are two lists of partial correlations (those for the normal tissue, and those for the diseased tissue). Normal Diseased Difference V 1 W 1 V 1 – W 1 V 2 W 2 V 2 – W 2 V 3 W 3 V 3 – W 3 … … … Sort the normal and difference variables. If 0 is contained in the middle 95% of the observations, then we would say the relationship or influence of disease is insignificant for this pair of variables. (This is called the percentile method). 16

Results The results of the PCNA bootstrap in the brain data (four datasets; covariates: drug, group) example is shown at the left. No arrows! At this point, we would ask the collaborating researcher for input on the directionality of each path. For paths not easily determined, we can implement one path in each direction. The results would be a hypothesized relationship that can be verified using structural equation modeling with an independent data set. 17