Linear Regression and Correlation Describing Relationship between Two

Linear Regression and Correlation

Describing Relationship between Two Variables l When we study the relationship between two variables we refer to the data as bivariate. l One graphical technique we use to show the relationship between variables is called a scatter diagram. l To draw a scatter diagram we need two variables. We scale one variable along the horizontal axis (X-axis) of a graph and the other variable along the vertical axis (Y-axis).

Describing Relationship between Two Variables – Scatter Diagram Examples

Regression Analysis - Introduction l l Correlation Analysis is the study of the relationship between variables. It is also defined as group of techniques to measure the association between two variables. Scatter Diagram is a chart that portrays the relationship between the two variables. It is the usual first step in correlations analysis. The Dependent Variable is the variable being predicted or estimated. The Independent Variable provides the basis for estimation. It is the predictor variable.

Scatter Diagram Example The sales manager of Copier Sales of America, which has a large sales force throughout the United States and Canada, wants to determine whethere is a relationship between the number of sales calls made in a month and the number of copiers sold that month. The manager selects a random sample of 10 representatives and determines the number of sales calls each representative made last month and the number of copiers sold.

The Coefficient of Correlation, r The Coefficient of Correlation (r) is a measure of the strength of the relationship between two variables. l It shows the direction and strength of the linear relationship between two interval or ratio-scale variables l It can range from -1. 00 to +1. 00. l Values of -1. 00 or +1. 00 indicate perfect and strong correlation. l Values close to 0. 0 indicate weak correlation. l Negative values indicate an inverse relationship and positive values indicate a direct relationship.

Coefficient of Determination ( r 2 ) Interpretation: Coefficient of Determination ( r 2 ) provides the amount of the variation in the dependent variable (Y) explained by the variation in the independent variable (X).

Correlation Coefficient - Example EXAMPLE Using the Copier Sales of America data which a scatterplot is shown below, compute the correlation coefficient and coefficient of determination. r = 0. 759 How do we interpret a correlation of 0. 759? First, it is positive and closer to 1. 0. So we see there is a strong direct relationship between the number of sales calls and the number of copiers sold. The value of coefficient of determination of 57. 6% indicates the percentage of variation explained in “the number of copiers sold” by the variation in “the number of calls made by the sales representatives”.

Regression Analysis In regression analysis we use the independent variable (X) to estimate the dependent variable (Y). l The relationship between the variables is linear. l Both variables must be at least interval scale. l The least squares criterion is used to determine the equation. REGRESSION EQUATION An equation that expresses the linear relationship between two variables. LEAST SQUARES PRINCIPLE Determining a regression equation by minimizing the sum of the squares of the vertical distances between the actual Y values and the predicted values of Y.

Regression Equation - Example Recall the example involving Copier Sales of America. The sales manager gathered information on the number of sales calls made and the number of copiers sold for a random sample of 10 sales representatives. Use the least squares method to determine a linear equation to express the relationship between the two variables. What is the expected number of copiers sold by a representative who made 20 calls? b = 1. 1842

SIMPLE REGRESSION – ANOTHER EXAMPLE Suppose a store conducts an analysis of five-month data to determine the effect of advertising on sales revenue. The data are shown below. Use the least squares method to determine a linear equation to express the relationship between the two variables. Advertising Exp. ($100 s) (X) 1 2 3 4 5 Sales Rev. ($1000 s) (Y) 1 1 2 2 4

SIMPLE REGRESSION – ANOTHER EXAMPLE X 1 2 3 4 5 Y 1 1 2 2 4 X 2 1 4 9 16 25 XY 1 2 6 8 20

SIMPLE REGRESSION – ANOTHER EXAMPLE b = 0. 7