10182

# Karhunen-Loeve Directions and Regression

Students sometimes ask about the difference between the regression line and the Karhunen–Loeve direction. The obvious answer a professor might give is that they are different animals! The object of this Demonstration is to give a more interesting answer.
The case of variables, and , is shown. It is assumed that and are bivariate normal with means zero, variances one, and covariance . For , the expected values for the regression lines on and on are shown together with the theoretical Karhunen–Loeve directions. For the estimated regressions and directions are shown along with a scatter plot of the data.

### DETAILS

Consider the multivariate random variable with mean and covariance matrix . Then the Karhunen–Loeve directions are determined by columns of in the eigendecomposition , while the regression of on is
,
where is the matrix with the first row and column removed. In the present example, this simplifies to and similarly for the regression of on .
The related question based on data may be asked. In this case we just replace expectations by their sample estimates.

### PERMANENT CITATION

 Share: Embed Interactive Demonstration New! Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details » Download Demonstration as CDF » Download Author Code »(preview ») Files require Wolfram CDF Player or Mathematica.

#### Related Topics

 RELATED RESOURCES
 The #1 tool for creating Demonstrations and anything technical. Explore anything with the first computational knowledge engine. The web's most extensive mathematics resource. An app for every course—right in the palm of your hand. Read our views on math,science, and technology. The format that makes Demonstrations (and any information) easy to share and interact with. Programs & resources for educators, schools & students. Join the initiative for modernizing math education. Walk through homework problems one step at a time, with hints to help along the way. Unlimited random practice problems and answers with built-in Step-by-step solutions. Practice online or make a printable study sheet. Knowledge-based programming for everyone.