# Estimating Conditional Expectations with Monte Carlo Simulation and Least Squares Regression

Requires a Wolfram Notebook System

Interact on desktop, mobile and cloud with the free Wolfram CDF Player or other Wolfram Language products.

Requires a Wolfram Notebook System

Edit on desktop, mobile and cloud with any Wolfram Language product.

In this Demonstration we consider three random variables, and , which are uniformly distributed on the interval [0,1] and , where , , and are (user-specified) non-negative integers. The purpose is to compute the conditional expectation symbolically and by polynomial regression on data obtained from randomly generated sequences (, ). The display shows the graphs of the conditional expectation function (red) and an estimate (green), explicit formulas giving the exact value of the conditional expectation and its polynomial estimate, and the (square-integrable) error of the estimate, obtained by integrating the square of the difference between the true conditional expectation and the estimated one.

[more]
Contributed by: Andrzej Kozlowski (March 2011)

Open content licensed under CC BY-NC-SA

## Snapshots

## Details

Many problems in science, economics, finance, and so on require us to compute conditional expectations. If and are random variables with nice density, then the conditional expectation can be defined as the orthogonal projection of on the linear subspace space of all functions of in Hilbert space of all (square-integrable) random variables. Thus the conditional expectation can be though of as a function of with the minimum distance from . This justifies the well‐known Monte Carlo method of approximating by generating a sample of (, ) pairs and regressing on by solving a least-squares problem for a polynomial of some chosen degree. In this Demonstration we start with two independent random variables and with uniform distribution on [0,1]. As we take a random variable for some positive integers , , and . In this case *Mathematica* is able to compute the exact formula for , so that we can assess the accuracy of the estimate by computing the norm using numerical integration.

The idea of this Demonstration is based on an example in chapter 11.6 of

K. L. Judd, *Numerical Methods in Economics*, Cambridge, MA: The MIT Press, 1998.

## Permanent Citation