# Automatic Differentiation

Requires a Wolfram Notebook System

Interact on desktop, mobile and cloud with the free Wolfram CDF Player or other Wolfram Language products.

Requires a Wolfram Notebook System

Edit on desktop, mobile and cloud with any Wolfram Language product.

This is a dual number expression RPN (reverse Polish notation) calculator for automatic differentiation, modeled on an old-style scientific calculator. Dual numbers are numbers of the form , where , are real and . ( is displayed with and in adjacent boxes. Use the calculator to calculate an arithmetic expression in and reals , , and ). Clicking a value puts the value on top of a pile. Clicking an "op" applies the "op" to the top member(s) of the pile as argument(s), and replaces them on the pile with its value. This is the RPN method of evaluation. The list of buttons clicked will be the reverse Polish notation for the expression. If the result is for a function , its value will be . Thus, is calculated "automatically". Moreover, this will be the result if is any function computable by the calculator. In fact, . It is as if were expanded in a Maclaurin series in , since .

[more]
Contributed by: Roger B. Kirchner (September 2009)

Open content licensed under CC BY-NC-SA

## Snapshots

## Details

The calculator works by extending built-in functions of one or two real variables to duals by and . The chain rule implies these relations hold for every computable function.

For example, if and , then .

In Dual Number (Wolfram *MathWorld*), a dual number is a number of the form , where and are real, and is a matrix such that , such as

Our calculator represents the dual number as the expression , with operations defined by

,

,

, which defines negation () and hence subtraction,

for real , which defines reciprocal () and hence division,

, for functions of one variable,

for functions of two variables,

.

These rules are implemented in *Mathematica* using "up values". With operations thus overloaded, the calculator is implemented as if it were defined only for reals.

References

[1] D. Piponi, "Automatic Differentiation". *A Neighborhood of Infinity*. (Jul 28, 2005) blog.sigfpe.com/2005/07/automatic-differentiation.html.

[2] L. B. Rall, "The Arithmetic of Differentiation," *Mathematics Magazine*, 59(5), 1986, pp. 275–282.

[3] R. D. Neidinger, "Automatic Differentiation and APL," *The College Mathematics Journal*, 20(3), 1989 pp. 238–251.

[4] R. D. Neidinger, "Introduction to Automatic Differentiation and MATLAB Obect Oriented Programming," *SIAM Review*, 52(3), 2010 pp. 545–563.

Also see the Wikipedia entries for Dual number and Automatic differentiation.

## Permanent Citation

"Automatic Differentiation"

http://demonstrations.wolfram.com/AutomaticDifferentiation/

Wolfram Demonstrations Project

Published: September 18 2009