Numerical Instability in the Gram-Schmidt Algorithm

The Gram–Schmidt process is an algorithm for converting a set of linearly independent vectors into a set of orthonormal vectors with the same span. The classical Gram–Schmidt algorithm is numerically unstable, which means that when implemented on a computer, round-off errors can cause the output vectors to be significantly non-orthogonal. This instability can be improved with a small adjustment to the algorithm. This Demonstration tests the two algorithms on two families of linearly independent vectors. Selecting "diagonal thousandths" tests the algorithm on the vectors that form the columns of the matrix:
Selecting "Hilbert matrix" tests the algorithm on the vectors that form the columns of the Hilbert matrix:
Both of these families of matrices have small but nonzero determinants, an indicator of sorts that their columns are linearly independent, but barely so. Let be the matrix whose columns are the vectors produced by the algorithm. This Demonstration measures the orthogonality of the resulting vectors via the number . The closer this number is to zero, the closer the columns of are to being orthogonal.
The Mathematica function QRDecomposition produces an orthogonal collection of vectors from a linearly independent one in a highly stable way. The result of this function is shown at the bottom of the pane.


  • [Snapshot]
  • [Snapshot]
  • [Snapshot]
    • Share:

Embed Interactive Demonstration New!

Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details »

Files require Wolfram CDF Player or Mathematica.

Mathematica »
The #1 tool for creating Demonstrations
and anything technical.
Wolfram|Alpha »
Explore anything with the first
computational knowledge engine.
MathWorld »
The web's most extensive
mathematics resource.
Course Assistant Apps »
An app for every course—
right in the palm of your hand.
Wolfram Blog »
Read our views on math,
science, and technology.
Computable Document Format »
The format that makes Demonstrations
(and any information) easy to share and
interact with.
STEM Initiative »
Programs & resources for
educators, schools & students.
Computerbasedmath.org »
Join the initiative for modernizing
math education.
Step-by-Step Solutions »
Walk through homework problems one step at a time, with hints to help along the way.
Wolfram Problem Generator »
Unlimited random practice problems and answers with built-in step-by-step solutions. Practice online or make a printable study sheet.
Wolfram Language »
Knowledge-based programming for everyone.
Powered by Wolfram Mathematica © 2018 Wolfram Demonstrations Project & Contributors  |  Terms of Use  |  Privacy Policy  |  RSS Give us your feedback
Note: To run this Demonstration you need Mathematica 7+ or the free Mathematica Player 7EX
Download or upgrade to Mathematica Player 7EX
I already have Mathematica Player or Mathematica 7+