9887

Fingerspelling Sign Language Using a Hand Model

This Demonstration shows how to translate a line of text into American Manual Alphabet fingerspelling using a simple 3D animated hand model. Select the message to translate from the pull-down menu, then play the animation. Increasing the number of frames per pose and slowing down the time playback gives a smoother animation.

SNAPSHOTS

  • [Snapshot]
  • [Snapshot]
  • [Snapshot]

DETAILS

To translate a line of text into three-dimensional time-varying language, this animated hand model was imported from an X3D file as XML. We derived the dimensions of the hand model from a combination of Defense Advanced Research Projects Agency (DARPA)-sponsored Digital Human published research as well as our own anthropometric study. We employ a method of traversing the X3D XML Document-Object Model (DOM) tree that is very general purpose. It is identical to traversing an animation scene graph in a high-performance 3D animation package.
Note, however, that XML in itself is intrinsically dangerous. For example, the Exponential Entity Expansion is a block of XML code that is both well formed and valid according to the rules of an XML schema, but which when executed recursively expands to overflow memory on the XML parser. We circumvent these difficulties here by pre-importing X3D externally from this notebook, using the necessary Read[ ] or ToExpression[ ] to convert XML string-valued fields, which have similar vulnerabilities for Mathematica.
This version imported 27 hand gesture poses, one for each letter of the alphabet plus a "neutral" hand pose. Double letters are separated by a "bounce" pose built on the double-letter pose. The poses were built in another notebook, which contained 23 sliders—one to set each finger joint rotation—within a Manipulate, plus a user interface to save the current pose into a file.
The Demonstration inserts a "bounce" pose between double letters in the input message.
References
[1] Web 3D Consortium. "VRML 2.0 Sourcebook: X3D Examples Archive." (Jul 6, 2012) www.web3d.org/x3d/content/examples/Vrml2.0Sourcebook.
[2] J. Yang and E. Peña Pitarch, "Kinematic Human Modeling," Technical Report No. VSR-04.02, The Virtual Soldier Research (VSR) Program, The University of Iowa, 2004. web.archive.org/web/20050323085750/http://www.digital-humans.org/Report2004/Documents/01-KinematicHumanModeling.htm.
[3] American Sign Language University (William Vicars). "Sign Language: Dr. Bill's ASL Fingerspelling and Handshape Art." (Jul 6, 2012) www.lifeprint.com/asl101/fingerspelling/abc-gifs/index.htm.
    • Share:

Embed Interactive Demonstration New!

Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details »

Files require Wolfram CDF Player or Mathematica.









 
RELATED RESOURCES
Mathematica »
The #1 tool for creating Demonstrations
and anything technical.
Wolfram|Alpha »
Explore anything with the first
computational knowledge engine.
MathWorld »
The web's most extensive
mathematics resource.
Course Assistant Apps »
An app for every course—
right in the palm of your hand.
Wolfram Blog »
Read our views on math,
science, and technology.
Computable Document Format »
The format that makes Demonstrations
(and any information) easy to share and
interact with.
STEM Initiative »
Programs & resources for
educators, schools & students.
Computerbasedmath.org »
Join the initiative for modernizing
math education.
Step-by-step Solutions »
Walk through homework problems one step at a time, with hints to help along the way.
Wolfram Problem Generator »
Unlimited random practice problems and answers with built-in Step-by-step solutions. Practice online or make a printable study sheet.
Wolfram Language »
Knowledge-based programming for everyone.
Powered by Wolfram Mathematica © 2014 Wolfram Demonstrations Project & Contributors  |  Terms of Use  |  Privacy Policy  |  RSS Give us your feedback
Note: To run this Demonstration you need Mathematica 7+ or the free Mathematica Player 7EX
Download or upgrade to Mathematica Player 7EX
I already have Mathematica Player or Mathematica 7+