Feedback will be the most critical part of our training system. Without adequate feedback, the student might as well be watching a video tape of a master, so we need to experiment and discover what the best way to help the student is. There are really four questions here.

How do we know what a wrong posture/motion is?
How do we tell the student where they are wrong?
How do we tell the student how to fix the problem?
How do we keep guests inside the tracked area?

To address these, we have come up with a number of designs. Ones in red will definitely be tried, ones in black will be tried if we have time.

Annotation of forms
A voice over of the current form can be heard while doing the motion in order to help the student remember which motions will go with which forms. click here to see video

Color incorrect body parts of master and/or student
The more the student deviates from the master, the more red those body parts that deviate become. click here to see video

Center of gravity
An image of the center of gravity of the student in relation to the center of gravity is shown on the display so that the student can try to match his or her center of gravity with that of the master. According to a Tai Chi expert, one of the most important part of doing a form is the proper placement of the person's center of gravity. click here to see video

Physically localized feedback
Attach some feedback device to the student in the real world that will localize the problem. For example, speakers, vibrators, or electrodes

 

Verbal cues from the master
For example, the master says "Keep that left foot in" or "lower your center". This will be done man-behind-the-curtain style for initial testing

 

Viewport
We show another view of the scene with the appropriate body part highlighted as a picture-in-picture view inside the HMD. We could also show diagrams or videos illustrating important points to the student.

 

World Dims
To keep the student inside the proper area, we can dim the lights in the world as they move away from the "sweet spot".

 

Tactile Border
We can define a physical boundary between space the student should move in and space he or she shouldn't with something as simple as placing carpeting on the floor where they shouldn't move. Since the students will be barefoot or in socks, this should be a noticable difference in flooring.

 

Integrated Viewports
Same as above, but rather than a picture-in-picture view, we integrate the images into the environment somehow (for example, screens in the virtual world, models of proper positions which get highlighted in the space, etc.

 

Linear meter of deviation
A simple virtual thermometer is overlaid on the HMD and we reduce the body variation to a simple number between 0 and 100

 

Text or iconic annotation
Icons or text pop up near the incorrect body parts, informing the student of what he or she should do to correct any problem. Something like pop-up video.

 

Slow down of form
When the student deviates too far from the master, the master says "lets slow this down a bit", rewinds the form a few seconds, and goes through the problem area very slowly.