What is Gesture-Based Computing?

It is already common to interact with a new class of devices entirely by using natural gestures. The Microsoft Surface, the iPhone and iPod Touch, the Nintendo Wii, and other gesture-based systems accept input in the form of taps, swipes, and other ways of touching, hand and arm motions, or body movement. These are the first in a growing array of alternative input devices that allow computers to recognize and interpret natural physical gestures as a means of control. We are seeing a gradual shift towards interfaces that adapt to — or are built for — humans and human movements. Gesture-based computing allows users to engage in virtual activities with motion and movement similar to what they would use in the real world, manipulating content intuitively. The idea that natural, comfortable motions can be used to control computers is opening the way to a host of input devices that look and feel very different from the keyboard and mouse — and that enable our devices to infer meaning from the movements and gestures we make.

INSTRUCTIONS: Enter your responses to the questions below. This is most easily done by moving your cursor to the end of the last item and pressing RETURN to create a new bullet point. Please include URLs whenever you can (full URLs will automatically be turned into hyperlinks; please type them out rather than using the linking tools in the toolbar).

Please "sign" your contributions by marking with the code of 4 tildes (~) in a row so that we can follow up with you if we need additional information or leads to examples- this produces a signature when the page is updated, like this: - Sam Sam Nov 1, 2011

(1) How might this technology be relevant to the educational sector you know best?

  • your response here- rolf.schulmeister rolf.schulmeister Nov 16, 2011hand gestures in the air are especially useful in areas that are dangerous, that are dirty, that need speed, that relate to vision and visual objects (maps, directions, etc.) oder visual processes (sign language)
  • The ability for students with disabilities to be able to interact with technologies and tools that they could otherwise not have is a big impact on learning. - JamieMadden JamieMadden Nov 20, 2011
  • Real human movement to aid interaction, linked to internet of things and haptics very powerful- DaveP DaveP Nov 20, 2011
  • The ability to apply direct interaction with data, manipulate digital assets and port information from the immediate environment into the digital space would deepen the learning experience for students and educators alike by reducing the level system user interface intermediation and offering a more engaging and natural mode of interfacing employing the use of intuitive actions. - Dougdar Dougdar Nov 20, 2011

(2) What themes are missing from the above description that you think are important?

(3) What do you see as the potential impact of this technology on teaching, learning, or creative expression?

  • your response here- rolf.schulmeister rolf.schulmeister Nov 16, 2011critically: hand gestures as they are used in iPad or iPhone have limitations if you do not have the chance or the time to clear your fingers, hands, if it is too cold, if the movements necessary (e.g. to draw fine objects) are too small and complicated etc.
  • another response here- rolf.schulmeister rolf.schulmeister Nov 16, 2011positive: in certain respect the gesture driven interface is more natural, intuitive, suited best for children and seniors.
  • If haptics are applied pressure can also act as an indicator of action- DaveP DaveP Nov 20, 2011
  • The incorporation of kinesthetic and tactile elements into the learning environment provides a more immersive interaction, and affords additional channels of sensory input to reinforce the associated information being examined. - Dougdar Dougdar Nov 20, 2011

(4) Do you have or know of a project working in this area?

Please share information about related projects in our Horizon Project sharing form.