Glove-Enabled Computer Interactions

Future space suits may be equipped with on-board computing, networking, and helmet-mounted graphical displays to provide astronauts with access to some of the same “apps” that terrestrial smart phone users now take for granted. These may include textual and voice communications, map-based navigation, video/image acquisition, document viewing/editing, and news/weather alerts. Unfortunately, bulky space suit gloves make it impractical to use conventional user interfaces such as a touch screen, keyboard, or mouse. Astronautics will need the functional equivalent of these interfaces to provide the point-and-click and rapid textual/numeric data entry capabilities that these applications require.

The patent-pending Glove-Enabled Computer Operations (GECO) design leverages extravehicular activity (EVA) glove design features as platforms for instrumentation and tactile feedback, enabling the gloves to function as human-computer interface devices. Flexible sensors in each finger enable control inputs that can be mapped to any number of functions (e.g. a mouse click, a keyboard strike, or a button press). A camera tracks hand translation, which is interpreted alternatively as movement of a mouse (change in cursor position on a graphical user interface) or a change in hand position on a virtual keyboard. Programmable vibrotactile actuators aligned with each finger enrich the interface by creating the haptic sensations associated with control inputs (e.g. recoil of a button press).

Prototype GECO gloves, developed in collaboration with Flagsuit LLC and the University of Washington Biorobotics Laboratory, were successfully evaluated in two separate test campaigns in the Advanced Suit Laboratory (ASL) at NASA Johnson Space Center (JSC).

GECO gloves

GECO gloves

In January 2013, five participants used GECO gloves to perform data entry and manual EVA tool-use tasks in an ASL glove box;

GECO3

GECO Glove Box Testing at NASA JSC ASL

In June 2013, three NASA subjects employed the GECO gloves under pressurized conditions in the Mark III Advanced Suit Demonstrator.

GECO Mk III Suit Testing at NASA JSC ASL

GECO Mk III Suit Testing at NASA JSC ASL

 

In both test events, subjects averaged greater than 95% accuracy in using the instrumented gloves to generate desired button strikes. With little training, subjects were also able to effectively use the gloves for text data entry employing a virtual keyboard.

Subject Accuracy Using GECO Gloves in Glove Box

Subject Accuracy Using GECO Gloves in Glove Box

 

Subject Accuracy Using GECO Gloves in Mk III Suit

Subject Accuracy Using GECO Gloves in Mk III Suit

 

In Likert-scale questionnaires, subjects unanimously asserted that GECO components did not adversely impact manual glove function and that the added elements had no adverse impact on conventional EVA tool use.

GECO7

GECO Manual Task Evaluations

GECO Manual Task Evaluations

 

GECO Videos

Video: Suited testing at NASA JSC. Subject using GECO glove in hunt-and-peck texting. 

Video: GECO glove used to emulate touch typing. 

Video: GECO user playing a Simon Says game to demonstrate use of glove.

Video: User employing GECO gloves to “free style.”

 

Acknowledgements

We gratefully acknowledge the support of NASA Glenn Research Center. Work on the GECO System was performed under contract NNX11CA55C. We also gratefully acknowledge the test coordination and on-site support provided by the NASA Johnson Space Center Crew and Thermal Systems Division, Space Suit and Crew Survival Systems Branch.

References

Adams, R.J., Olowin A., Krepkovich, E., Hannaford, B., Lindsay, J., Homer, P., Patrie, J., and Sands, O.S., “Glove-Enabled Computer Operations (GECO): Design and Testing of an Extra-Vehicular Activity Glove Adapted for Human-Computer Interface,” in Proceedings of the AIAA International Conference on Environmental Systems, AIAA-2013-3459, Vail, CO, 2013.

Adams, R.J., Olowin A., Patrie, J., and Homer, P., “Mark III Space Suit Testing of Glove-Enabled Computer Operations (GECO),” to appear in Proceedings of the AIAA International Conference on Environmental Systems, Tucson, AZ, 2014.