SixthSense

Summary

SixthSense is a gesture-based wearable computer system developed at MIT Media Lab by Steve Mann in 1994 and 1997 (headworn gestural interface), and 1998 (neckworn version), and further developed by Pranav Mistry (also at MIT Media Lab), in 2009, both of whom developed both hardware and software for both headworn and neckworn versions of it. It comprises a headworn or neck-worn pendant that contains both a data projector and camera. Headworn versions were built at MIT Media Lab in 1997 (by Steve Mann) that combined cameras and illumination systems for interactive photographic art, and also included gesture recognition (e.g. finger-tracking using colored tape on the fingers).[3][4][5][6]

Steve Mann wearing a camera+projector dome in 1998, which he used as one node of the collaborative Telepointer system[1]
Pranav Mistry wearing a similar device in 2012, which he and Maes and Chang named "WUW", for Wear yoUr World.[2]
"Gesture-based wearable computer"
"Mann's Gesture-based wearable computer finger-tracking system"
"Front view of gesture-based wearable computer"
1994 prototype of headworn SixthSense gesture-based wearable computing apparatus invented, designed, built, and worn by Steve Mann, MIT Media Lab.[7] Finger-pointing gesture to outline and select a physical object.[8] Front-view shows cameras attached to head-mounted display with wireless communications antennae on helmet.

SixthSense is a name for extra information supplied by a wearable computer, such as the device called EyeTap (Mann), Telepointer (Mann), and "WuW" (Wear yoUr World) by Pranav Mistry.[9][10]

Origin of the name edit

Sixth Sense technology (a camera combined with a light source) was developed in 1997 as a headworn device, and in 1998 as a neckworn object, but the Sixth Sense name for this work was not coined and published until 2001, when Mann coined the term "Sixth Sense" to describe such devices.[11][12]

Mann referred to this wearable computing technology as affording a "Synthetic Synesthesia of the Sixth Sense", believing that wearable computing and digital information could act in addition to the five traditional senses.[13] Ten years later, Pattie Maes, also with MIT Media Lab, used the term "Sixth Sense" in this same context, in a TED talk.

Similarly, other inventors have used the term sixth-sense technology to describe new capabilities that augment the traditional five human senses. For example, in U.S. patent no. 9,374,397, timo platt et als, refer to their new communications invention as creating a new social and personal sense, i.e., a "metaphorical sixth sense", enabling users (while retaining their privacy and anonymity) to sense and share the "stories" and other attributes and information of those around them.

References edit

  1. ^ "Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance", IEEE International Symposium on Wearable Computing (ISWC00), pp. 177, 2000, Los Alamitos, CA, USA
  2. ^ "WUW – wear Ur world: a wearable gestural interface", Proceedings of CHI EA '09 Extended Abstracts on Human Factors in Computing Systems Pages 4111-4116, ACM New York, NY, USA
  3. ^ IEEE Computer, Vol. 30, No. 2, February 1997, Wearable Computing: A First Step Toward Personal Imaging, pp25-32
  4. ^ [Sensularity with a Sixth Sense https://blog.metavision.com/professor-steve-mann-society-of-sensularity-with-a-sixth-sense/]
  5. ^ [Sixth Sense Technology, International Journal of Science and Research (IJSR) ISSN 2319-7064 https://www.ijsr.net/archive/v3i12/U1VCMTQ1Nzc=.pdf]
  6. ^ Kedar Kanel, SIXTH SENSE TECHNOLOGY, 2014, CENTRIA UNIVERSITY OF APPLIED SCIENCES
  7. ^ Wearable, tetherless computer–mediated reality, Steve Mann. February 1996. In Presentation at the American Association of Artificial Intelligence, 1996 Symposium; early draft appears as MIT Media Lab Technical Report 260, December 1994
  8. ^ IEEE Computer, Vol. 30, No. 2, February 1997, Wearable Computing: A First Step Toward Personal Imaging, pp25-32
  9. ^ "IEEE ISWC P. 177" (PDF). Retrieved 2013-10-07.
  10. ^ "Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer", Steve Mann with Hal Niedzviecki, ISBN 0-385-65825-7 (Hardcover), Random House Inc, 304 pages, 2001.
  11. ^ Cyborg, 2001
  12. ^ Geary 2002
  13. ^ An Anatomy of the New Bionic Senses [Hardcover], by James Geary, 2002, 214pp

Further reading edit

  • Elish, M. C. (2011, January). Responsible storytelling: communicating research in video demos. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction (pp. 25–28). ACM.

External links edit

  • Sixthsense Tutorials
  • Steve Mann's SixthSense site
  • Pranav Mistry's SixthSense homepage
  • SixthSense Google code site
  • SixthSense Github repository