Sixth Sense is a wearable gestural interface that enhances the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Imagine a world where we can use a piece of paper as computer, a simple frame gesture takes a digital photo or making a call by dialing numbers on your palm! Sixth sense technology makes all these happen.It is based on the concepts of augmented reality and has well implemented the perceptions of it. Sixth sense technology has integrated the real world objects with digital world.


The Sixth Sense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus Sixth Sense also supports multi-touch and multi-user interaction. Article Suggestions : Augmented Reality | Google project glasses

  • Can carry our digital world where ever we go.
  • Access anywhere internet: The users can browse internet on any surface even on their palm.

  • Drawing application: Lets the user draw on any real world surfaces.

  • Mapping : With features of zoom in and zoom out using simple hand gesture.

  • Video newspaper : This enables the readers to view videos along with reading the newspaper. Live sports updates are also available with the help of this device.

  • Capture photos with a simple hand gesture

  • Can make a call by dialling on users palm

  • Check your Flight Status: Just place the ticket in front of the projector and it checks its status from the internet.

  • Watch : The user just needs to make gesture of clock and the watch will be projected on the user’s hand.



Pranav Mistry is a research assistant and a PhD candidate at MIT Media Lab. Before joining MIT he worked as a UX Researcher with Microsoft. He received Master in Media Arts and Sciences from MIT and Master of Design from IIT Bombay. He has completed bachelors’ degree in Computer Science and Engineering.He is from Palanpur, which is situated in northern Gujarat in India. SixthSense has recently attracted global attention. Among some of his previous work, Pranav has invented Mouseless – an invisible computer mouse; intelligent sticky notes that can be searched, located and can send reminders and messages; a pen that can draw in 3D; and a public map that can act as Google of physical world. Pranav holds a Master in Media Arts and Sciences from MIT and Master of Design from Industrial Design Center,IIT Bombay besides his Bachelor degree in Computer Engineering from Nirma Institute Of Technology, Ahmedabad.

  • Winner of ‘TR35 2009’ award, Technology Review.
  • Winner of ‘INVENTION OF THE YEAR 2009’ award, Popular Science.
  • Winner of ‘Young Indian Innovator 2009’ award, Digit Magazine.
  • Speaker for TED 2009 talk on ‘sixthsense’, TED 2009, Long Beach, CA.

The sixth sense technology definitely marks the beginning of a new era of technology where engineering will reach new milestones.


Leave a Reply

Your email address will not be published. Required fields are marked *