MatangHari Blog

Posted on May 3, 2013

OVERVIEW

‘SixthSense’ is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

We’ve evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.

The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture. The user can stop by any surface or wall and flick through the photos he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail. The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.

The current prototype system costs approximate $350 to build.

1. Introduction

People are always curios about how things work. From the knowledge of different kinds of ministry, people tried to copy nature or to go beyond what nature could offer, to further explain these; we people have been creating so many things as of this age. Many things were considered fictions that now exist very natural to our daily lives. The imagination of people created things that would be considered as magical or witchcraft as it was before.

As our imagination take place, brilliant people that are very imaginative created characters with powers and gadgets that were hardly considered concrete and factual. Now, we have these called power tools and it is already possible to create large scale constructions over a 30 story building in just 15 days. I give that credit to China.

Going to the main point, we could relate the Movie Ironman, were he created this hologram technology all over anywhere that are in contact with either air or light frequency, or in other words, these digital graphics are in the air as if it is already existing like natural things around us. Another example was Tron, were the idea of creating a digital world tool place.

Pranav Mistry, a graduate research student with the fluid Interfaces Group at MIT(Massachusetts Institute of Technology), utilized this common fact and along with his team devised something which has been aesthetically named as ‘The Sixth Sense Technology’. The technology claims to bridge the gap between the digital world and the human mind.

This SixthSense Technology utilizes a pocket projector, a camera and a mirror which can be coupled into a compact mobile wearable device. The projector projects the visual information enabling surfaces to be used as interfaces while the camera tracks the user hand gestures and the interfaces, using computer vision based techniques. The technology uses ‘visual tracking fiducials which are actually colored markers at the tip of the user’s fingers. These fiducials are interpreted as gestures that send interaction instructions to the interfaces.

This technology is a revolution in itself since it eliminates the use of all the hardware devices which have become so significant to us lately. The exact scientific circuitry hasn’t been revealed in details but it has been declared that it will be an open protocol which implies that each one of us can access the technology for free. Moreover, we can make our own prototype device suiting our needs and the required application.

This invention is definitely a new phase for the technological world. The world is graduating from a phase of complete dependence on digital accessories to a complete hardware-less world.

2. Objective of the Project.

The Project’s goal is to be able to construct an actual projection of a digital data into any surface. This way, from the touch technology namely Android and IOS technology, we could project digital contents of a hardware into any kind of surface as well as enabling its interaction through the actual gestures as we naturally use it.

Another goal is to be able to synchronize and synthesize individual hardware devices and eliminate negative feedback controls.

3. Building the project.

Basic Components of the Project

“People will be able to make their own hardware. I will give them instructions how to make it. And also provide them key software…give them basic key software layers. . . they will be able to build their own applications. They will be able to modify base level and do anything”.

–Pranav Mistry.

The devices which are used in sixth sense technology:

1. Camera – Logitech QuickCam Pro for notebooks

2. Colored Marker – red, blue, yellow, green

3. Mobile component – any windows computer

4. Projector – Micro vision (laser)

5. Mirror – any 1×1′ mirror

It consists of certain commonly available components, which are intrinsic to its functioning. These include a camera, a portable battery-powered projection system coupled with a mirror and a cell phone.

All these components communicate to the cell phone, which acts as the communication and computation device. The entire hardware apparatus is encompassed in a pendant-shaped mobile wearable device. Basically the camera recognizes individuals, images, pictures, gestures one makes with their hands and the projector assists in projecting any information on whatever type of surface is present in front of the person. The usage of the mirror is significant as the projector dangles pointing downwards from the neck. To bring out variations on a much higher plane, in the demo video which was broadcasted to showcase the prototype to the world, Mistry uses colored caps on his fingers so that it becomes simpler for the software to differentiate between the fingers, demanding various applications.

The software program analyses the video data caught by the camera and also tracks down the locations of the colored markers by utilizing single computer vision techniques. One can have any number of hand gestures and movements as long as they are all reasonably identified and differentiated for the system to interpret it, preferably through unique and varied fiducially. This is possible only because the ‘Sixth Sense’ device supports multi-touch and multi-user interaction.

3.1 Hardware Setup

3.1.1 Camera

The camera is the key input device of the SixthSense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the appropriate computer vision computation.

The major functions of the camera can be listed as:

• Captures user’s hand movements and gestures (used in reorganization of user gestures).

• Captures the scene in front and objects the user is interacting with (used in object reorganization and tracking).

• Takes a photo of the scene in front when the user performs a ‘framing’ gesture.

• Captures the scene of projected interface (used to correct the alignment, placement and look and feel of the projected interface components).

Suggested Product: Logitech QuickCam Pro for notebooks

3.1.2 Projector

The projector is the key output device of the SixthSense system. The projector visually augments surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content to be projected. The projector unit used in prototype runs on a rechargeable battery.

The major functions of the projector can be listed as:

• Projects graphical user interface of the selected application onto surfaces or walls in front

• Augments the physical objects the user interacting with by projecting just-in-time and related information from the Internet.

Suggested Products: You can buy either laser (AAXA, Micro-vision) or L.E.D (3M MPro110) projectors

3.1.3 Mirror

The mirror reflects the projection coming out from the projector and thus helps in projecting onto the desired locations on walls or surfaces. The user manually can change the tilt of the mirror to change the location of the projection. For example in application where the user wants the projection to go on the ground instead of the surface in front, he can change the tilt of the mirror to change the projection. Thus, the mirror in the SixthSense helps in overcoming the limitation of the limited projection space of the projector.

Suggested Product: Any 1”X1” first surface mirror

3.1.4 Microphone (OPTIONAL)

The microphone is an optional component of the SixthSense. It is required when using a paper as a computing interface. When the user wants to use a sheet of paper as an interactive surface, he or she clips the microphone to the paper. The microphone attached this way captures the sound signals of user’s touching the paper. This data is passed to computing device for processing. Later, combined with the tracking information about user’s finger, the system is able to identify precise touch events on the paper. Here, the sound signal captured by the microphone provides time information whereas the camera performs tracking. The applications enabled by this technique are explained earlier.

Suggested Product: Microphone of Logitech QuickCam Pro for Notebooks

3.1.5 Mobile computing device

The SixthSense system uses a mobile computing device in user’s pocket as the processing device. The software program enabling all the features of the system runs on this computing device. This device can be a mobile phone or a small laptop computer. The camera, the projector and the microphone are connected to this device using wired or wireless connection. The detail of the software program that runs on this device is provided in next section. The mobile computing device is also connected to the Internet via 3G network or wireless connection.

Suggested Product: Any Windows computer

3.1.6 Colored Marker

There are colored markers placed at the tip of user’s finger. Marking the user’s fingers with red, yellow green and blue colored tape helps the webcam to recognize the hand gestures. The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.

3.2 Software Setup

Sixth Sense Technology Software, the WUW_v0.1, is to be installed in the System Files as well as its assembly in the computer’s Operating System. As of now, the only working programmable Operating System for this is the Microsoft Windows OS(s).

3.2.1 Direct X

Microsoft DirectX is a collection of application programming interfaces (APIs) for handling tasks related to multimedia, especially game programming and video, on Microsoft platforms. Originally, the names of these APIs all began with Direct, such as Direct3D, DirectDraw, DirectMusic, DirectPlay, DirectSound, and so forth

http://en.wikipedia.org/wiki/DirectX

3.2.2 Visual Studios

Microsoft Visual Studio is an integrated development environment (IDE) from Microsoft. It is used to develop console and graphical user interface applications along with Windows Forms applications, web sites, web applications, and web services in both native code together with managed code for all platforms supported by Microsoft Windows, Windows Mobile, Windows CE, .NET Framework, .NET Compact Framework and Microsoft Silverlight.

( http://en.wikipedia.org/wiki/Visual_Studio)

3.2.3 Adobe Flash player (active x)

Adobe Flash (formerly Macromedia Flash) is a multimedia platform used to add animation, video, and interactivity to web pages. Flash is frequently used for advertisements, games and flash animations for broadcast. More recently, it has been positioned as a tool for “Rich Internet Applications” (“RIAs”). (http://en.wikipedia.org/wiki/Adobe_Flash).

3.2.4 WUW v0.1 beta (the main software)

Instruction

WUW_v0.1 is the beta version of SixthSense code (WUW stands for Wear Ur World, a former name of the project). This version runs on Windows. Make sure you have Visual Studio and Direct X installed. Extract and copy the files from wuw_v0.1.zip to any location on your computer. Open WUW01.sln (which is present in the folder “CODE”) then click on F5 to debug it. If you debug it successfully, a black screen appears with a little square box on the right just hover your mouse around it and you will find Option tabs such as Camera, Tokens and Apps.

Camera: you can choose which camera to use and configure the camera settings here. You may need to mirror the camera here using the camera settings. It is also recommended to use fixed/manual white balance and exposure such that the camera image is stable and light independent.

Tokens: This version of code uses colored fingertips as markers. One need 4 different colors in order to run most of the Apps. We recommend to use Red, Yellow, Blue and Green (or colors that are different enough). We have also noticed that the matt colored tape/objects works better as they have less reflective changes. When you click on ‘Add Markers’, the screen starts blinking and after 4-5 secs it stops with a still picture so that you can add those markers on your hand as new markers. You can simply drag-select the colored marker on the screen by mouse cursor. Once you have all four markers (O, P, M, and N) added the software will start tracking the four markers. You can set the thresholds to better the tracking. You can save those markers and can reuse in subsequent executions, or can add new markers every time.

Apps: there are three ways to launch any application. Apps tab can let you choose the apps you want to load and run. One can also load apps from ‘Menu’. ‘Menu’ is triggered using Namaste gesture. Once on Menu screen you can choose the App by hand-click (Hand Click gesture works by moving the O marker and hiding P marker.

4. How It Works

The Sixth Sense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces.

Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. It also supports multi touch and multi user interaction.

4.1 The Sixth Sense technology works as follows:

1. It captures the image of the object in view and tracks the user’s hand gestures.

2. There are colored markers placed at the tip of user’s finger. Marking the user’s fingers with red, yellow green and blue colored tape helps the webcam to recognize the hand gestures. The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.

3. The smart phone searches the web and interprets the hand gestures with help of the colored markers placed at the finger tips

4. The information that is interpreted through the smart phone can be projected into any surface.

5. The mirror reflects the image on to a desire surface.

The entire hardware apparatus is encompassed in a pendant-shaped mobile wearable device. Basically the camera recognizes individuals, images, pictures, gestures one makes with their hands and the projector assists in projecting any information on whatever type of surface is present in front of the person. The usage of the mirror is significant as the projector dangles pointing downwards from the neck. To bring out variations on a much higher plane, in the demo video which was broadcasted to showcase the prototype to the world, Mistry uses colored caps on his fingers so that it becomes simpler for the software to differentiate between the fingers, demanding various applications.

The software program analyses the video data caught by the camera and also tracks down the locations of the colored markers by utilizing single computer vision techniques. One can have any number of hand gestures and movements as long as they are all reasonably identified and differentiated for the system to interpret it, preferably through unique and varied fiducials. This is possible only because the ‘Sixth Sense’ device supports multi-touch

and multi-user interaction.

MIT basically plans to augment reality with a pendant pico-projector: hold up an object at the store and the device blasts relevant information onto it (like environmental stats, for instance), which can be browsed and manipulated with hand gestures. The “sixth sense” in question is the internet, which naturally supplies the data, and that can be just about anything

MIT has shown off the device projecting information about a person you meet at a party on that actual person (pictured), projecting flight status on a boarding pass, along with an entire non-contextual interface for reading email or making calls. It’s pretty interesting technology that, like many MIT Media Lab projects, makes the wearer look like a complete dork — if the projector doesn’t give it away, the colored finger bands the device uses to detect finger motion certainly might.

The idea is that SixthSense tries to determine not only what someone is interacting with, but also how he or she is interacting with it. The software searches the internet for information that is potentially relevant to that situation, and then the projector takes over.

4.1GESTURES

The software recognizes three kinds of gestures:

1. Multi-Touch Gestures:

Like the ones we see in the iPhone-where we touch the screen and make the map move by pinching and dragging.

2. Freehand Gestures:

Like when you take a picture or Namaste gesture to start the projection on the wall.

3. ICONIC Gestures:

Drawing a icon in the air. Like, whenever we draw a star, shows us the weather details. When we draw a magnifying glass, shows us the map.

5. TECHNOLOGIES RELATED TO SIXTH SENSE TECHNOLOGY

5.1 Augmented Reality:

The augmented Reality is a visualization technology that allows the user to experience the virtual experience added over real world in real time. With the help of advanced AR technology the information about the surrounding real world of the user becomes interactive and digitally usable. Artificial information about the environment and the objects in it can be stored and retrieved as an information layer on top of the real world view. When we compare the spectrum between virtual reality, which creates immersive, computer-generated environments, and the real world, augmented reality is closer to the real world. Augmented reality adds graphics, sounds, haptic feedback and smell to the natural world as it exists. Both video games and cell phones are driving the development of augmented reality. The augmented systems will also superimpose graphics for every perspective available and try adjust to every movement of the user’s head and eyes. The three basic components of an augmented reality system are the head-mounted display, tracking system and mobile computer for the hardware. The main goal of this new technology is to merge these three components into a highly portable unit much like a combination of a high tech Walkman and an ordinary pair or eyeglasses. The head-mounted display used in augmented reality systems will enable the user to view superimposed graphics and text created by the system. Another component of an augmented reality system is its tracking and orientation system. This system pinpoints the user’s location in reference to his surroundings and additionally tracks the user’s eye and head movements. Augmented reality systems will need highly mobile computers. As of now many computers aren’t there to satisfy to provide this option.

5.2 Gesture Recognition:

It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. An interface which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the Sixth Sense devices colored bands are used for this purpose. Once hand pose has been captured the gestures can be recognized using different techniques. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique hasa high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures.

5.3 Computer Vision:

Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. It’s also used in autonomous vehicle like SUV’s. The computer vision technique basically includes four processes.

1. Recognition: One of the main task of computer vision technique is to determine whether the particular object contain the useful data or not.

2. Motion Analysis: Motion analysis includes several tasks related to estimation of motion where an image sequence is processed continuously to detect the velocity at each point of the image or in the 3D scene.

3. Scene Reconstruction: Computer vision technique employs several methods to recreate a 3D image from the available images of a scene.

4. Image Restoration: The main of aim of this step is to remove noise from a given image. The simplest method involves using simple filters like low pass or median filters. In order to get better quality images more complex methods like In painting are used.

5.4 Radio Frequency Identification

Radio frequency identification systems transmit the identity of an object wirelessly, using radio magnetic waves. The main purpose of a radio frequency identification system is to enable the transfer of a data via a portable device. The portable device is commonly known as tag. The data sent by the tag is received and processed by a reader according to the needs of the application. The data sent by the tag contains various information’s’ identification or location of the information, or specifics about the product that has been tagged, for example price, color, date of purchase, etc. This technology gained importance because of its ability to track moving object.

A typical radio frequency tag consists of a microchip attached to a radio antenna which is mounted on a substrate. To retrieve the data from the tag a reader is needed. A typical radio frequency reader consists of two antennas that emit radio waves and at the same are capable of accepting the signals from the tag. The reader then passes the information that it has received to a computer device in digital form. The computer then interprets this digital data and processes it. Radio frequency identification techniques are widely used in the fields like asset tracking, supply chain management, manufacturing, and payment systems etc. One of the major advantages of devices using radio frequency technology over other similar devices is that RFID devices need not be positioned precisely relative to the scanner. But till then there are certain areas of concern for this technology. Some problem related to this technology is tag collision and reader collision. Usually the reader collision occurs when the signals from two or more readers overlap, while tag collision occurs when many tags are present in a small area.

6. APPLICATION

The sixth sense technology finds a lot of application in the modern world. The sixth sense devices bridge the gap by bringing the digital world into the real world and in that process allowing the users to interact with the information without the help of any machine interfaces. Prototypes of the sixth sense device have demonstrated viability, usefulness and flexibility of this new technology. According to the words of its developers the extend of use of this new device is only limited by the imagination of human beings. Some practical applications of the sixth sense technology is given below

6.1 Viewing Map:

With the help of a map application the user can call upon any map of his/her choice and navigate through them by projecting the map on to any surface. By using the thumb and index fingers movements the user can zoom in, Zoom out or Pan the selected map.

Map application

Application

6.1 Taking Pictures

Another application of sixth sense devices is the implementation of a gestural camera. This camera takes the photo of the location user is looking at by detecting the framing gesture. After taking the desired number of photos we can project them onto any surfaces and then use gestures to sort through those photos and organize and resize them.

The user taking making a pose gesture, The camera takes the photo of the location

6.2 Drawing Application

The drawing application allows the user you to draw on any surface by tracking the fingertip movements of the user’s index finger. The pictures that are drawn by the user can be stored and replaced on any other surface. The user can also shuffle through various pictures and drawing by using the hand gesture movements

6.3 Making Calls

We can make calls with help of sixth sense device .The sixth sense device is used to project the keypad into your palm and the using that virtual keypad we can make calls to anyone.

making calls

6.4 Interacting with physical objects

The Sixth Sense system also helps to interact with physical objects we use in a better way. It augments physical objects by projecting more information about these objects projected on them. For example, a gesture of drawing a circle on the user’s wrist projects an analog watch on the user’s hand. Similarly a newspaper can show live video news or dynamic information can be provided on a regular piece of paper

Figure9: Newspaper showing live feeds Figure10: an analog watch projected into the wrist

6.7 Getting Information:

Sixth sense devices can be used for getting various information relating to our everyday life by getting in contact with objects

• Product Information:

Sixth sense technology uses marker technology or image recognition techniques to recognize the objects we pick in our hand and then provide information relating to that product.

• Book Information:

By holding and shuffling through the book pages, the sixth sense provides Amazon ratings on that book, other reviews and other relevant things related to the book.

• Flight Updates:

With the help of the sixth sense technology it is no longer required to log into any sites for checking the status of the flights. The system will recognize your boarding pass and let you know whether the flight is on time or not.

• Information About People:

With help of face recognition techniques the sixth sense devices are able to provide information about the people when we meet them. The sensor detects the face and checks the data base for the relevant information. The system will then project the relevant information about a person like what they do, where they work,

Boarding pass showing current status

The information about a person being projected

7. ADVANTAGES AND ENHANCEMENTS

7.1 Advantages

• SixthSense is a user friendly interface which integrates digital information into the physical world and its objects, making the entire world your computer.

• SixthSense does not change human habits but causes computer and other machines to adapt to human needs.

• It uses hand gestures to interact with digital information.

• Supports multi-touch and multi-user interaction

• Data access directly from machine in real time

• It is an open source and cost effective and we can mind map the idea anywhere

• It is gesture-controlled wearable computing device that feeds our relevant information and turns any surface into an interactive display.

• It is portable and easy to carry as we can wear it in our neck.

• The device could be used by anyone without even a basic knowledge of a keyboard or mouse.

• There is no need to carry a camera anymore. If we are going for a holiday, then from now on wards it will be easy to capture photos by using mere fingers

7.2 Future Enhancements

• To get rid of color markers

• To incorporate camera and projector inside mobile computing device.

• Whenever we place pendant- style wearable device on table, it should allow us to use the table as multi touch user interface.

• Applying this technology in various interest like gaming, education systems etc.

• To have 3D gesture tracking.

• To make sixth sense work as fifth sense for disabled person.

8. Observations

8.1 Portable

One of the main advantages of the sixth sense devices is its small size and portability. It can be easily carried around without any difficulty. The prototype of the sixth sense is designed in such a way that it gives more importance to the portability factor. All the devices are light in weight and the smart phone can easily fit into the user’s pocket.

8.2 Support multi touch and multi user interaction

Multi touch and multi user interaction is another added feature of the sixth sense devices. Multi sensing technique allows the user to interact with system with more than one than one finger at a time. Sixth sense devices also in-cooperates multi user functionality. This is typically useful for large interaction scenarios such as interactive table tops and walls.

8.3 Cost effective

The cost incurred for the construction of the sixth sense proto type is quiet low. It was made from parts collected together from common devices. And a typical sixth sense device cost up to $300. The sixth sense devices have not been made in large scale for commercial purpose. Once that happens it’s almost certain that the device will cost much lower than the current price.

8.4 Connectedness between real world and digital world

Forming a connection between the real world and the digital world was the main aim of the sixth sense technology.

8.5 Data access directly from the machines in real time:

With help of a sixth sense device the user can easily access data from any machine at real time speed. The user doesn’t require any machine-human interface to access the data. The data access through recognition of hand gestures is much easier and user friendlier compared to the text user interface or graphical user interface which requires keyboard or mouse.

8.6 Mind map the idea anywhere

With the advent of the sixth sense device, requirement of a platform or a screen to analyze and interpret the data has become obsolete. We can project the information into any surface and can work and manage the data as per our convenience.

8.7 Open source software

The software that is used to interpret and analysis the data collected by the device is made to an open source. This enables other developers to contribute to the development of the system

Recommendation

The probability of succeeding the project’s construction is very high. If we are going to subscribe on their channel, the prototypes posted by random individuals succeeded and they were able to make their own improvements and version. Looking at it, it is very much at grasp.

Though the project still has its flaws, it is very open for improvements. As of now, the only working Operating System for this is the Microsoft Windows. Eventually, if we pursued this and organized the proper placement of each part, we could make a better one. The WUW_v0.1 Software is also an open source; it is very much free to download. The source code is also written and viewable; with this we could further improve the assembly of this software at will. Even with the WUW’s beta version, the project was already proven to succeed. I would recommend that the project would be pursued.

9. CONCLUSION

The Sixth Sense Technology is a very useful technical tool which is portable and accessible almost anywhere that isn’t harmful to its hardware. Having this technology given as an open sourced program, any developer may upgrade it at their own freewill. This possibilities of digital display unto anywhere eliminates the disadvantage of having a screens to display data, instead we could use any surface for its use.

Having its gesture driven functions also fascinates the users to make it enjoyable and user friendly. Doing file transfers and its data transfer also plays a significant role upon capturing frequencies and converting it to data made it very useful upon technical terms. Therefore the project would gradually improve the technology of portable use though, as of now, there is no formal hardware yet that will provide a low percent error upon the feedback and also the convenience of having these gadgets in a comfortable manner.

The technology is not yet perfected, though everypossibility makes it very flexible upon a greater change. Improvements are always welcome and every different version would be very much improving this superb idea.

10. References:

1. http://code.google.com/p/sixthsense/

2. http://www.scribd.com/doc/52609477/SIXTH-SENSE-TECHNOLOGY

3. http://www.springerlink.com/content/n7222135321k3574/ (A Feasibility Study of Sixth Sense Computing Scenarios in a Wearable Community

4. http://blog.sherweb.com/motion-control-sixthsense-technology-why-were-still-waiting/(Motion Control Sixth Sense Technology: Why We’re Still Waiting

5. http://www.scribd.com/doc/45413245/Sixth-Sense-Research-Paper.