Based on micro-electromechanical (MEMS) technology, 3D gesture recognition technology is significantly expanding its smart phone and TV remote areas of application, but no longer limited to the first children's games.
This can be said 3D gesture recognition technology break through the traditional application of the general framework of the game of the year. From the original as Nintendo (Nintendo) Wii wireless game interface for the first time in the consumer market, after several years of development, MEMS-based sensor for gesture recognition technology has been extended to reach a smartphone and be prepared to seize the most emblematic of the consumer interface: TV remote control.
Since the Wii in 2006, after the advent of Nintendo's competitors have all developed their own 3D gesture recognition and processing technology. Sony is designed for high-precision control of the pursuit of game players to develop Move Playstation dynamic controller used; Microsoft (Microsoft) realize the game places Xbox Kinect hands-free interface.
Apple (Apple) the first use of MEMS sensors the potential to successfully create a more intuitive interface for smartphones and the iPhone in 2007, an increase in the MEMS accelerometer in 2010 added a MEMS gyroscope . Apple's competitors followed, and soon, all kinds of 3D commands (such as to shake that cancel, bring that answer, and said reverse phone disconnected) will become the standard smartphone features.
Today, they are consumer OEM to increase its product line 3D gesture recognition. Some companies use GestureTek's camera technology licensing, and other companies to obtain Hillcrest Laboratories Movea's MEMS companies or technology licensing. Movea company has more than 250 patents covering like to use gyroscopes to control the cursor like technology; Hillcrest company has 100 patents, including the use of accelerometers and gyroscopes to track the movements of the patent. The two companies are providing value-added 3D gesture designers of software development tools are Movea's Gesture Builder and Hillcrest's Freespace MotionStudio.
Google (Google) area is in the code-named 'Gingerbread' (Gingerbread) of Andr oid operating system adds MEMS-based gesture recognition application programming interface so that you can identify, such as tilt, rotation, insertion and cutting action .
"Action processing will eventually be widely accepted by mainstream consumers," InvenSense founder Steve Nasiri said, "We expect the action processing and gesture recognition for the hardware will become like a camera module as the same, widely used in smart phone. "InvenSense is the first single chip integrated accelerometers and gyroscopes, MEMS chip manufacturer.
InvenSense in its gyroscope and accelerometer / gyroscope integrated processor chip embedded in an action to perform when necessary to identify the user gestures complex sensor fusion algorithms, while reducing the task of application processor load. InvenSense company plans next year will be integrated on a single chip accelerometer, gyroscope and magnetometer (electronic compass).
At the International Consumer Electronics Show (CES) in, InvenSense's motion processing database for the first time appeared in TV remote controls and smart phones the TV remote control 3D gesture recognition, and smart phone for basic phone functions (such as Just picked up the phone to your ear will be able to answer the phone). Both products are LG Electronics products Magic Motion remote control for LG Infinia Series 3D TV; and LG's new Optimus Black only 9.2mm wide, said to be the world's thinnest smartphone smartphone can identify a variety of unique gesture commands.
Other MEMS chip maker also will gesture recognition algorithm integrated accelerometers and gyroscopes in its products. For example, Kionix offers dozens of built-in gesture recognition algorithm of products, the company's Gesture Designer software development kit can also help design a customized OEM gesture control effect.
"TV remote control company who are working to bring gesture recognition technology integration in their products, which requires the use of very sophisticated motion control technology." Kionix company CEO Greg Galvin pointed out that "the essence is the integration of visual input on the TV in , so that the user via a remote control to switch channels, download music, view photos collection or library, word processing or browsing the Internet. "
Implementation in IPTV applications and browse the Web content, remote control must have the same accuracy as the mouse, click and gesture-based in order to achieve the control function. "The application does require the use of MEMS technology." Galvin said.
Smart TV first year
Hillcrest founder and CEO Dan Simpkins believes that 2011 is the 'smart TV the first year', and added, "more than 50 years, ushered in the television market and finally for the first time a new input technology." Hillcrest has developed an air mouse Loop pointing device, specifically for those who want to connect computer and TV to consumers and design; the same time, the company developed for IPTV a Kylo browser.
LG Electronics at CES the Magic Motion remote control using gesture recognition Hillcrest's Freespace technology, can help users to click through a complex web browser interface screen and traditional television content.
Other competing technologies include Philips (Philips)'s uWand. Philips handheld infrared camera integrated controllers use infrared light detection television, the gyroscope can be achieved without the use of accurate motion tracking. But most other IPTV remote control using MEMS gyroscopes.
For example, Movea company announced at CES, Taiwan notebook keyboard supplier Sunrex computer (Sunrex) later this year in the upcoming controllers, MEMS-based company will use Movea's MotionIC platform and SmartMotion technology to achieve 3D gesture recognition.
"The next generation will be able to identify the remote operation of all types of new gestures." Movea's global marketing manager Dave Rothenberg said, "For example, parents sign gestures by waving in the air, you can unlock the adult content on television, and when the child into the room again when the same action to start the monitoring control functions. "
Meanwhile, Microsoft's Kinect controller also challenges conventional wisdom. The built-in MEMS accelerometer's Kinect controller can be placed head-end devices, allowing users to completely get rid of the hand gesture-sensing hardware. According to Microsoft, the company authorized by the GestureTek from optical recognition technology developed for the Kinect proprietary 3D recognition algorithms.
Kinect controllers for specific games (such as virtual volleyball) defines a strict range of motion, and classification. The technology will be a set of rules to the laser dot projected onto the infrared players who, while projecting the image of the segment, and then measuring the reflection intensity of each point. Intensity of the reflection point is set lower for the reflection from the background, and a strong reflection point was set to the user from the foreground reflection from the body. Then, Kinect longer be the best guess the user's actions analysis to drive the game in the embodiment of the reaction and action. Kionix's MEMS accelerometers are cameras can help to more accurately align the user.
According to industry analysts, said the technology at the expense of some accuracy in order to facilitate the user's mobility. "I think the Microsoft-based camera identification system have still not sufficient to meet the accuracy requirements of many gamers, this may cause them still prefer to continue to use hand-held controller, allowing gamers Sony's Move to become a better choice. "iSuppli's senior analyst Jeremie Bouchaud said.
"Microsoft's solution for the targeted user: for example you want to quickly enter and leave the game, and want to have easy and immediate experience of the family." IHS Screen Digest's Games head Piers Harding-Rolls said. "On the other hand, Sony's Move is a hybrid solution, not only to track the motion sensor is also used to track the camera position. At this stage, Sony's argument is to provide gamers a more accurate sensor technology . "
Kinect controller such as the camera-based technology, "is not the Terminator gesture recognition it has some space there, but the accelerometer / gyroscope combinations also have their own market space." Gartner analyst Jim Tully that .
"For example, Kinect camera lens can not be detected in a series of multi-user applications of complex movements, especially when a particular user by another user block, and when the user back to the camera lens, the effect of these times is not good ... ... we need more cameras, however, in most cases are not necessarily feasible. "
By observing the changing of the photographic image, GestureTeck the company's technology has been tracking several million mobile phones in 3D action. The company and therefore claim the optical gesture recognition technology will eventually overcome the MEMS-based devices.
"So far, optical resolution and gesture recognition technology is still not reached such a precision MEMS inertial sensors when using the effect, but for most games is enough." GestureTek co-founder and president Vincent John Vincent said "Meanwhile, with the resolution of the camera lens on the rise, we believe that optical gesture recognition will have a more precise definition, so that every part of the equipment to track body movements, will eventually go beyond the MEMS technology."
Gesture recognition in the field of 'Cadillac'
As gamers, as precision is valued, the game itself, not as the importance of game development or animation effects movies in general. For the animation of people, the gesture recognition in the field of 'Cadillac' is Xsens Technologies Corporation to create a mosaic of MEMS components tights. This set of accelerometers and gyroscopes can achieve real-time preview of the animation sequence.
Xsens companies use the Analog Devices (ADI) the company's high-precision three-axis accelerometers, gyroscopes and magnetometers, developed a sophisticated dynamic tracking. For example, some professional designers use Xsens technology for the film 'Iron Man 2' (Iron Man 2) and PS3 games 'killing zone 2' (KillZone 2) development of animation. This technology provides motion capture solutions can be applied to any occasion, without complex infrastructure. Xsens predicts the technology will eventually enable consumer applications to reduce costs, achieve a similar experience of Kinect, but provide more of its higher accuracy, the number of how many players are unrestricted.
"Microsoft Kinect is an excellent solution because it does not need to install any sensors on the body, but which also make it slower, sometimes in tracking human motion in posture seemed more slow." Xsens company CEO Casper Peeters said, "Our technology is much more flexible in application, it is fine to track the wearer's movements can achieve higher accuracy, but the action-based game controller and telephone interface has just begun. Xsens company expects development towards the other hand, detailed character animations for the realization of high-end motion capture, and more interesting for the future birth of the application. "
Microsoft is also eyeing the future, plans to take full advantage of the company, respectively, in 2009 and 2010 and the acquisition of 3-DV Canesta company made 3D tracking technology. These companies ranging in time difference (TOF) gesture recognition patent has actually monopolized the market, especially for mobile devices is concerned.
Difference distance infrared sensor from the measured object is reflected back to reach a specific time CMOS sensor to achieve at any distance under any lighting conditions High precision 3D depth map. Difference ranging depth mapping technology and Microsoft were also authorized the development of 3D camera GestureTek gesture recognition algorithm is a perfect combination.
Germany TriDiCam and several other companies also claim to have jet lag ranging sensor technology. But so far only confirmed this concept Canesta company can make use of a CMOS image sensor device in action only a few inches above the wave at the exact 3D image map, even in bright sunlight outdoors with no problem.
Meanwhile, companies such as Silicon Labs is the use of low-cost infrared and ambient light sensors, to identify specific application gestures, such as a finger in the air to draw a line to start the monitor or adjust the volume.
Surface changes
Microsoft showed off at CES next generation of Surface multi-touch platform. This platform is no longer a first-generation product in the five cameras built to achieve a more light can be vertically mounted equipment.
Surface platform that allows users to directly manipulate objects on the screen display and built-in algorithms to interpret a variety of gestures, such as selection, drag, drop, single-finger zoom (pinch-to-zoom) and other similar touch screen instructions (OEM can develop self-built algorithm). The new version of the "thickness of only 4 inches, capable of horizontal, vertical or any angle for installation." Microsoft Surface general manager Brad Carpenter pointed out that the development team.
Microsoft Surface platform is the key to Samsung's LCD division to develop PixelSense technology. The technology for the staggered checkerboard pattern of visible or infrared light, to which each LCD pixel is to add a light sensor. In the backlighting of the visible and infrared light emitters so that each pixel can be detected corresponding to the user hands or other objects from the reflected light, and then to 60f / s sampling speed sensor, multiple users can simultaneously track action, the number of users is only limited by the available surface area of the screen space. Built-in support for location tracking of the FPGA, and can read the screen to place objects on the surface of a special application on the label, then through infrared transmission to send data to the camera with a smart phone Windows 7.
In the application area, Surface platform including support for Windows 7, Advanced Micro Devices (AMD) Athlon X2 245e 2.9GHz dual-core processor, and a match with the AMD Radeon HD 6750 graphics processor.
Samsung will also use this technology to launch the display model SUR40, "this 40-inch screen will be Samsung's LCD department sales price of $ 7,600 to the global market." Carpenter said of Microsoft.
Illustrated: Apple users are very familiar with 2D gesture control, including the scaling instruction as referring only have been the field of computers and smart phone competitors copy.
Fig said: dressed Xsens company MVN Motion Capture actor tights elastic fibers (the) this tight Lycra material inlaid with ADI's MEMS inertial sensors. He simulated the U.S. Marvel Comics (Marvel Comics)'s 'Iron Man' comic illustrations of the characters posture (left), as Paramount Pictures (Paramount Picture) company created "Iron Man 2" (right) film-based animation.
Source: Marvel, Xsens, Paramount
Fig said: Philips uWand with MEMS technology for the controller with the same application, but do not use MEMS devices. Instead, it incorporates an infrared camera to detect infrared light from the TV, so do not be able to achieve the gyroscope motion tracking.
Source: Philips
(Infra-red beam, infrared sensors, the cursor + key to the receiver through the RF)
Illustrated: the support of the OEM algorithm, Microsoft Surface platform can read 'wave' action. Redesigned screen panel can be hung on the wall.
Illustrated: Microsoft's Xbox Kinect to PrimeSense reference design based on CMOS imager using two (one for the infrared light, one for visible light) to detect 3D depth, enabling the system to easily distinguish the room gamers and background objects.
Read from ChinaAET