| In recent years, with the development of natural human-computer interaction technology, the somatosensory technology and multimedia system has been widespread concerned and researched. Traditional multimedia systems usually are touch advertising machine, and keep in a one-way broadcast mode, but they are unable to achieve a more accurate delivery of information through an interactive experience. Therefore, if the somatosensory technology is applied to multimedia systems, it will increase the interaction and diversity of the system. Among them, the gesture of somatosensory technology is a natural human-computer interaction.This thesis through the integration of information technology in today’s leading somatosensory technology, augmented reality, 3D depth skeleton joint positioning technology and large-size touch-screen technology, it achieves a set of advertising impressions, product descriptions, as well as dynamic virtual reality dressing functions as an integrated smart products show and projects propaganda system, and it is a new somatosensory multimedia interactive system integrated the variety of high-tech.This thesis firstly captures the depth image of the whole body from K inect intelligent somatosensory equipment, then identifies the human body through static and dynamic separation, and the human body will be separated from the complex background, and then by threshold segmentation of the depth information on the body, dividing the palm part of the body, and complete the identification of static gestures comb ined with hand node of human skeleton information. Then, analysis the three major dynamic gesture recognition algorithms, and this selects Hidden Markov Model(HMM) algorithms widely used in the field of speech recognition to achieve dynamic gesture recognition, and through a combination of static and dynamic gesture recognition, at last it improves the gesture recognition accuracy.Then, using the implemented gesture recognition and Kinect’s skeletal tracking technology, realizes the "air mouse" function, only by human gesture it can operate multimedia systems in air, no touch, and break the limitations of the general multimedia systems unable to interact. Based on this, it achieves the function of the interactive display of multimedia information system, including audio and video playback, photo browsing, PPT control, somatosensory dressing mirror system and so on, which somatosensory dressing mirror system can intelligently measure clothes, clothing size changes as users the shape, and clothing move following the people, and achieve the result which wear sample clothes fitting as in reality in front of the mirror. Meanwhile, for the transfer of multimedia information, it is no longer limited to play in a single form, and increases diversity of information dissemination. |
PDF Full Text Request