Somatosensory Interaction And The Somatosensory Game Design

With the coming of the era of experience, people pay more and more attention to naturalhuman-computer interaction. Somatosensory interaction is a kind of natural human-computerinteraction, It is the combination of the virtual reality platform after analysis, image recognition,image tracking algorithm will provide depth information sensing equipment into bone node dataof the human body, and embedded into the virtual reality platform, can let the computer likehumans perceive3D world and convert it into a synchronous image. The scope of application ofsomatosensory interaction technology, on which the somatosensory game is a kind of electronicgame based, is very wide, the somatosensory game input information by gestures, is no longer asimple handle push-button to process the mode of operation, so as to make the operation moreintuitive, to bring the game player a better gaming experience.This study, the main content of the interaction by aiming at the somatosensory interactionexperience, is not good. Multi-objective tracking capture delay and accuracy is not high.Thepurpose of the study is to improve user experience of the somatosensory interactive productsbased on the Kinect. Difficulties and innovations in this research are: firstly, the study of userexperience design of somatosensory interactive products, including interaction design of the userand the virtual scene, user interface design, virtual design, virtual character design; secondly, thestudy includes the accuracy of multi-objective tracking capture will be involved in somesomatosensory interactive products;thirdly, it also includes aspects of an important applicationdirection of somatosensory interaction, the somatosensory research on design andimplementation of methods and techniques of the game. The following research methods: first ofall, this paper begins with the basic requirements of several steps according to the characteristicsof the somatosensory interaction.To understand the user’s user task,this paper uses user-rolemodeling, user-centered somatosensory interaction design; secondly, in the somatosensoryinteraction scenarios, sometimes overlapping between multi-objectives will cause that thequantity and the interactive action of recognition is not accurate, This paper puts forward a newmethod of Kinect multi-objective tracking,the precise action recognition though occlusionjudgment based on2D image captured with Kinect, and then extract the shape features of theobjective image, then through the space division of the objects, finally realize the motiontrajectory of each object. Then though mult-objective tracking problem is transformed to thelinear continuous target points in a certain period of time, we build the equations of motiontrajectory tracking multiple targets. Finally, this study is preliminary study and application onsomatosensory interaction design and technology,based on which we developed a somatosensory game with Kinect and Unity victory power.