Design And Implementation Of Virtual Reality Interaction System Based On Kinect

With the development of the electronic technology industry and multimedia information technology,people are no longer satisfied with simple visual experiences.The gradually emerging somatosensory-based virtual reality interaction technology has made up for the gap in technology and needs.It has been widely used in the fields of education assistance,film production,medical rehabilitation and live broadcast interaction.Aiming at the problems of the current virtual reality interactive system,suc h as the complex motion capture device,high prices,single function,and strict environment requirements,this thesis designs and implements a Kinect-based virtual reality interactive system.Users can interact with 3D models by map expressions and body movement data in real time.The system has broad market prospects and practical value.The virtual reality interactive system in this thesis mainly improves from the interaction mode,detection mode a nd detection performance.In terms of interactive mode,this thesis uses Kinect camera as the image acquisition device.The Active Appearance Model and skeletal tracking algorithm are used to capture the facial and physical feature points for real-time interactive driving of 3D models.In terms of detection methods,this thesis uses RGB and depth image information to detect huma n feature points.In terms of detection performance,this thesis proposes a method of hand joints position inference.It can solve the loss of hand joints and inaccurate feature point positioning.Then the system performs median filtering on human motion data,effectively improving the accuracy of data collection.According to the requirements of the system,the virtual reality interactive syste m is divided into the interface terminal,the data acquisition terminal,the expression detection terminal,the motion capture terminal,and the background terminal.The thesis selects Model-View-Controller as the overall system framework.The next work is to determine the overall system scheme and process.The thesis designs and completes the system functional modules.They include the user interface module,the visualization module and the model scene module of the interface terminal,the face recognition module,the state analysis module and the expression driving module of the expression detection terminal,the bone data optimization module and the motion redirection module of the motion capture terminal,the action data management module of the background terminal.Finally,in order to verify the feasibility and accuracy of the system,a test analysis is performed on each functional module.The results show that the recognition rate of the expression detection of the virtual reality interactive system designed in this thesis reaches more than 70%,and the rate of hands joints lossing is less than 40%.The system achieves the expected goal.