| Since the Virtual Reality technology is increasingly mature, people begin to value the Virtual Experiment based on Virtual Reality technology. But the interface of traditional virtual experiment were mostly 2D ones, and the interaction pattern relied on mouse and keyboard, and most of them only allowed one user operating at a single time. So it is a hot issue that how to develop a kind of 3D virtual environment with high immersion, can be operated by somatosensory interaction and in which multiple users can conduct together at the same time.This paper studies the Kinect somatosensory technology of the computer learning field. The Kinect can obtain the depth image of the space, separate human image from background, determine user’s skeleton joints information, and catch human gesture data in the end. User’s skeleton data is processed in the virtual environment built by Unity 3D engine, then user can conduct a virtual experiment by somatosensory interaction. Compared with traditional mouse and keyboard interaction pattern, this kind of natural interaction pattern brings more sense of reality and immersion to customers. At the same time, this paper introduces Remote Process Call technology to virtual experiment, realizes the goal of connecting the virtual experiment system between server-side and clientside to update one’s operation within all the users’ virtual environment. This proposal fills in gaps in multiplayer online in virtual experiment. Research contents of this paper includes: analyzing Kinect somatosensory technology principles and researching the applications of Kinect in related fields, comparison and selection of network technology for virtual experiment communication function, basic framework of somatosensory multiplayer virtual experiment, specific project and evaluating.Firstly, introducing Kinect somatosensory technology in detail, including four parts: capturing and generating depth images based on Light Coding technology, proposing a solution to classify human parts based on random decision forests, and locating human skeleton joints positions. Introducing briefly the Kinect for Windows SDK and investigating the cases of Kinect application in related area.Secondly, listing and analyzing the network communication technology can be used in somatosensory virtual experiment. There are Socket and RPC technique. The paper compares their advantages and disadvantages also their suitable applications. We determine to choose the Remote Process Call technique as the core technique for network communication of virtual experiment in consideration of actual requirement. And we illustrate the actual realization of Remote Process Call in Unity 3D project.Thirdly, expounding the structure of the multiplayer online virtual experiment based Kinect somatosensory technology; and we talk over the functions of each module of the system.Finally, testing and verifing the possibility of the techniques referenced above, and we designed and developed a set of multiplayer online Kinect somatosensory virtual experiment for chemistry. The application has the advantages of lifelike experimental effect and nature human-computer interaction, also supports multiplayer online. |
