The Research On The Interactive Technology Of Augmented Reality Based On Kinect

Augmented reality is developed on the basis of virtual reality technology. It is akind of technology which using computer systems to provide information to enhancethe user’s feelings about the real world. Augmented reality can addcomputer-generated virtual objects, scene or system prompt information to the realscene so that enhancing the reality. Its key technology mainly includes: trackingregistration technology, interactive technology, display technology, etc. In order toimprove the user’s interaction experience of augmented reality system in this paper,the research is mainly focused on the long-term visual tracking,3D trackingregistration technology, two-hand interaction technology of real world and virtualworld based on Kinect. In this paper, the main work and innovations are as follows:1. A robust long-term real-time tracking algorithm based on compressedsensing is proposed. As the tracking algorithm based on compressed sensing prone totarget drift and lost under complex situations such as texture changed, largeillumination transformed or transient blocking. An improved algorithm was proposedto fuse track and detection. By introducing the cascade search strategy when thetarget is partially or totally lost the algorithm can reposition the accurate position ofthe target quickly, effectively reduce the drift frequency and greatly improve thetracking accuracy and stability. The test results of different video sequences of testresults show that the algorithm proposed in this paper still be able to detect and trackagain the accurate object and even if the target move rapidly and irregularly orpartially or totally out of the camera field.2. A real-time marker-less3D registration algorithm based on the depth cameraof Kinect is proposed. By introducing the Kinect equipment we can get the depthinformation of the scene. Then with the help of the3Gear system of hand trackingplatform, and by introducing3Gear system to registration technology of augmentedreality according to the principle of camera calibration, we unified the3D spacecoordinate system of OpenGL and3Gear systems. Based on the data provided by the3Gear server we can complete the real-time marker-less3D registration. At the sametime by introducing more Kinect equipments, we can effectively solve someproblems of the registration leading a more robust registration effect.3. A two-hand interaction technology based on Kinect is proposed. Thetraditional augmented reality interaction technology needs the help of data glovesand other complex equipments or the research is just for single hand interaction.However, in this paper the main study of two hands interaction technology whichbased on the hands tracking and3D virtual object’s successful registration in thepalm of your hand, can register the virtual object rightly and interact with it by twohands through the real time changes of gesture. The whole interaction depends onthe tracking and registration technology proposed in this paper. By introducing 3Gear system, after the reunification of the coordinate space, we can change theinteraction problem from augmented reality to virtual reality. Moreover, in theprocess of the interaction of virtual objects, we can greatly improve the naturalinteraction experience by introducing the simulation technology of virtual objectsand collision detection technology.In this paper, we studied the visual tracking technology based on the RGBcamera of Kinect, augmented reality3D registration technology based on the depthcamera of Kinect, and the augmented reality interaction technology research basedon Kinect. A series of experiments show the effectiveness and the innovation of theproposed method in this paper. Moreover, by introducing Kinect into the augmentedreality technology the application range can be greatly extended by Kinect which canalso promote AR technology development effectively.