Research On Some Key Problems Of Virtual And Real Interaction In Augmented Reality

Augmented Reality (AR) technology is a novel technology with the advance of Virtual Reality (VR) technology. AR presents a seamless augmented reality environment to users and expands VR application with virtual object and reality environment from modeling VR objects and generating virtual scene and fusing reality scene or objects.Although AR technology has been applied to entertainment, training, medicine, education etc., the further application of AR is limited to the key technology of virtual and real human-computer interaction (V&R HCI). V&R HCI is a kind of interaction technology, which is about the interaction between virtual objects and real scenes, or some objects and interaction tools, in AR application. The main problems are object registering, tracking and recognition technologies, virtual and real collision detection technology, novel HCI theories and applications and so on. The above key technical problems are all multidimensional and accurate and real-time. Solution of these problems with traditional algorithms has been proved infeasibility. So we import some heuristic intelligence algorithms such as Cellular Automata (CA), Complex Network (CN), and Ant Colony Optimization (ACO), etc. to solve those problems. The specific researches are listed as follow:(1)This paper proposes an improved marker recognition algorithm based on CA model and a SIFT K-means Contour Tracking (SIFT-KCT) registering algorithm based on natural features. The CA marker recognition algorithm replaces traditional marker recognition algorithms with CA model. It improves the CA rules and uses it to register and recognize and track marker in AR application. This paper analyzes the marker recognition and SIFT-KCT algorithm and compares it with traditional algorithms. Besides, according to the development of markerless application, the SIFT-KCT algorithm based on nature features is proposed which combines SIFT operator with active contour model and clustering method.(2)An AIS collision detection (AIS CD) algorithm and a Voxel Deformation Cellular Automata (VDCA) model are proposed in this paper. AR collision detection (AR CD) is a technology about detecting the virtual and real collision events which have happened and responding the event afterwards. It is necessary to meet real-time feature for AR CD. For responding process, the fast render algorithm is more necessary. This paper introduces and designs an AIS CD model to solve the problem which is detecting the happened collision event. Because AIS algorithm has accurate classify ability and insensitivity for the dimensions of initial data sets. We create and adjust the AIS model for solving and completing simulation. And a VDCA model is proposed to solve the virtual object deformation problem after CD. The model is designed and implemented for deformation simulation.(3)An improved hand shape recognition algorithm is proposed based on ACO, and the palm print recognition technology is applied to AR firstly. With the development of HCI, the novel HCI methods occur with an increasing frequency, such as hand shape and gesture and so on. But there are some shortcomings about these technologies, such as inadequate theoretical research, real-time problem, etc. This paper proposed a method which uses multi-model HCI method to solve AR natural interaction problem especially hand shape in AR. The method uses ACO model to recognize hand shape and uses palm-print recognition in AR firstly, and in addition brings personality in AR application.(4)This paper creates a simulating eye gazing tracking network (EGTN) model for novel gazing control technology, and proposes an augmented display method for depth of field effect. And we simulate and analyze the EGTN model with complex network conception. The EGTN and Ferns method are applied in the augmented display method to implement the display process.Experiments demonstrate the marker recognition algorithm based on CA and SIFT-KCT algorithm based on natural features presented by this paper have good features of real-time and accuracy and achieve the demands of AR tracking and registering. The AIS CD and VDCA model can detect the collision in real-time and implement the deformation which happens in collision event and meet the demands of collision detection in AR environment. The hand shape recognition algorithm based on ACO has great improvements in accuracy and real-time feature for AR application. The EGTN based on complex network models successfully simulates the factual network features of eye gazing tracking network, the EGTN augmented display method is robust and meets the depth of field requirements in AR application. Some key problems of AR virtual and real interaction are solved by this paper.