Research Of The Interaction With3D Virtual World Using Smartphone

As the smartphone appearing, more and more people choose smartphone as their communication tool in the daily life. Nowadays, the speed of build-in processor in smartphone becomes faster and faster, and the processing ability becomes more and more powerful. In addition, the build-in gyroscope sensor can accurately detect the state of smartphone and obtain a variety of data. Applications on smartphone are widespread. Specifically, Android and Iphone applications can work in every situation. For example, the applications can make smartphone become a mouse, a PPT controller, a laser pointer and so on. The improvement of hardware and the wide consumer base of smartphone make itself become excellent3D interaction equipment.This thesis presents a convenient and an inexpensive way to interact with the3D scene using smartphone. The first example in this thesis shows how to interact with virtual museum using smartphone. Users can wander in the virtual museum, look at antique and do translation, rotation, scaling operation on antique. Smartphone can finish all the operation in the virtual museum under mouse and keyboard mode. Users don’t have to set in front of computer, which increases the flexibility of user interaction and brings new experience to users. Another example is that smartphone is used in the O3D military boxing system as a control device. Users control virtual scene with smartphone to let the users to learn military boxing from different angles. Especially, when users practice with virtual environment, a smartphone can freely control system and make the interaction of system diversely. We use develop application in Android and use gyroscope sensor and WIFI communication module.In this thesis, smartphones are selected as interaction equipment in the two specific3D scenarios. Combined with the inherent features of smartphones and3D scene, smartphone as control device can create a new interaction method in3D scene for the users, which make the3D interaction diverse and more natural. On account of the limited time, the system is unstable, and will be improved in the future work.