Research On Concealed Processing Platform Based On Leap Motion Controller And Semi-immersion Smart Glasses

With the fast development of the information technology, the progress of our society has been pushing forward increasingly. The national defense, communications,energy, finance, transportation, aviation have been deeply involved in data transferring and management. People’s lives are tied to computers and information technology everywhere.The information security issues are getting more complicated with the informatization process together with the conflict of acquiring, using, and controlling the information, which makes information security guaranteeing more difficult. The information security includes facility security, data security, content security and behavior security. The safety of information system hardware structure of the operating system is the basis of the information system safety. Besides, Cryptographic algorithms and network security is the key. However, security is not always absolute,only hardware and technology can’t guarantee information security for one hundred percent; it also depends on complete and precise management system and safe reliable behavior control.At present, augmented reality(AR) technology and body posture sensing are developing very fast, which provides a more convenient way of computer interaction.In his paper, we designed a concealed processing platform based on the Leap Motion controller and the Moverio BT200 from Epson, with which we replaced the traditional model of interacting with the computer in way of open operation mode with the first view only mode, by which we can make our operation behavior undetectable and incomprehensible. The processing platform can conceal what you are doing without real input facilities.The main works are finished in this thesis:(1) Virtual keyboardTo realize first view only mode,the most important issue is to implement the virtual keyboard. The operation system must recognize the codes of keyboard beforethe codes are sent to the program, which needs to use the Hook function to hook the keyboard function out。With the keyboard hooked out,the user can tap the keys like a real one to input the words,besides,user should be able to any input method including the methods that is installed by the user himself.(2) Virtual keyboard displayed by smart glasses.The platform aims at operating without real keyboard. We get the information of the traditional monitor with a pair of smart glasses instead. We use the SDK provided by the Leap to implement the virtual keyboard. When using this platform, the sensor of the Leap Motion can capture operator’s gesture and recognize which key we are tapping.(3) capture the gesture of operating keyboardIt is using gesture that we control the first view only mode keyboard. But, gesture recognition has lots of uncertainty. How to recognize the gesture of operating keyboard and filtering extra gesture is the core matter. Only in this case can we improve the accuracy and avoid wrong operation. As a result, one of the key content of this paper is to the movement of gesture accurately.