Design And Implementation Of Android-Oriented Human-Computer Interactive Virtual Machine System

As an OS of intelligent terminals,Android is developing quickly during recent years.With popularization and networking of intelligent devices,interoperability requirements such as remote sharing and control among Android deices are becoming more important,but these features are not provided by current Android OS,especially it becomes a bottleneck to solve when a device without a screen such as intelligent household sound device faces difficult human-machine interaction.Therefore,it is necessary to change and extend the Android kernel and framework and make it have a capability of mirroring and remote interaction.The system in this paper is based on the Android OS of the intelligent household sound devices and display devices,touch devices,key devices and the corresponding events are managed and handled at the Flinger and Gralloc layer of the Android kernel in order to realize real-time mirroring and redirection,network coding,transmission,decoding and virtual restoration of human-machine interaction data such as display output signals and input control signals across devices.The system can run as a virtual machine on one Android device and run the applications of this Android device on another Android device.Users of intelligent household sound devices can install and use all open and universal Apps on intelligent household sound devices without screens via a wireless network on their handheld intelligent terminals at any time and place by using this technology.For redirection of display signals,instant display and low network load is guaranteed by networking and virtualization of display devices based on compatibility to advanced graphic primitives and basic display signals.When the upper applications execute graphic operations,the graphic primitives will be redirected to the virtual graphic system via the RMI(Remote Method Invocation).After the virtual graphic system draws a graph,it will display to end users.When the network bandwidth is enough,after upper applications complete image operations,the image will be segmented into blocks to compare differences in double display buffers and mark on differential block chain.The differential blocks will be encoded by sequence image differences regularly and transmitted to the virtual graphic system for decoding.Then they will display to end users.For redirection of input signals,the client event module of the system in this paper will encode terminal's key events and pointer control events in real time and transit them to the server of the event module.The server module will decode event data in real time and inject virtual events into Android kernel for interaction with applications.The practical running results show that the system in this paper acts as a network virtual computer with the capabilities of Ethernet graphics card and Ethernet I/O device and can provide users with virtual soft device support for remote networking screen display output and networking touch operation input and realize networking,software and virtualization of I/O devices of the Android intelligent devices.