The Research And Implementation Of Human-Machine Interaction System On TV Platform Based On3D Recognition

As tri-networks integration promoted the development of fusion terminals, smartTV also becomes another research hotspot of the fusion terminal. With the constantlyenhancement of smart TV’s hardware performance, as well as the improvement of itsoperate system, users can download and run a variety of applications on smart TV’splatform. However, most of these applications need to utilize keyboard and mouse tointeract with users.As the traditional medium of human-machine’s interaction, remotecontroller has failed to meet users’ requirement. It’s urgent to find a better way ofinteraction between users and smart TV.This paper introduces research background, current status both at home andabroad, and the basic theories related to this subject. Then it introduces the currentcontradiction between human-machine interaction design and user experience. Thebasic technologies and theories related to this subject are also mentioned. Besides,based on3D human motion’s recognition technologies, it realizes a new TV HMI(Human-Machine Interaction) to get better user experience. The related innovationsare as follows:First, control of system: Instead of traditional remote controller, we use3Dcamera to monitor the user’s action, and deal user’s data with the rotate matrix torecognize user’s action. So that user can utilize their body languages to interact withsmart TV.Second, user experience of system: The circle gesture is developed to achievecontinuous command sending. At the same time of this control pattern, mouse modereplaces the original use of direction key to manipulate the focus and avoids leapoperation’s pigtails. These methods mentioned above enhance the user experience of this HMI system.Third, redevelopment of the system: By utilization of the COM port on TV board,existing TV software can receive COM control instructions which are translated fromuser’s gesture. It not only has no change of TV original communication mode, but alsois easy to achieve redevelopment for developers.The theoretical analysis and design implementation in this paper lays thefoundation for the research and promotion of smart TV HMI system for smart TV. Italso has reference value for the design and evaluation of that.