Design And Research Of Gesture Interaction Based On Wearable Device Interaction Scenario

Traditional touch-screen interaction(TSI)is clearly limited because wearable device is always carry-on and it characterized with small-size or even no display.Therefore,natural interaction based upon speech sounds and body language becomes more efficient Human-computer Interaction(HCI)solution.With the maturity of gesture recognition algorithm,stable HCI could be conveniently developed by users through gesture interaction.However,the gesture interactive mode,to a great extent,also restricted to hardware features,interactive space and other technical realization modes.Therefore,effective interaction design approach,which used for the multi-modal natural interaction of wearable device,becomes an unsolved problem.The research methods of this study are documentary research,and induction and deduction.Firstly,the characterization of HCI for wearable device is pointed out from the perspectives of the hardware features and interactive modes.By exploring the interactive gesture modes and approaches for wearable device,interactive gesture features and gesture design objects based upon wearable device are summarized.Thus,the advantages and disadvantages of current interactive gesture design approach are concluded by literature research.Combined w ith interactive gesture features for wearable device,current gesture design approaches may be inappropriate to the interactive gesture design for wearable device.The effective design approaches of interactive gesture design for wearable device become the keystone of this paper.Finally,the relevant theories of scenario are introduced in order to provide theoretical directions for the following-up interactive gesture design approaches for wearable device.Besides,combined with basic rules of interactive design(People,Activities,Context and Technology,PACT),the ingredients of interactive gesture design system for wearable device(users,user behaviors,usage scenarios and technical support)are proposed,which provide theoretical foundation for the classification and construction of interactive gesture scenario.On the basis of relevant scenario design,three scenario elements involving user,device and environment are extracted in order to construct the interactive gesture scenario for wearable device.Related connection between scenario and gesture design object is established.Therefore,the map model of interactive gesture scenario and interactive gesture design object is constructed through main relationship and secondary relationship.All these pr ovide theoretical frame and knowledge foundation for the design approaches of interactive gesture for wearable device.Based on the above research,the principles of interactive gesture design were defined and elaborated in accordance with the scenario ele ments of gesture interaction and ten interface design principles provided by Jacob Nielsen.Availability indexes of interactive gesture design and user gesture interaction experience evaluation index es for wearable devices were put forward.According to mapping model,the design model and design flow of gesture interaction are proposed,which provide guidance for practice.Design model and design flow obtained from this research are applied in a practical interactive gesture design project for a brand int elligent wrist watch.Gesture interaction design is developed according to the applicable environment and functional requirement of wrist wearable device in future market,and thus gesture card was obtained.The project successfully developed a series of g esture patterns,and a prototype machine,which is applicable for several gestures.The feasibility of this method is preliminarily verified.On the basis of the design approach of gesture interaction for wearable device,wrist wearable device is set as the object,this paper put forward the approaches of interactive gesture design,constructed interactive gesture design mode and design process for wearable device based upon scenario.It also proposes indexes and principles used to evaluating the effectiveness of gesture.The study provides guidance for the gesture interaction design for wearable device.