Research On Haptic Modeling And Displaying For Touchscreen Device

Touchscreen device, as a new Human-Computer-Interaction (HCI) interface, is widely used in people's daily life and work. With the improvement of the performance of touchscreen device, rich visual and auditory information have been presented to users. However, haptic interaction is relatively insufficient on touchscreen device. Haptic feedback could enhance virtual reality immersion and realism, and provide a more real interactive experience. The combination of haptic interaction technique and touchscreen device allows the user to touch, perceive and manipulate virtual objects on the touchscreen device and to interact with the objects in virtual environment with tactile sensation. The reaserch of haptic modeling and displaying method for touchscreen device widen the haptic field, which has broad prospects and market value.This thesis mainly studies haptic modeling and displaying method for touchscreen device with the aid of pen-like haptic interaction apparatus. The haptic display system provides the user with roughness sensation of the texture and compliance tactile of virtual objects. The main contents of this thesis are as follows:(1) the vibration characters of piezoelectric actuator and the relationship between tactile sensation and texture features are researched by haptic perceptual experiments. The experiment conclutions are the basis of the haptic texture modeling. (2) The texture roughness model for fine and coarse texture on the touchscreen device are built respectively. According to the model, the texture roughness is displayed with different vibration modes of piezoelectric actuator. The texture characteristics are extracted from the texture image with image processing method. The exploring speed of the user is detected by touchscreen. Both of the texture characteristic and exploring speed are considered in the texture roughess model. (3) A haptic interaction and perception system is developed on Android platform with Java language. The system can extract the roughness from the image, render the virtual scene and the flexible deformation of object with the help of OpenGL ES, as well as realize haptic display with the aid of pen-like haptic interaction device.The research focus and innovations of this thesis are:(1) Studying the relationship between the vibration of piezoelectric actuator and texture features. (2) Proposing a texture roughness modeling and displaying method based on vibration. (3) Realizing haptic display and flexible deformation of object on Android platform.