Digital Image Haptic Rendering With Region Characters

Image haptic interaction is a new interactive mode between human and digital image.When the user interacts with the digital image through the force feedback device,the force feedback device feedbacks the force sense information of the object surface in the image to the user.The user feels as if he really touches the object in the image.In order to improve the authenticity of image haptic perception,in this paper,we innovatively propose a perceptual model based on regional haptic texture features and establish a new visual tactile sensing system,which can perceive the three-dimensional contours,roughness and smoothness of object in an image by different regions and different levels.To realize visual-haptic synchronous feedback like real.The main contents are summarized as follows:Chapter 1: Introduce the background and significance of the research on haptic generation based digital image,including reviewing and overviewing the research process and status of virtual touch at home and abroad from the aspects of shape restoration of object surface,restoration of haptic texture information on object surface,and softness recovery of object surface,etc.The research process and research status of virtual tactile are analyzed and compared.Summarize the key points,difficulties and urgent problems to be solved and then clarify the research objectives and contents of this paper.Chapter 2: Explore the method of image segmentation.In order to realize high quality simulation based on haptic device in the virtual scene,this paper proposes an improved method of image segmentation based on JSEG algorithm,reduces over-segmentation phenomena and simplifies the calculation process.Making the result of segmentation fits more closely with human perception while ensuring the quality of segmentation.This can express the different regions of the image more comprehensively,and lay a good foundation for the regional image-based haptic device.Chapter 3: Study the expression method of haptic texture information restoration and object surface contour shape based on region.Mainly to restore the height of each pixel point on the object surface so that can express the surface roughness of the object.Then,the 3D shape of the object will be constructed by triangular meshes.Finally,express the 3D surface of the object contour shape by different regions(region groups)and different layers.Chapter 4: Explore the technique of flexible image deformation based on region.In this paper,we use the Mass-Spring model to construct an image deformation surface model,and then map the 2D texture pixel points to the spatial position of the deformed surface and store them in the visual thread.The three dimensional points of the image surface shape recovery are mapped to the spatial positions of and stored in the haptic threads.In the process of human-computer interaction,flexible image deformation is realized in visual rendering thread and tactile rendering thread.Chapter 5: Explore the method of region-based image haptic display.In order to ensure the real-time,stability and continuity of the haptic device's output during the process of image interaction,a six-element image force touch algorithm is proposed to perceive the concavity,supple and softness of the object surface.Chapter 6: Based on the above algorithm,realize the system integration,and verify its effectiveness through experiments.In this paper,the system is implemented based on the whole framework of the system,the rationality and effectiveness of the algorithm are analyzed and summarized by three sets of experimental data.Realize image-based force haptic interaction system with immersion.Chapter 7: Summarize and prospect for the future research based on the shortcomings of the paper and the current work.