Research Of Multi-mode Sensing Compact Gesture Interaction Equipment

Gesture interaction is the main research object of somatosensory interaction.Single mode interaction has its inherent limitations,and fusion of vision and motion could provide complementary information.A new somatosensory device based on multi-mode sensing of vision and motion is developed for gesture interaction,which can lay a foundation for later multi-mode fusion and interactive application.This thesis introduces and analyzes new gesture interaction device and gesture application scene at present,and a multi-mode sensing acquisition method based on Near Infrared(NIR)vision signal and inertial motion signal is proposed.The compact device designed by this thesis integrated with NIR optical module,inertial motion sensing unit,high performance computing unit and low-power control circuit.A software platform is built based on embedded Linux on ARM-based platform.Multi-mode signals is concurrently collected in real-time,and data transmission mechanism is based on low-power Bluetooth version 4.0 protocol.In order to make middleware of gesture recognition can be embedded smoothly into the software system and run efficiently,a multi-task,modular layered and priority-based scheduling software framework is constructed.Tasks are loosely coupled by efficient data coupling mechanism using buffer pool technology,zero-copy technology and double-buffers switching technology.The device is designed for low-power consumption from device selection,control circuit and operation mode several aspects.The highest power consumption of device is 0.757 watts after test.The portable device is 52mm long,32mm wide and 18mm high after compactly integrated through 10 layers high-speed PCB design and dimensional structure design.