The Interactive Music Play Table

With the rapidly development of human-computer interaction technology, based on the technology, image processing has become an important research field of pattern recognition and development directions. In this paper, the design is based on the VC software, mainly investigating the development and realization of the object recognition, the hardware construction about the interactive music desk, the fast and robust tracking of fiducially markers attached onto physical objects, as well as for multi-touch finger tracking[2],Acquisition and Recognition System; based on MIDI music synthesis, and interactive platform computer vision framework. Specifically, the main research contents are as following:(1)The hardware structures, primarily acquisition system positioning, shooting environment, testing and module design and feasibility analysis, and build on the hardware performance of the various modules to be introduced.(2) The fiducial mark,collection and identification of the target module. In this paper, we will design a gesture as the operation module for the first time, prepare for the later redevelopment of the interactive music table; the same time, at the Image segmentation part, for the characteristics of the infrared Image, and the shooting environmental may causes more noise, we use two-dimensional maximum entropy based on threshold to segment the Image, and this method get a good purpose. the volume control part, based on control operation, this operation module without geometry changes, we position the module based on meanshift tracking algorithm, and achieve better real-time and accuracy tracking, so we get a more continuous control about the change of the sound level.(3) Sound and image synthesis, the voice synthesis part mainly based on MIDI software library. Through the Image processing, we get the characteristics of the operating module, then pick up the features about the module, and then sent different MIDI commands to the system to get tamber,amplitude,frequency and different information of MIDI sound, resulting in a special sound with different volume, different rhythms and different tamber, by adjusting module to produce a more smooth music. Image synthesis part, the wave is called WAV file real-time waveforms to display. (4) Operation platform. Operation platform is developed based on Visual C++6.0 with MFC, platform generate human-computer interaction interface. Mainly for image acquisition, segmentation and recognition integrated part of the algorithm, so the user can get the feature signal of the operation module form the operation interface.