The Application Of Speech Recognition And Gesture Recognition In Remote Sensing Image Processing And Display

Along with the development of the China High-Resolution Earth Observation System(CHREOS),remote sensing technology is widely used in military affairs,agriculture,exploration and other fields.In order to deepen mining of remote sensing image data,many kinds of remote sensing image processing software has been developed at home and abroad.Nevertheless,most of the existing remote sensing image processing software is designed for the research on the algorithm,which doesn't support for the visualization of image processing flow and display of processing results.With the development of gesture recognition,speech recognition and other intellectual technologies,the human-computer interaction based on the virtual reality and augment reality has the characteristics of intelligence,humanization and naturalization.With the application of gesture recognition and speech recognition in remote sensing image processing and display system,users will have a more natural human-computer interaction experience while making a convenient operation of the system in presentation.Therefore,according to demands of the project and scientific research,the author designs the operation method of the remote sensing image processing and display system based on the speech and gesture recognition to solve the problems in remote image processing system.This method uses speech and gestures as interactive information to construct remote sensing image processing flow,providing an intelligent display platform for system users.The main research work is as follows:(1)The identity authentication is designed and implemented.This function can help to recognize the identity of users by acquired face and voiceprint information.In this way,when entering the system,users can enable this function to avoid interference from unrelated persons.(2)The interactive information recognition based on gesture and speech is designed and implemented.The function can help to obtain the voice information and gesture information of users,then identify and execute predefined system instructions through corresponding algorithms.(3)The interactive process flow based on And-Or graph(AOG)and Knowledge Mapping(KM)is designed and implemented.This function can help to generate the corresponding process flow of remote sensing image processing by identifying the system instruction,and combining the Knowledge Mapping of remote sensing image processing and the remote sensing image processing method described with And-Or Graph(AOG).Combined with the development of remote image processing and display system,the method of remote sensing image processing and display based on speech and gesture recognition is realized in this study.This study can also provide intelligent extended interface for remote sensing image processing and display platform,which is of great significance to enhance users' interaction experience and field display of remote sensing image processing.