Auxiliary Audio Of The Video Content Analysis Technology Research And Implementation,

Looking at multimedia research, the field of automatic content processing of multimedia data become more and more important. Automatic cut detection in the video domain genre recognition or automatic creation of digital video libraries are key topic addressed by researcher.But at present, prior work on video content analysis is difficult of approach good result using video frequency data alone and is inapplicability to scene segmentation and video content classified. Using corresponding audio and text information to assist video analysis can deal with this problem.Further more, in present years, audio processing technology developed rapidly and speech recognition technology already grown up and achieve high veracity in vocabulary speech recognition. Speech recognition and natural language process technology can receive and sort audio content. This is the first step toward retrieval entire video and sort video content.In this paper, we deal with the problem of segmenting news video data into semantically coherent scene using audio and video data, besides, classifying of news video content.1. According to research of audio, we analyze physics and biology characters and pick up a serial of audio characters on the base of classic short-time analysis.2. We develop a serial audio content analysis algorithm about audio classification and segmentation, speaker change detection and speech recognition.3. Merging audio analysis method we develop the algorithm about video structure analysis. Fusing video and audio analysis result we realization the method of video scene detection and story segmentation.4. Via text classification we develop content-based classification algorithm of video data. In this way we can approach more available result on video browse and retrieval.