| This years, the amount of network multimedia data showed explosive growth with the increasing popularity of Internet applications. More people choose to get audio and video news information they interested in through the network channels. To find out the news clips from a long video news, it can only be detected by artificial linear stepwise if we get it through the traditional way of news video retrieval which based on manual annotation.In view of the above problems, this paper studies the existing content based video detection technology, takes the news audio and video as the research object and analyzes the characteristics of them, then designs and implements a set of audio and video news content detection software system for the media management staff in radio and television industry based on the technology like news item segmentation method which based on audio mute connection segment and shot edge detection, FFmpeg multimedia processing, and Speech recognition technology.The software system includes three modules, which are audio and video news story segmentation, audio and video news clip preprocessing, keyword based news clip retrieval and playback. the main work of each module is as follows:1. Study the characteristics of the abrupt change of the news video shot and the audio mute connection segment, divide the news audio and video material according to the news story into separate news segments combined with audio mute detection and video shot edge detection technology. Finish the audio and video news story segmentation module.2. On the basis of getting the news audio and video item segment, separating the news story item fragments from the audio and video by using FFmpeg multimedia processing technology, than do audio format conversion to get the news audio material for the next step. Do speech recognition for the processed audio based on the third party speech recognition development library, gets the news content text and saves it as a file for future target news retrieval. Finish the audio and video news clip preprocessing module.3. Do keyword matching for all news item text files one by one, retrieves the corresponding text file and the corresponding video news item containing the keyword, and design the play module for the playing of search results. Finish the keyword based news clip retrieval and playback module.Finally, the research content is summarized, The audio and video news content detection software system designed and implemented in this paper can achieve news segmentation and target news segment retrieval well by verification,... |
PDF Full Text Request