Research And Implementation Of Content-Based Image And Video Network Database System

Multimedia Database (MMDB) has a wide range of application fields, suchas digital education, medicine, e-commerce, e-government and so on. WhatMMDB is expected to do is really exciting. But the difficulties in theories andtechnologies are great. How to describe the multimedia data, index the data andwhat kind of structure of database is used are still problems. Image and video, astwo kinds of most complex data types in multimedia data, are more difficult toprocess and manage. So in this paper, we provide a practical scheme and itsimplementation to image and video database management system, including thedata describing method, data indexing structure, database model, systemarchitecture, and system network structure. On the base of content-based visualinformation retrieval algorithm, a three-layer web database system is designed andimplemented. The System can deposit and share the image and video in intranetand also provide friendly user interfaces both in the user end and server end toretrieval and manage the data. The paper focuses on the following contents.The system architecture and database model is very important for the designof a database system. The database's architecture and model reflect the features ofmultimedia data. For the architecture, integrated media pattern, separated mediapattern and client/server(C/S) pattern are the three main schemes. For theapplication in network, a C/S pattern is more suitable. So a more advancedBrowse/Server pattern is used in a three layer system. B/S is an extension andpromotion of C/S to the web application in network. Data model is anotherproblem. Relational database and object database are two kinds of popular modelused in database, but facing the multimedia, relational database cannot providegood simulation, while object database is still immature, so a combination of thetwo models becomes the proper way to do a multimedia database in the currentlevel of technology. Relation-object model is used to describe the image and videoin our system.The system is to manage image and video and provide retrieval and browse.Content-based visual information retrieval is a good way for the image and videoretrieval. Our team have been studying on the field and made a lot of experimentsand studies in image feature extraction, video segmentation, high-dimensionalspace index and visual information similarity measuring. On the foundation offormer studies, this paper provides a hierarchical video describing algorithm.After segmenting the video, video can be described by the key frames, but there isinformation redundancy. Time-based key frames tree clustering is used to clusterthe key frames (shots) and forms a cluster tree to describe the video. At the toplayer of the tree, every cluster can be regarded as a scene of the video, so anotherkey frame extraction (key key frame extraction, KKF) reduces the informationredundancy and a scene (KKF)-shot (KF)-video video index structure is formed.For both image and video, a modified C means cluster method is used to generatea global index. Web is a good tool to implement a network system. A merit of B/Sthree-layer network architecture is to distribute different functions in differentlayers and reduce the complexity of the system. The system is more flexible andwith the middle layer it can conquer the defects of both thin client-fat server andfat client-thin server C/S system. In B/S system, dynamic web techniquecombines the web and database. For web database access techniques, from CGI toASP.NET and ADO.NET, it is becoming easier and functionally stronger,and .NET platform is a good way to implement the web system. Another ability ofimage and video network database system is the support to long transactionprocessing. Video browsing needs the ability. On the platform of MS WindowsMedia Services, the system can provide end to end video data transmission, clientreal-time video browsing and retrieval functions. In the rest part of the paper, the design and implementation of the system aregiven. The whole system runs on the intranet and has three layers: client browser,web server, database server. The client browser takes charge of user login,database retrieval interface and media exhibition. Web server integrates functionslike: client response, query parse, database search engine and database access.Database server and streaming media server work together to provide functionslike: management of media data, system information, user information and controlof communication of video stream. The system running environment is made upof IIS5.0, MS Sql Server2000, Windows Media Services, ASP.NET1.1 and theimage & video database management system (IVDBMS). IVDBMS is a softwaresystem developed by our team integrating the content-based media describingalgorithm, indexing generating algorithm and the managing functions of the websystem. The web system has been tested using MS WAST and now is running for...