Research And Implementation Of Data Integration Middleware Based On Dynamic Database Connection Pool

More MIS are applied in enterprises and government units with the development of the computer science. There are many differences in these systems because of different period and technique in developing, such as the saving way, accessing method etc. As a result, these systems can hardly share data with each other. Along with the development of information-based construct, enterprises and government units now need to gather their data urgently, not only in their present systems, but also in their future systems. So the data integration system is needed to realize share and exchange data between these MIS. The first problem is the heterogeneous data source in implementing a data integration system, and the second is effectiveness. How to improve these systems'heterogeneousness and effectiveness become the hotspot in data integration research and the urgent problem needed to be resolved in application.The existing data integration system can induce to virtual integrating systems and material integrating systems. In general, virtual integrating systems using XML and middleware technique to construct virtual global mode, accessing data source for each query, to realize the complete heterogeneousness and consistence. But the main problem of this kind system is the effectiveness. Material integrating systems use data replication and operate directly on central database, so they can improve the effectiveness in data access, but has weakness in heterogeneousness and consistence. To avoid the weakness of the two methods mentioned above, people start researching how to use these methods together. The research of this aspect is still less., and more attention is paid on whole model design and the choice of paths in replication, while without considering concrete realization.This paper analyze disadvantages and advantages of present data integration systems, consider heterogeneousness and effectiveness together, and design and implement one kind of data integration middleware based on dynamic database connection pool. This middleware combine virtual integrating system and material integrating system together, and import database connection pool technique to realize data source heterogeneousness and get higher data access capability.The main contributions of this paper are as follows:1,Research database connection pool technique and designed dynamic database connection pool based on present database connection pool. Dynamic database connection pool can load,modify,delete pool when running,watch pool running state and automatically adjust related parameters and conjunction objects, to make the pool's performance highest.2,Use JavaBean technique to realize dynamic database connection pool. Gather it into web application server, and develop visual tool based on browser to make client's management more convenient.3,Based on current heterogeneous database replication methods, design a kind of heterogeneous data replication mode based on middleware database and changing log file. This mode create one changing log file for each data source in order to make less infection on data source. The middleware database save mapping information between republication and subscription, as a data center, to simplify flow and structure,avoid conflict of replication and provide higher access effectiveness. Based on subscription table, can replicate single table,view,user defined virtual object and so on, to extend current tool's replication function.4,Building global query mode with virtual subscription table. This mode provide global SQL as unique query language, so client can access global data more simple to meet the need of sharing global data and ensure the consistence.5,Based on dynamic database connection pool, extend replication module and query module. Bring forward a kind of data integration middleware based on dynamic database connection pool. Replication module carry out the replication mode mentioned above. Query module is used to global query mode. Combining them to integrate heterogeneous data sources effectively.6,Based on dynamic database connection pool, realize the middleware's bussiness with JavaBean., and realize visual management with JSP.7,Applying the middleware to Guang Xi Normal University's financial MIS, to resolve the data share and exchange problem between each MIS. Results proved that this middleware has many advantages, such as high heterogeneousness,effectiveness etc.The data integration middleware based on dynamic database connection pool is a bold and useful try in data integration area, and get good results in application.