Design And Implementation Of Exchange Platform In Campus Data Based Ondata ETL Tools

With the popularization and development of information technology in primary and secondary campuses have continued to establish the corresponding data system for students as well as teaching affairs. However, each of the data system to establish the time, create a way, the use of technology and the storage format of the data are different, each of the data system is actually in a mutually separate state, which for the exchange of data between the different data systems and data extraction difficulty, each of the data system can not be achieved between the effective sharing of the data, so that data generated value.Data exchange platform is designed to solve the problem of data communication and data exchange between different applications, different databases, data stored in different data formats can achieve cross-platform cross-format intelligent data extraction, data exchange servicesplatform.ETL(Extract-Transform-Load) technology is more data exchange technologies, ETL is actually data extraction, data conversion and data loading three operating general. ETL operations usually occur in the data warehouse ETL tool to extract the required data from the data source, according to the format required by the data format conversion, cleaning, removal of redundant data, the data will be stored in different formats unified format. Then the processing after the data is loaded into the new database for storage.This article through the analysis of the specific needs of shared data interaction in elementary and middle schools to fully compare the different existing data exchange technology, an ETL-based data exchange platform solutions. Tested by the actual environment, and achieved good results. The specific work of the following points:1.According to the needs of Changchun City, a middle school and building a unified information exchange platform, based on the overall design of the architecture of the ETL technology, and be achieved through open source ETL tools.2.in basic bus architecture based on the proposed improvements to increase the buffer and service capabilities, and improve the stability of the entire system focus on the source database and the bus between the introduction of secondary data exchange node.3.Message queue handling mechanism was introduced for concurrent data requests, priority when the server multithreaded were busy, according to data requests into the message queue in turn service.4.Supports manual entry and audit functions, improve data security and reliability of the platform as a whole.Achieve data exchange platform system is based on open source ETL tools kettle, this tool is operating on a more concise, easier implementation, and more scalable. The data exchange platform initially built in the school deployment, the function is check function and run well. Meet the basic needs of the user.