Design And Implementation Of Data Transmission Platform Based On Kettle

With the rapid development of technology, computer-related hardware and software are continuously upgraded and changed. However, the upgrading of software and the changing of software products cause the problem about data maintenance. For some users who have huge amounts of data, such as the legal department, the public security system and so on, when they decide to replace the information management software, how to migrate existing data to a new system will be a primary problem which is needed to be solved.In this article, we design and implement a data transmission platform which is based on Kettle for the process of massive data migration. Different from other ETL tools in the market, the designed data transmission platform is based on web and is in the way of the BS to provide users with the capability of transferring data. Compared with other ETL tools, this data transmission platform can avoid these steps that the traditional software needs including download, install, upgrade and so on, which can meet the need of customers easily and simply. The data transmission platform based Kettle provides users with the ability to transfer data between a dozen different databases, in addition to traditional relational database, which can provide mixed data transfer capabilities between the non-relational databases or special file systems, finally it implements the capacity of massive data transmission. Besides, this data transmission platform provides a beautiful, simple and easy-to-understand user interface, which packages and redesigns the ETL configuration process to provide users with the simplest and the most easily understood data transmission configuration guide.From the point of view about the software development process, started with requirements analysis, this article introduces the way of designing and achieving this data transmission platform. It introduces us with designing logic and display of databases and even each sub-function module. This data transmission platform provides web-based user management, data connection management, transition management and scheduling management and other functions, which can also achieve a transmission of massive data between dozen different databases. From the perspective of the front and end web, system functions are realized.