Research And Implementation Of Mass Data Migration And Report Automatic Generation

Report is the foundation measure and path for enterprise management. It is the basic business needs for the enterprise and it is the foundation to implement BI strat-egy. Report can help enterprise access data, format data, and show the data informa-tion to customer using a reliable and safe way. It can help user understand the Enter-prise operating conditions deeply and it is very powerful to help enterprise grown.But most of the reporting systems currently implemented in most companies are closely related with platforms and the business logic, with high complexity in updat-ing and maintenance. Data source is also lack of central management and the data format is variety. How can we extract the useful information from the distributed data become a question for us. In addition a lot of popular report development platform don't work very well on the requirements. A corporate hope to have such a reporting system: easy to develop, maintain, flexible to adapt report requirement variability, easy to migrate and integrate with the customized report engine.Base on the background we talked above, in this paper we investigate how to ex-tract information from mass data which is stored in Lotus Notes text database and how to design a light web report engine. On that basis we has designed and developed a light web report automatic generation system--MassReporter which is met general requirements for enterprise.In this paper, Firstly, we looked into the various techniques to help mass data migration from Lotus notes to relational database (DB2) and base on the particular requirement for the enterprise we proposed a solution for the mass data migration and report automatic generation. Then, we identified and researched the following key problems: 1) how can we implement the mess data migration from Lotus Notes to re-lational database (DB2) from time to time? 2) How can we mix the web report gen-eration system login mechanism and Lotus Domino login mechanism, consolidate multi- heterogeneous system's access right assignment? 3) How can we improve the speed for report creation? 4) How can we improve report system's usability? 5) How can we choose the way to store the mass data and the solution to backup the data to keep the system high efficient?After that, we analyze system requirement for the light web report automatic generation--MassReporter from functional requirement and nonfunctional require-ment area. We designed the system architecture. MassReporter system consists of data migration subsystem, web report generation subsystem and access right authentication subsystem. Then we analyze the structure of original data resource in Lotus Notes and design the target database structure in DB2. In the next we focused on the detail de-sign for web report generation subsystem and its key module (including base report templates,report data extractor,web report generator).Now MassReporter system is passed the functional test and performance test. It is used by IBM TSC. During the shakedown period, the system centralizes controls all of reports in the department, consolidates report's style, report's layout, and operation, saves client's communication efforts and developer's maintenance efforts. We achieve the prospective goal.