Design And Implementation Of Acquisition System Of National Financial Data

The integration of information technology and economic society has led to the rapid growth of data. Accordingly, the data has become a national basic strategic resource. Analysis of the data can reveal the relationships that are difficult to demonstrate with the traditional technology and methods. Promote open sharing of government data, advance integration of social business data and integration of resources, which will greatly enhance the Government’s overall data analysis capabilities to provide new tools for effective dealing with complex social issues. Establish a data resource catalogue and long-term and multivariate data collection mechanism surrounding the need for financial business analysis and decision making, which is taking acquisition system of National financial revenue and expenditure data as a gathering point of fiscal data, dynamic collecting financial data, including budget preparation, budget execution, financial data of government debt and asset management business, etc. to actively promote resource sharing in public infrastructure information, business data and other aspects between the Ministry of Finance and the external units. Converge all kinds of data and enhance the quality of data management, then form a pool of financial data resources gradually, including public infrastructure data, financial business operation data and other external related information, which will build a good foundation for the application of large financial data.My main work is reflected in all the important aspects of the project. The part of key technologies in this thesis introduced technical support to achieve this system. The part of design’s outline completed selection of the system architecture and implementation. The part of the detailed design of the system elaborated the concrete implementation. The section of test completed the testing of the system using a variety of testing methods. Design and implementation work of five main modules includes:the definition of the data collection standards in "standard management module" and the realization of formed version. Construction and implementation of the data transmission channel in "data transmission module". Interface design and service framework implementation in "Interface service module" The implementation of document distributed storage in "data storage module". The implementation of users and roles’ service in "user management module". The system implements the business logic using a Spring Web MVC, and extends with the use of Apache Hadoop, using Apache ZooKeeper framework to achieve load balancing. The implementation of the system involves the digital digest algorithm, load balancing algorithms and message queuing technology.The system has now been deployed to more than a dozen provinces in the country to carry out the work of data collection, that superior financial collected the inferior professional data, which has broken the financial industry restrictions of "one government, one finance", and become an important means to control local financial data of central. After a period of time, it is possible to achieve automated data collection, and it can also be fast response to a higher amount of data at night. When a new collection system is added, the system has good scalability.