Design And Completion Of Early Warning System Based On The Complex Data Processing And Analysis Of The Agriculture Products Processing Industry

In recent years, the Chinese government is increasing the importance of China’s agricultural products processing industry. In order to meet the demand of the Planning and Design Institute of the Ministry of Agriculture, the main subject of this article is to solve Statistics and Analysis of monthly data system of the agricultural product processing industry, monitoring and early warning system. Referencing to the existing complex data processing model results and based on diverse sources of the data files and the characteristics of the data content format diversity, we design and develop a model for the analysis of complex data processing, solving problems of large number of files, the contents of the file checksum rules inconsistent, complex bulk data, and many other issues. To improve the compatibility of a document processing system, this article uses the method of middleware. As to the diversity of content validation rules, we create an XML configuration file. The program automatically match the validation rules, thus reduce the cost of subsequent modifications. In order to ensure the atomicity of the original data, we use relational databases. Database transaction mechanism is introduced in the data import process. We use stored procedures to avoid the time consuming computationally intensive processing.The research methods of this article complete fast and convenient functionality to handle complex documents, and these problem-solving methods have versatility. The article explains the complex data processing’s ideological reference value in the practical application of the system, and the processing methods can be applied to practical problems in logistics management information system processing information on bulk orders.