Research On SaaS Platform Data Exchange Technology Based On Log Difference Extraction And Message Queue

With the SaaS technology continues to mature, based on SaaS platform and enterprise information system within the mixed architecture information technology program has been more and more applications. SaaS platform to connect the collaboration enterprises to solve enterprises "data island" problem in the industrial chain, increasing the transparency of information between enterprises, so that the entire enterprise cluster more efficient and stable operation. For the SaaS platform for the industrial chain, the data exchange adapter for the tenant is one of the key technologies to realize the inter-enterprise collaboration.Compared with the traditional data exchange adapter, SaaS platform data exchange adapter has the following characteristics: First, because the SaaS platform tenants continue to change, so the data exchange system needs to provide multi-tenant data within and outside the integrated application requirements; Second, SaaS platform and the enterprise The data exchange system of the internal system is different, so the data exchange system needs to provide a visual configuration interface to solve the heterogeneity of the internal system;Third, the SaaS platform is an uninterrupted operation of the whole, the data exchange system should ensure that the data exchange Transaction. Four, SaaS platform for the transfer of data are collaborative business sales and other key information, in order to ensure the interests of collaborative enterprises and promote the promotion of collaborative platform, the need to ensure the safety of data transmission process.In this paper, the characteristics of the data exchange system of SaaS platform are analyzed, and the existing problems of data exchange between SaarS platform and SaaS platform are analyzed. The data exchange model and technology research for industrial chain cooperative SaaS are carried out. (1) Based on the data of the tenant and the keyword-driven original data exchange, this paper proposes a scheme based on transaction log differential data extraction and message exchange based on message queue for SaaS platform. (2)Proposed transaction log difference data extraction and message queue for data exchange key technology research, proposed asymmetric encryption and equipment hardware coding and USBKey to Certify tenant identity, proposed the database log differential data extraction method based on ZeroMQ. (3) On the basis of the key technical scheme, the structure of using the message queue as the data transmission carrier and the data file structure of the data exchange are designed. At the same time, the metadata exchange and metadata exchange engine is developed, and the authentication, Differential data extraction, data transmission and other functions were developed and implemented, in support of structured data exchange while supporting the image type of unstructured data exchange. (4) The test of the tenant data exchange adapter mainly tests the transmission efficiency, transmission stability, transmission security, and configurability in the data exchange process...