Design And Implementation Of Multi-source Heterogeneous Data Integration System

With the popularization of Internet technology and communication technology,the number of Internet users are increase with each passing day.The behavior of users on the Internet is digitally recorded,and the data forms and sources on the network are gradually enriched.Although the user analysis model research based on a single user and a single data source is relatively mature,with the rapid growth of heterogeneous data from multiple sources,the difficulty of user modeling analysis is increasing.The single data cannot describe users characteristics accurately too.Multi-source heterogeneous data fusion research has become a hot spot and trend.Organizations in university have more than one information system.Information systems and application systems cannot be interconnected and shared,formed the problem of information island.Build a multi-source heterogeneous data integration system is the key to solve this problem.With the development of mobile applications,especially the popularity of 4 G network and smart phones,mobile information has become a trend.The demand that integrate various system backlog into one application to realize mobile office is very urgent.In this paper,the design and implementation of multi-source heterogeneous data integration system is the research subject.It focuses on how to extract multi-source and heterogeneous data,and integrate the extracted data to output the required data.The thesis firstly summarizes the background and significance of the topic,the purpose and necessity of constructing the multi-source heterogeneous data integration system,introduces the research status of the multi-source heterogeneous data integration system domestic and overseas,and discusses the key technologies and advantages of the multi-source heterogeneous data integration system,as well as the technical problems solved by the system.According to the existing problems of multi-source heterogeneous data system,we improve and design the prototype,and then according to the designed prototype,complete the framework of the whole system,along with the corresponding database development.Secondly,different technologies are applied to each platform based on the overall framework of the system,such as applying the B/S architecture to the background system.The system architecture was based on the Java EE architecture,SpringMVC implements the Web MVC model.The Mybatis persistence layer controls access to the database.The allocate personnel uses XML and XSL to configure the data source and format the corresponding data.The mobile terminal uses the HTML5+ specification for development.The mobile end passes the request to the back end,the background accesses the data source according to the matching data source and rules,then combines the data according to the matching template.The mobile terminal outputs XML data through the interface to the mobile terminal to parse the corresponding data and present it.Finally,we analyze the design of the whole system,Test and verify it.The results will prove the effectiveness of the system.The system studied in this article plays a positive role in solving the problems within the university organization.Such as incompatible information systems,complex identity authentication,disordered authority management,inability to share business contents,and the difficulty of providing mobile interfaces for existing systems.Moreover,the function expansibility of the system is optimized,which can effectively improve the system performance and work efficiency.