Design And Implementation Of Big Data Shared Service Platform

With the expanding of informationize into various areas, big amount of data has been stored into industry inside system. The development of this digital era made it unlikely to undisclosed data even though undisclosed data protected the benefits of those companies. The essay aims to discuss how to solve the problem of single and less stereoscopic analysis data, how to effectively protect data, how to reduce operating costs and obtain the hidden value of data, how to use data under the premise of protecting interests of enterprise and how to break through the traditional limitation in data use.Nowadays, the main method to realize the low-cost and high effective of establishing large amount of unstructured data is to use hadoop the data warehousing from the ecosphere as the storage platform. This also depend on the analyse and usage of data provided by some companies utility software. This topic use Hive as the data warehouse to manage the storage data. Hive provides convenience usage of data by providing HQL statement execution interface as well as by transforming SQL to MapReduce as tasks running on the server.The essay will solve the technical problems existing from data importing to data use from three aspects. Firstly, data migration tool will be used to expand data accumulation in the system. Then management of current data will be divided to realize data sharing under the premise of data safety. Finally, data application service will be provided to solve users' actual problems. System uses SpringMVC,hibernate,JPA,Shiro as a structure technology, which simplified the development process. During the process, the data access use data access address and other information through the front desk to create timed task.To make it convenient for users to work on data mining with the system, the system will provide users with interfaces to upload data. Users can upload all their data to the system database as private package so as to analyze data, which greatly enhance the dimension for data and provide the technical support for more precise and effective data mining.The system applies MySQL database to store Web system configuration data. Its fast response rate provides users with a good service experience. And being provided with optimized building packets services by administrators can make users get rid of complicated data sieve-filtration so as to throw themselves into the data mining.