Design And Implementation Of The Internet Financial Data Platform

With the rapid development of information technology and and the continuous integration of the Internet and the various walks of life,the concept of Internet + is becoming more and more popular.In the financial industry,with the advance of national interest rate marketization,Internet + finance emerges and flourishes.However,in order to achieve rapid development,we must have a clear understanding of the market,company's products and users.In order to have an overall and accurate understanding of the relevant factors,we must be based on the datum,so the emergence of data platform becomes extremely important.The completion of the data platform will play a great role in the company's decision-makers,operators and product managers,help them to better locate and launch the market,and improve the quality of the product constantly.Based on the above situation,this paper first introduces the construction background of the financial data platform,and then introduces the related technologies to develop the data platform.The technologies involved in this paper include Sqoop data transmission,Hive data analysis,SpringMVC framework,MyBatis framework and information display technology of the data platform.On the basis of a certain understanding and mastery of the background and related technology of the data platform construction,the author participates in the whole process of the requirement analysis,outline design,detailed design and implementation of the data platform.In the stage of requirement analysis,the author applies the idea of software engineering to identify and analyze the requirements,and extracts the functional requirements and non-functional requirements of the data platform.According to the requirements,the system is briefly designed,including the design of the overall framework,the design of each sub module and the database table.These sub modules include the channel analysis module,the post loan performance module,the user transformation module,the user feature description module and the collection monitor module.On the basis of the outline design,the author designs the data platform in detail,introduces the implement detail of each component,from the view of data collection,data storage and data use respectively,in which data collection is the integration of the data from different sources,and the data storage is the classification of data after integration.The following data are classified according to the subject,so that they are stored in the form of subject oriented,this is to facilitate data analysis.The data usage part is mainly to display these subject oriented data.Finally,test cases are written to test the data platform,and start from functional testing and non-functional testing respectively,so as to ensure the stable and normal operation of the system.The data platform is basically completed and put into practical work.And the data platform can provide effective data support for relevant users,and reduce the cost of company's decision and operation.