Font Size: a A A

Design And Implementation Of Blockchain Data Analysis Platform

Posted on:2021-05-06Degree:MasterType:Thesis
Country:ChinaCandidate:X T ShenFull Text:PDF
GTID:2428330602983970Subject:Computer technology
Abstract/Summary:PDF Full Text Request
Block chain has been widely concerned since its birth.With the development of block chain technology,many problems come with it,such as disclosure of user privacy and illegal financial activities.The data in the block chain are increasing,but only the data obtained through data analysis are valuable.In the bitcoin's public chain,nodes can obtain all data which provides a data interface for bitcoin's data analysis.By this way,data analysts can analyze the data in the chain,and then analyze the behavior behind the data transaction to understand and solve related problems.Therefore,it is very important to build a data analysis platform that can efficiently process and calculate massive data and can also visualize data results.The data analysis platform described in this paper is based on bitcoin,and it includes data acquisition technologies,data storage technologies,data analysis technologies,data visualization technologies and other technologies.This data analysis platform mainly includes three parts:data acquisition,data processing,and data display.The system uses the index provided by the data file in the bitcoin wallet to obtain the data in order,and then processes the data as required and stores the data.The Spark SQL is used to calculate the data activeness.The Spark GraphX is used to calculation and analyze the transaction data.The Spark MlLib is used to identify the transaction data.The system will display the results through charts,files,etc.after calculation.The system functions can be divided into five modules from the functional level,which are data acquisition module,data display module,data calculation module,data identification module and user management module.The data acquisition module provides an interface for users to acquire data;In data display module,the activity index will be presented in line chart.In data calculation module,the user uploads the data set,selects the calculation method provided by the system for calculation,and saves the result to the file after calculation.In the data identification module,the user inputs the information to be identified and uploads it to the data set for calculation and identification.After system calculation,the information is compared with the result to judge whether it is an abnormal transactionThe project uses java to obtain data,and uses MySQL database to store data.The project uses Scala language,spark computing framework and HDFS distributed storage files for data calculation.Finally,based on the Springboot architecture,a parameterized,usable,and interactive system platform is formed.
Keywords/Search Tags:bitcoin, spark, data analysis platform
PDF Full Text Request
Related items