The Design And Implementation Of Network Authentication System Based On Hadoop/hive

With the growing dependence on the networking and communications, it is increasinglyimportant to maintain the network information security and the legitimate rights of users. While thenetwork is open, uncertain and virtual, which undoubtedly is not a small problem to this work.Binding of network identities is becoming inevitable. There are four common networkcommunication behavior for each user, e-mail, Microblogging, SMS and telephone. Four virtualidentity in four systems maybe correspond to an identity of reality. The binding of the four identityhelp to confirm the reality of the identity of the user, which makes the network subjected to thesupervision and guarantee to maintain the order of the network just like society reality.It produce PB-class massive data because of many data sources as well as the range of users ofvarious systems, and frequent operating daily. Traditional relational databases can not meet therequirements of the storage and analysis of data. The project uses the Hadoop/hive distributedcomputing platform which has the feature of high reliability, high scalability, high efficiency andhigh fault tolerance, to analysis the basic information of the user. The results demonstrate the highefficiency and correct function display.The article describe a program of the design and implementation of network identificationsystem based on development of the actual system. Layers of cleaning the raw data for each datasource using MapReduce programming framework, then load them into a new event-based datawarehouse. Then, using HiveQL to analysis and process the data with the help of the professionalworkflow control tools. Finally, display the rusults.The functions of the system have been partially put into use, and all the indicators of theperformance meet users’ requirements. The system has high practical value.