The Research Of Big Data Processing Strategy For Communication Behavior Analysis

With the rapid development and innovation of computer technology,Internet technology has penetrated into every aspect of our life,and the concept of “Internet plus” has emerged quietly and developed into the “New Normal State” in the various industry.CNNIC(China Internet Network Information Center)had released the 39 th National Internet Development Statistics Report in January 2017.It showed that China's Internet users had reached 731 million until December 2016,and the size of mobile phone users had reached 695 million,with an increase of more than 75.5 million compared with the number by the end of 2015.With the increasing mobile Internet users and the non-stop explosive growth of network data,it has attracted more attention from all fields of life about how to deal with these big data and then dig its potential laws and application value.In the era,data is the most valuable asset in the information world,and it is another major technological change in the IT industry,which is of landmark significance.It can be predicted that the big data will make a great difference in various fields and open up a new path for the development of the field.Transmitting from the instruction of the CPU internal instruction set to the human Mars exploration project,communication has become the most basic element of the information age.The generation of data is inseparable from a variety of communication behaviors,and rapid development of the Internet of things and the mobile Internet has made the data generated by communication more diversified.It has been focused on how to excavate the communication behaviors of user information from volume data accurately and quickly,as well as find out and summarize the characteristics of the communication behaviors so as to serve for network management,network monitoring and equipment policy management.What you should note is that the user behaviors of communication here is not merely about “people”,but also all the behaviors of “objects” that can produce communication behaviors such as intelligent equipment,network terminals and virtual environment.In this context,the paper has researched on the big data processing construction which is popular at present in the view of the current development trend of big data,determined the Hadoop distributed architecture as the basic platform of the system,and compared the various communication behavior analysis models.It meant to understand the behaviors of all kinds of users in the network environment,and study the various network protocols of the TCP/IP reference model.Targeting at the aspects of communication relationship,communication law and normal network behaviors of the users,and integrating with the Hadoop distributed processing,storage technology and network protocol restructuring reduction technology,the study has designed and realized the big data processing system based on the analysis of communication behaviors,and achieved the functions of restructuring and restoring the protocol required in the big data and finding the relevant information.Furthermore,it has made the statistics on the network communication metadata including communications network,protocol usage,web browsing and email,realizing the master of the overall network communication.And it also analyzed on the specific users and specific communication behaviors to learn their communication behaviors and master the communication rules.In order to provide more detailed and accurate information about network communication behaviors for the network administrators,the system will assist the network managers in supervising the network communication behaviors better in the context of big data,providing the solid and strong guarantee for the network management model which is scientific and efficient.