The Design And Implementation Of A Characteristic Network Group Intelligent Analysis System Based On Hadoop And Spark

With the daily social life of human beings,each person will produce a large amount of social data,and the hidden interpersonal network information in these social relationship data has a very considerable value.Traditional analysis of human networks is often based solely on stand-alone processing.Due to the complexity of data content and the large amount of data,single-machine processing efficiency is not high.If Hadoop and spark technologies are used to store large data in analytical calculations,the efficiency can be significantly improved.Then,data training and prediction of deep learning neural network in artificial intelligence can be used to realize efficient and rapid analysis of a large number of interpersonal data.Relationship network model.This paper uses java language and scala to implement a set of criminal suspects interpersonal network intelligence analysis system based on big data analysis and machine learning algorithm.The system use the excavated information to conduct initial modeling and extended modeling of the interpersonal relationship network.Then,based on the feedforward neural network classifier model constructed by the Spark deep learning framework Multilayer Perceptron Classifier(MLPC),the data classification prediction is performed.Finally,the JavaWeb page designed based on the springMVC framework provides users with a data visualization display interface.In this paper,a character recognition system based on deep learning is implemented in the Python language.The system preprocesses the image and then uses the convolution neural network model constructed by Keras deep learning framework to carry on the character recognition.Finally,the paper is based on the Django framework Web pages provide users with a visual interface.The user's operation is all through the browser to access the system,complete the pretreatment of the data of the interpersonal network in the browser page to the data display the whole process.After system testing,the system has high functional robustness and system stability.