The Distributed Minimum Spanning Tree Algorithm In Social Network Analysis Tool

Cloud Computing is a new IT service model which provides on-demand, flexible and efficient use of multi-tenant service transparently to the large number of users. With its ultra-large scale cloud storage capacity, ultra-large-scale distributed and parallel computing capability, high reliability and availability features, Cloud Computing draws great attention from both the scientific and industry areas, and with their vigorous promotion, has achieved great development. At the same time a new Internet service model SNS (Social Networking Sites) has also been developing rapidly. Everyday, large scale data sets are being produced by these sites and how to find deep level useful information with commercial values from these data sets has drawn great attention from these Social Networking Sites. SNA (Social Network Analysis) is an efficient way to solve the problems above and has become the focus of many scholars.But modern SN (Social Network) are often very large with many millions or even tens of millions of ultra-large-scale data sets, how to deal with large-scale data sets is a great challenge to traditional social network analysis methods. In order to figure out the social network analysis of large scale data sets, this article proposes X-RIME:A tool combinomg the plowerful cloud computing platform HADOOP with social network analysis mthods together for doing large scale social network analysis with good scalability and universality. The X-RIME data model based on HDFS (HADOOP Distributed File System) and the X-RIME algorithm model based on HADOOP MapReduce programming model bring X-RIME ultra-large scale cloud storage capacity and ultra-large-scale distributed, parallel computing capability. What's more, the X-RIME algorithm library created above the X-RIME data moedel and X-RIME algorithm model contains more than ten distributed SNA algorithms implemented with MapReduce which can be deployed on hundreds of or even tens of hundreds of PCs making the core parts of X-RIME for doing SNA jobs. In addition, the distributed MST (Minimum Spanning Tree) algorithm in X-RIME algorithm library with wide range of application in optimistic transmission is very important in SNA. This article first introduces the overall design of the system structure of X-RIME and then introduces the design and implementation of the Data Model and Algorithm Model of X-RIME, followed by the introduction to the design and implementation of the distributed MST algorithm in X-RIME algorithm library and finally introduces the tests of X-RIME distributed MST algorithm.