Font Size: a A A

Cloud Storage System For Massive Data And Applied Research

Posted on:2013-01-06Degree:MasterType:Thesis
Country:ChinaCandidate:M AiFull Text:PDF
GTID:2218330371460022Subject:Computer technology
Abstract/Summary:PDF Full Text Request
With the development of the Internet, mobile Internet, the number of Internet users is increasing, the data also showed explosive growth, mass data era has come, now "data is the business itself" especially in the Internet, telecommunications, finance and other industries. Face of such vast amounts of data, the first question is:The size of the data is beyond the load capacity of single PC, how to construct a large-scale, high efficiency, easily extended, highly reliable storage system is an urgent problem which need to solve; second in the information society, information is critical, in the mass of data, there is an important trend that the socialization of the data, which is we commonly called unstructured data (such as:text, images, audio, video, etc.), how to get useful information from the massive data, has become a great challenge of the Internet in recent years.Based on the above questions, this paper do some research on mass data storage and data mining. Because the infinite and variety of the data forms, this paper takes the literature management for example, it materialized massive data into electronic literature data. On this basis, the paper successfully built a cloud storage system for massive literature data by cloud storage and cloud computing platforms, the system implements management and analysis of the literature data. First, system requires user registration, then the user can upload documents (eg PDF files) stored in the cloud, then the user will be able to manage your uploaded documents, such as increasing the documents, delete documents, etc. the system also provides literature information retrieval and analysis.
Keywords/Search Tags:massive data, cloud computing, cloud storage, GlusterFS, Nutch, Hadoop, Mahout, text clustering
PDF Full Text Request
Related items