Font Size: a A A

Research On Behavior Analysis Of Cloud Application Based On Big Data Platform

Posted on:2019-04-24Degree:MasterType:Thesis
Country:ChinaCandidate:L M ChenFull Text:PDF
GTID:2428330626456588Subject:Software engineering
Abstract/Summary:PDF Full Text Request
With the rapid development of enterprise information and intelligent construction,more and more application systems are widely used in enterprises.How to evaluate the operation and security of all kinds of application systems by the smallest way of entry has become an important issue of concern for all enterprises.While using these application systems,some access information will be recorded.By analyzing the behavior data produced by the application,the user's access preferences and the potential security problems of the application system can be excavated,thus providing an important basis for the evaluation of various applications.However,with the rapid growth of data generated by various applications,the analysis and mining of massive data based on single machine environment can no longer meet the needs of business.In this context,the application behavior analysis and large data processing technology are combined to study the related theory of application behavior analysis.Based on the Spark computing framework,the preprocessing of applied data and the application behavior analysis algorithm are designed.This method improves the efficiency of mass data processing;at the same time,it is based on the application of LSTM.The amount is predicted.In addition,the paper also studies the collection method of massive application data,designs and implements data collection system for different types of data.In the aspect of data storage,the storage management of log files is realized based on HDFS,and a data storage model for mass application behavior is designed based on HBase.In the integration of various large data frames,the large data analysis engine has completed the scheduling management of various frameworks.The architecture based on Spring Cloud micro service is adopted in the system architecture,and the business system of different technology stacks is designed independently as a single service to ensure the high reliability and stability of service system service.Based on the above research contents and results,this paper designs and implements a big data platform for application behavior analysis.The platform can carry on the multi-dimensional statistics of behavioral indicators,the application of security detection and the prediction of the application access,and the system also provides interactive data analysis function,and allows users to customize the data preprocessing and analysis process to realize the mining and analysis of the applied data.It is proved by experiment that the system has high scalability and data analysis efficiency,and solves the delay problem of processing massive data by enterprises,and provides decision-making basis for enterprises to manage all kinds of applications.
Keywords/Search Tags:big data, behavior analysis, Spark, HBase, micro service architecture
PDF Full Text Request
Related items