The Research And Implementation Of The Key Problems Of Video Big Data Processing Based On Cloud Computing

Access to the Internet era,with the development of microblog,social networking,mobile APP,location-based services and other technologies makes global data growth explosively.Big data provide such a rich source for data mining and data analysis that the result of data mining results will become more meaningful and even full of surprises.However,facing with the big data traditional data process methods are unable to meet people's needs.How to efficiently deal with big data has become a hot issue in all walks of life.The research of this paper is based on the problems encountered in the process of the construction of the film and television big data intelligent analysis system.A kind of film and television big data processing strategy and method are put forward after analysis of the existing data processing program.The main research contents include the following aspects.First,the concept of cloud computing and some related technologies are studied.The Hadoop which is open source cloud platform is selected as the foundation platform in this study;the MapReduce distributed programming model and HDFS distributed file storage system are studied deeply.Followed by in-depth analysis of the business needs of the various parts of the video data,to deal with different data processing requirements,two kinds of data processing schemes are proposed for making full use of the advantages of relational database and the Hadoop distributed platform.One of the two schemes isa single node data processing based on relational database and the other one is a kind of distributed data processing based on Hadoop.Facing with different data processing requirements,different schemes are choose to be successfully applied to the analysis system with a good effect.