The Design Of Cloud Platform Of Radio And Television Monitoring Data Management Based On Hadoop

With the rapid development of computer technology, the internet has entered into the era of big data. Various types of data are generated every day. The Monitoring equipment in broadcasting system will also engender more and more types of data. However, the traditional broadcasting data storage management system adopts a centralized method to store data and to control the system, which occurs bottlenecks with the impact of the big data.Mass data storage and management has been tremendous researched in recent years. Under the development of open source community, a wide variety of computing framework and platform is raised. Hadoop, as a leader in distributed computing platform, is applied to main areas like communication, medicine and finance. The datas which are generated by radio monitoring system are mainly structured text data and unstructured data, such as video and audio signals. So we use Hadoop which refer to the the distributed platform when dealing with data storage and management apply to broadcasting monitoring system to solve the bottleneck problem of data calculation. The main contents of this paper are as follows:1. Analyse HDFS file system and the parallel computing framework of Map Reduce, meanwhile, do some search in text search and video data transcoding. According to the needs of the data processing in broadcast monitoring system, this paper proposes a solution.2. In order to solve broadcast monitoring system’s data transmission, data process and node monitoring problems, this paper mainly researches the mass data storage and management system’s optimizing of nodes, data’s upload and download, text data searching and monitoring video transcoding and storage management.Finally, do automated test of the system as follows, the uploading and downloading speed, searching and analyzing text, distributed transcoding of video data. According to the experimental results, this paper finds out it is feasible to apply Hadoop to broadcast monitoring system, and it can improve the capabilities of data storage and management compare with the original system.