Design And Implementation Of Guangdong Telecom IT Data Cleaning Backup Scheme

China Telecom enterprise aims to allow the customers to enjoy a wonderful life with new information technology.And its strategic goal is to become a world-class integrated information service provider.Either this mission or this goal is insisted by many systems.And behind the systems,there is something hidden--data.On account of years of accumulation,these systems have to support a large quantity of data which is produced by massive customers.The huge amount of various data includes each customer's bills,basic information,the application logs and so on,all of which are generated ceaselessly and at the same time of great value.Data is the most basic element of achieving the corporate missions and goals.Therefore,data storage has become an important strategic fulcrum.Integrated billing system,as one of the most important systems of MBOSS,of which the data storage and management directly affect the users' perception,and will directly influence the development of Guangdong Telecom.With the rapid development of telecommunication business in the past few years,the advent of the era of 4G,a lot of voice,SMS,Internet data,a wide range of logs and database tables appeared and grew explosively.Besides,with the increase in the complexity of business,there are more and more complex data structures,and the data volume is becoming lager and lager,leading to great difficulties in data storing and processing.Consequently,the Oracle Database is unable to support the storage of huge data.In case of an emergency,we can only reduce online data which is stored in Oracle Database.What's worse,there will be a long recovery period if we use tapes to backup the data that can't be analyzed.Without doubt,this approach,on the one hand,can not meet the present requirements;on the other hand,it has a bad effect on the data analysis and fault verification.And worse still,it will affect the customer awareness and implementation of company strategy.Therefore,we are in urgent need of a new way of data storage and management,to relieve the growing of data.Based on the actual situation,this paper analyzes the data characteristics and data cleaning requirements of the telecommunication system and then designs the data cleaning backup scheme which is taken into consideration generally.There are three parts of the work: Part one: analyze data characteristics and classify data.Part two: depending on the classification results,a data cleaning system is designed for the majority of conventional data.Part three: in view of the special characteristics of the data,design a special clean-up backup program.The core for the paper is the designation of the IT Data Cleaning Backup System which mainly studies analysis,design,and implementation of the system,trying to establish a system in which huge amounts of data considered from aspects of architecture,technology application,database design,interaction with other systems,system analysis and design can be stored.And the most important is that it can provide real-time query and cleaning function of the system.The MVC pattern is adopted to improve the design of IT Data Cleaning Backup System.Technologies,such as the BS structure programming techniques,the browser programming language including HTML,CSS,JavaScript,are used in the design.And we adopt JSP/Servlet as the server-side programming technology.We use JDBC to link the MySQL Database and Web Services technology to invocate cloud services using rest protocol and XML for data transmission.At the same time,we store data in HBase.In the aspects of systems analysis,the paper mainly described actual application requirements and the function module classification,including: Scene 1,a key to health examination;Scene 2,rubbish cleaning;Scene 3,health assessment;Scene 4,in search of big data;Scene 5,enquiry about complaint;Scene 6,query.