Measurement And Evaluation Of Data Consistency

With the increasing amount of information processed by global computer systems,the quality of data has become an issue of great concern to the industry.Data quality is a multidimensional concept that relies on both the needs of the consumer and the standards set by the company or organization.That is why it is difficult to assess data quality.Consistency problem is one of the key points of data quality research in this paper.In the process of system and software quality requirement and evaluation,it is very complicated to quantify consistency,on the one hand,we need to measure the quantitative consistency,on the other hand,we need to select the appropriate measurement function to calculate the index value.Now more and more distributed systems are being developed to provide users with easy access to data through communication networks.In many cases,even if the network fails,we still want the system to function properly.In this case,an important issue is how to ensure the reliability of the master database data while maintaining the consistency of multiple replicas.Therefore,the inconsistency detection of the master library and replica is a problem that can not be ignored by traditional methods such as complete inconsistency.In order to effectively evaluate the consistency of data and improve the efficiency of data qual-ity measurement,based on MySQL database system,this paper constructs the frame of data consistency measurement and evaluation,and describes the connotation of the framework of consistency evaluation from four aspects of target entity,measuring method,measure element and measuring function.In this paper,two methods of inconsistent data detection are proposed,and a data consistency detection tool is implemented.In order to solve the above problems,this paper studies the data consistency measure-ment and evaluation,in particular to the following:(1)The data consistency measurement and evaluation framework is proposed and the quality measurement function is designed.(2)A method for detecting inconsistent data of replicas is proposed.This method realizes the consistency detection of the replica data through the steps of data chunking,calculating the data block digest value,inconsistent data detection and so on.The CRC algorithm is used to compute the digest value of the data block,which greatly improves the detection speed.(3)In this paper,a single table detection method based on conditional function depen-dency is designed.The single table consistency detection based on CFDs is studied,and the single table violation data is detected by generating detection query SQL.(4)Based on the FCS-ABP model and the Six Sigma classification standard,a con-sistency classification method is proposed,and the validity of the model is validated by experiments.The research results of this paper are helpful to the improvement of data quality,which is suitable for the consistency assessment of backup systems as well as the study of the con-sistency of single-file data,and can provide a theoretical basis for the consistency measure-ment and evaluation of distributed systems.