Research On The Application Of Data Tracing Me Thod In Hadoop Environment

At present, most data traceability systems are based on a traditional database, which resulted in the in dealing with massive amounts of complex data query efficiency is low.The results unreliable. In view of the above question,discusses the Hadoop system,the existing dat a model and the current methods of traceability and domestic and international research,on the basis of in-depth analysis of relevant theories, techniques and methods,and based on the viewpoint of gene encoding data.Based on genetic algorithm, a data chromosome tracing mo del is proposed, and it is applied to Hadoop system to deal with the problem of high com plexity and high complexity.Data chromosome tracing model is based on the data gene encoding technology and genetic algorithm.the core is using biological evolution process to simulate the process of data transmission,by the probability of occurrence of data in the communication process variation data analysis to achieve traceability purposes.The model is applied to the Hadoop system,a data traceability system based on Hadoop system is established.In the early stage to partici pate in the results of the HUAWEI project "Hadoop distributed system of traffic models to study" as the source data.Using the basic genetic algorithm,The probability and transfer matrix of each generation of data are calculated, and it is applied to the system and the simula tion experiment is carried out.Experiments show that the system has better performance and scalability.The data chromosome tracing model was applied to Hadoop system,It can solve the problems of low efficiency and low accuracy of traditional data tracing system when dealing with massive data.And can achieve high cohesion, low coupling and easy to expand the design requirements.