Applied Big Data Research On Electronic Construction Diary Of Railway Engineering

With the popularization of Railway Engineering Electronic Construction Diary in various railway lines,the construction site data is increasing at an unprecedented speed.These data include track,subgrade,bridges,tunnels,and other engineering specialties,collecting the scene work that technicians,quality and safety officers are doing everyday.And also,covering the reporting,multiple business scenarios,including workflow and basic statistics,which are characterized by diversity.In the era of large data,such a huge,multidimensional data is a gold mine for on-site construction,project management,can provide effective and key information for these domains,has a high analytical value,but there is no action to make these data into the power for enterprise efficiency growth.On the other hand,the increase of data,impacts system performance.Especially statistics and analysis based on OLTP system makes the system performance worse.It is urgent to introduce big data technology to eliminate the influence of massive data.This paper will firstly introduce the Railway Engineering Electronic Construction Diary System,analyze the data structure and characteristics of the current system in detail,divide the data into structured and unstructured types to discuss,and point out problem domains of applying big data to construction diary.Latter use software developing methods to analyze and design.The problem domain is then transformed into the problem-solving domain,facilitate the two business domains of storage system and analysis system be formed.Finally,the storage system and the analysis system are engineered separately,where the traditional software development method is still used.According to the customer's requirement during working on this paper,the analysis application scenarios are arranged.These applications are constructed step by step from the requirement developing,system designing,and implementation stages.By taken Hadoop and its environment tools,data mining algorithms,covering the extraction,cleaning,loading,query,analysis of the entire data life cycle.Through the mutual support of storage system and analysis system,the specific data is analyzed,which makes the information much easier to be understood by customer enterprises,much easier to convert into productivity,and improves the insight of related enterprises to use data.We know that the application of big data itself is a cyclic process.By applying large data to obtain analysis model,improving construction and management level,good management level can improve the quality of data itself,and then through highquality data,further improve the model,complete a mutual promotion,put final step to this better loop.Through the application of construction diary data in this paper,the first step is taken for this loop,and the expectation of customers is achieved through practice.