The Research And Design Of The Data Processing Platform For Location Based Service

In the research of the data mining from location based service data, the ability ofdata process limits the data analysis. Although with the help of MapReduce,researchers can accomplish their calculation quickly, the calculation is still complex.Since MapReduce model has a strict limit for the data structure and calculation job,the researchers have to undertake a lot of work of data cleaning and format conversion.During their data process, researchers also need to write a lot of program to achievethe experiment. All these complex jobs have negative impact for the data analysis. Inthis paper, we designed a data process platform for location based service data, andthree major jobs have done.1. We designed the domain model of the data cleaning and data processing for thelocation based service data. This paper made a discussion for the data modelingapproaches, and then we conclude the basic idea of data modeling and purpose thedata modeling approaches for these requirements. Then we provided the data modeland data cleaning strategy for the general location based service data.2. We designed the software architecture for the data processing platform. Thispaper analyzed the current technology of data processing, built an open dataprocessing platform with customizable patterns. By write their data pattern,calculation pattern and core function, a researcher can accomplish his data analysisjob quickly from original data.3. We provided the system design for this platform. This paper provided thedefinition of the data model and core component of the data platform in a formallanguage and we used the component technology and language Z described theplatform. We also defined the processing logic of the components.By analysis current data processing platforms and the data search requirementsfor the traffic flow research, this paper designed an open data cleaning and dataprocessing platform for location based service. It can be used in the data clean processfor location based service data, It can also provide the basic quick search inspatio-temporal dimension. The designed methods using components can also providethe technical support for the future extensions.