The Design And Implementation Of Data Import Solution In Off-site Web Analytics System

With the development of web analytics technology, web analytics is far beyond traffic analysis. For off-site web analytics system, the biggest problem is the method of data acquisition. The solution to this problem can be defined as three key steps:define the data types and structure of different data suppliers, transfer data and config the reporting system to show data reports.Currently, the solution in industry adopts lots of custom development:suppliers define their data structure and tell system developer, who will then develop specific data file resolver programs running as timing tasks in data server; data suppliers will transfer their data file in time using FTP method; the data is shown in a pre-defined way in report system. This solution has lots of drawbacks such as the waste of labor due to too much custom development, insecurity and unreliability of data transfer method and the lack of custom configuration in report system.A new solution to implement the data acquisition procedure is supplied in this paper: first create a platform for different suppliers to define and modify the data types and structure; then allow suppliers to transfer data using web service interfaces; finally provide a consistent way for users to config their report.This solution will be implemented based on an existing web analytics system, using php as key technology. In this solution, lots of php framework and library technology will be applied such as web service, Symfony, Mojavi, DB_SQL and NuSOAP along with front-end technology like JS and Ajax. New web analytics system will provide a more visible, flexible and efficient solution to the problem of off-site data acquisition.