An Web Structure Optimize System Based On Web Log Mining: Design And Implementation

Web is a huge information source, but only the user, who often visits the web site, can determine whether the structure of the web site is proper. Each visit of user will register a visit log on the web server. From the web log, we can get the information, such as: URL, which the user visited, the user's IP address and the user's visit time. In this paper, we develop a Web Structure Optimize System(WSOS) by analysis the web logs. Using WSOS, web manager can get the user's latent evaluation to the web at any moment, adjust the improper web structure, and grasp the visit statue of the whole web site resource.WSOS includes the data preprocess, data warehouse subsystem based on OLAP technology, knowledge extraction subsystem based on web log mining.Data preprocess includes web log cleaning and filtering, user identification, session identification, and path fill (using algorithm GTPFWLP), which provides service for the two subsystem below.Data warehouse subsystem based on OLAP technology set up a data warehouse by using the huge web log, on which we can use OLAP technology, and master the visit statue of the whole web site resource.Knowledge extraction subsystem based on web log mining includes web site structure adjuster(algorithm CBP), visit pattern finder(algorithm TFAP, DGWAP), page association rule fmder(algorithm PARD), and information statistic reporter producer. This subsystem is the kernel of WSOS.