Design And Implementation Of Competitive Intelligence Collecting System Based On Vertical Search Technology

This article describes the development and construction of vertical search technology based on the competitive intelligence collecting systems design and implementation of the project by Institute of Scientific and Technical Information of Shanghai Chemical Industry.First, this article briefly introduces the background and sources of the issue. It not only introduces the intelligence analysis software of both domestic and international competition or platform status, but also shows the characteristics of competitive intelligence collecting system --- docking with the search engines and search features. Institute of Scientific and Technical Information of Shanghai Chemical Industry takes up the industry intelligence and information research and publishing for long term. The institute develops the project which has a positive value. Aiming at similar products on the market for the shortcomings of the situation, this article mentions five aspects of suggestions about it.Secondly, the paper introduces the working principle of general search engines, main function modules of search engines . All introduction lays the foundation for the theoretical basis of subsequent chapters.Then, this paper compares general search engines with vertical search engines to illustrate the vertical search engines better than general search engines, which has a feature with "specialized, refined, deep". It is the application tools in the field of specific industry sectors, institutions and other professional information resources in the development of online information and services. Moreover, this paper introduces key technologies in the the vertical search engines. The introduction of this knowledge industry for the design and implementation of competitive intelligence analysis system has obvious relevance, which is the frame of the subsequent chapters.Finally, the article focuses on the design of competitive intelligence collecting systems based on vertical search technology and implementation process. It one by one discusses the establishment from the vocabulary database, collection of information and data, information retrieval and user interface design module , in which the most important part is information and data acquisition module and the information retrieval module. The latter module discusses the manual entry of information and data, web information andata collected automatically in the "Spider" programming. In the module of info-index, the information retrieval module focuses on search engine technology with reverse order, while outlines the data statistics and Analysis and back-end database management module. In the construction and implementation process, the theory does not blindly pursue every step of the process, but a combination of hardware environment of the project and information collection features. It proposes the work of innovation, selective combination of several function operations. For example, in the automatic collection process, information collection, page extraction and part of speech taggingmergers procedure implemented in the same paragraph. It compresses information collection and identification , and saves the server's overhead.The results of the project is the vital composition of the Analysis Platform by Institute of Science and Technology Information of Shanghai Chemical Industry. It gives the first stage for the future studies in the development of the competitive intelligence analysis system on artificial intelligence-based technology. Meanwhile, it accumulates more experience and knowledge for the development of the latter projects.