Design And Implementation Of Vertical Search Engine In The Field Of Medical Device

As the constant penetration of Internet technology in the medical industry in our country,the traditional medical device products gradually transferred to the online access from information channels,more and more medical device product information is posted online,but vast amounts of data over the Internet and more interference information brings equipment department of medical institutions,medical devices professionals and medical apparatus and instruments consumers a lot of inconvenience to access to medical device products information.And the general search engine searches for too much information and they hava commercial ranking and advertising,which will bring inconvenience to the professional medical device search users to search medical device product information.By studying the working principle and the related technology of the vertical search engine,this article combined the characteristics of information with user needs in the field of medical devices,researched and implemented a vertical search engine specialized in the field of medical devices.This paper mainly studied the following content:(1)Put forward the needs and objectives based on researching the related technologies of vertical search engine and full text search framework and analyzing the current problems,and then designed the overall architecture and workflow of vertical search engine of the medical devices.(2)Customized fetching the strategy of topic crawler of medical devices based on link template rule tree,used links hash algorithm to achieved the theme crawler multithreaded fetching,eliminated the restrictions on robots.txt,effectively controlled crawl range of the crawler and improved crawl efficiency of the crawler.(3)Customized information extraction strategy based on the structure of the DOM tree,then extracted and saved key information of key nodes to make web page turn into text information.(4)Implemented word omni-segmentation algorithm based on the medical devices topic dictionary and implement digital-chra-connector segmentation algorithm,and combined with word segmentation principle of Lucene to form a custom medical device in Chinese word segmentator which ensured users search for fine-grained keywords and product types accurately.(5)Constructed a double storage structure of database-index library,used Lucene's indexing technology to structure information and store it and combined with MIAnalyzer to establish the inverted index of the text at the same time,and then used Lucene's search technique to set the retrieval and sorting in different fields,which makes users search for products by name,brand,model,sort products by price and filter products by country.Requirements of searching medical device products were basically reached by the vertical search engine of medical device,which can help the medical institutions,medical equipment practitioners and medical equipment consumer groups to obtain medical device product information to a certain extent and has a certain engineering significance.