| As the structure of the front-end page becomes more and more complex and more and more functions,the code needed to maintain the page information by using the traditional buried point method is more and more complicated,and the manpower required is more and more,but the corresponding effect is not Significant improvement;the code for collecting page information without the buried point technology is consistent,and the impact of the page structure is relatively small,and the human input can be minimized on the basis of the guarantee result.Therefore,in order to reduce the dependence of page information collection on the front page structure,no burying technology is very necessary.In this thesis,the information that can be collected in the non-buried point is introduced in detail,and it is divided into two categories according to whether the standard is required for user operation:static information and dynamic information.Then according to the characteristics of different kinds of information,the corresponding collection method is designed.This thesis studies the core technology of burying-free acquisition:the unique identifier of the URL collection,the unique identifier of the page element based on the element's own attributes,and the precise collection scheme based on the unique identifier of the element.As the front end becomes more complex and the front-end framework increases,the increase in DOM changes in the page leads to XPath processing difficulties.Aiming at the problem that the traditional XPath scheme is greatly affected by the change of DOM,a scheme based on the unique identification of the page elements of the element's own attributes is designed.On the other hand,XPath's unique identifiers obtained by the same element in different pages are inconsistent,affecting subsequent statistics of collected data.Therefore,this thesis designs and implements a unique identification scheme of page elements based on the elements' own attributes,which solves the problem of inconsistent representation results caused by different positions of the same element in different DOMs in different pages.Finally,the thesis introduces the intelligent acquisition scheme that can be implemented in the non-buried point scheme.Since the previous solution found that in the different network environment and machine performance environment,the same solution may have an impact on the user experience.Therefore,this thesis designs a scheme for intelligent adjustment in different environments to minimize the impact on the user experience. |
