Design And Implementation Of Remote Controllable Network Data Collecting Platform Based On Net Magic

With the fast development of the Internet and communication technology, it seems an emerging trend for the convergence of communication network, computer network and wired television network. As a result, everyday working, living and entertaining of human beings are coupled with the Internet more tightly. End users have a more strict standard for network Qo S and information security, ISP needs to enforce better management and maintain with networks by network measurement and analysis to fulfill the customer’s needs; At the meanwhile, the research and development of IP network technology, network management, networking failure detect and recovery, Internet traffic engineering and network behavior mode are all clients of network measurement technology. Network measurement, which is regarded the basic method to analysis and monitor network data, has been an important hot topic in the field of network research.However, the accuracy of network measurement highly depends on methods and tools to perform data collecting. As the basis and premise of network measurement, network data collecting have become a priority with the network measurement. How to design and implement a data collecting tool which has high accuracy, easy management interface and no influence on normal networking operation is the overwhelming consideration to researchers on network measurement. Due to all these aspects, this thesis designs a remote-controllable network data collecting platform called NDCP on Net Magic. The major work and innovations include:Firstly, based on careful researches of related technics such as network measurement, data collection and Net Magic platform, the implementation scheme of a Net Magic based remote-controllable data collecting platform is proposed. The global architecture and deployment environment of the platform is designed, together with the hardware logic and structure of the remote control software which adoptes the idea of multi-block hardware and multi-tier software.Secondly, a novel method of remote control and management with the platform is issued, which consists of the basic scheme design of interaction between hardware and software, the implementation of specific-purpose protocol for remote access control of the data collecting platform. The lowest level and basic library function as well as main APIs in application-support layer inside the three-tier structure model of remote control and management software are also defined.Thirdly, new ways of hardware design of network data collecting platforms are proposed. With technologies such as auto address fetching, network address resolution, multi-tuple storage and search, accurate time stamp, functional components as packet classification, auto address configuration, table lookup and packet forwarding, packet transmission control of collecting platforms are implemented.Lastly, key hardware components of data collecting platform have been identified on the testbed which is constructed upon the novel collecting platform design. Insightful analysis of platform performance, hardware resource consumption and packet forwarding latency has been done, the result of which can be leveraged to show the stability of the platform and its ability to fulfill the design target.In sum, this thesis introduces researches of network data collection related technologies based on Net Magic with designation and implementation of NDCP data collecting platforms thereafter. The research productions have certain theoretical meaning and practical value to innovative development of the network data collecting technology.