The Research On Scalability And Related Key Agorithms Of Internet Measurement Systems

Recently, network measurement has become the key to the management and research of Internet. However, the scalability of the existing network measurement systems has been challenged by the heterogeneity and high-speed trend of Internet. This dissertation discusses the scalability issues and related key algorithms of network measurement systems. It focuses on the scalability problems of three aspects for improving the performance of network measurement systems: end to end one-way delay measurement, traffic measurement on high-speed network, identifying super-connection hosts in network security detection. The main contributions are as follows:(1) The clock skew and resets of the end-systems will result in serious error in one-way delay measurement. A new algorithm based on the Fuzzy clustering analysis is proposed to estimate and remove the clock skew and resets from one-way delay measurement results. Numerical experiments demonstrate that this algorithm is more accurate and robust than existing algorithms. Additionally, the new algorithm has time complexity of O(N).(2) The Netflow scheme commonly used in traffic measurement is not scalable when the traffic increases rapidly or traffic bloom (e.g. DDos) happens. A measurement-buffer-based time-stratified packet sampling method is proposed to overcome Netflow's shortcomings. Theoretical...