Design And Implementation Of Smart Service Analytic Platform

With the development of the Internet, the number of users and applications increase rapidly. The original design for the Internet is severely challenged, exposing many difficult problems, such as poor security, weak mobility support, low utilization rate of resources, lack of extensibility and so on. Basically, the reason of all kinds of serious drawbacks of the existing Internet is the characteristics of "triple binding" and the traditional relatively static and rigid design.Aimed at solving these difficult problems of the existing Internet, National Engineering Laboratory for Next Generation Internet Interconnection Devices of Beijing Jiaotong University has putting forward Smart Cooperative Network Architecture. In this paper, we designed and implemented the Smart Service Analytic Platform, completed the service registration and parsing mechanism. Meanwhile, for the large-scale network situation, we proposed and implemented the fast parse and query scheme for the service. The scheme has great significance in correctness and feasibility for the development and validation of Smart Cooperative Network prototype system.Firstly, we analyzed the problems and deficiencies existing in the current Internet, introduced the "three layer" and "two domains" system architecture model of the Smart Cooperative Network. Then we briefly described the service registration and parsing mechanism, illustrated the main work of this article and thesis structure.Secondly, we described in detail the registration and parsing mechanism of the Smart Cooperative Network Architecture, including registration mechanism, parsing and forwarding mechanism as well as package format design scheme. Then we introduced the development platform in our implementation, including OpenFlow, Click Router and Intel DPDK.Thirdly, according to the design of registration and parsing mechanism of Smart Cooperative Network Architecture, we completed the mechanism in the domain and between domains, focusing on the implementation of resource manager and border router function module. Then we based on OpenFlow and Click, built the prototype system, accomplished the implementation of function module and tested the function for verification.Finally, considering the situation of the large-scale service request and huge amounts of registration information, we designed and implemented the Smart Service Analytic Platform based on Intel DPDK. We achieved the optimization of high concurrency Cuckoo Hashing algorithm on DPDK platform, combining DPDK characteristic such as hugepage memory, batching and prefetching, which improved the packet forwarding throughput. Then we made tests for our implementation, including raw forwarding test, algorithm optimization analysis test, impact test for table item numbers and impact test for CPU numbers. The test results show that when the service identifier number is 500 million, the service request packet speed reaches 20.49Mpps which is the limit speed of NIC, the Smart Service Analytic Platform based on Intel DPDK can reach 18.30Mpps, which is the limit speed of DPDK packet forwarding.