Study On Soft Control Mechanism Of Complex Multi-Dimensional Optical Network In Computing System

With the rapid growth of big data and cloud computing, the traditional data centers based on electrical switching are close to the limit in terms of bandwidth, switching capacity, scalability and energy consumption,which are bottlenecks in improving the performance of distributed computing. Optical switching network is suitable for data center network due to its characteristics of large capacity and high bandwidth. Among the optical switching network architectures, OpenScale optical switching network has the small world characteristics such as short average network distance, regionally high aggregation coefficient, etc. It can be seen a promising optical network architecture in data center, due to its ability of dynamic wavelength connection reconfiguration, flexibility of bandwidth allocation and easy scalability. At present, the unified resource management and scheduling platform commonly in distributed systems like YARN cannot perceive network resources for reasonable task placement and network resource applying. Consequently, the network becomes a bottleneck restricting performance of computing system. By bridging the gap between distributed resource management platform and the optical network, we can make the optical interconnected network resources meet the requirements of distributed computing applications.Finally, both performance can be improved.Based on the background aforementioned, the main contents of this paper include the following two aspects:Firstly, we propose a fusion architecture combining network and application in this paper. Based on the unified resource management and scheduling platform YARN, its workflow is illustrated and the performance bottleneck caused by network are analyzed. We combine OpenScale and YARN platform considering the features of former. Based on this architecture, we design the network-aware resource scheduling mechanism and communication service interface connecting YARN and OpenScale network centralized controller. With additionally extended the OpenFlow protocol, centralized controller can flexibly control the OpenScale optical network to meet the request of computing system. We verify the effectiveness of the mechanism on a system prototype.Secondly, we design and implement the OpenScale network node. We prepare the boot files and programs for operating system, which is the basic environment for OpenFlow Agent belonging to control plane. We design and debug the drive circuit of the variable optical attenuator in the node. Experiments show that the node can work normally.