| The inter-connection among nodes of cluster plays an important role on the efficiency and scalability of the parallel computing. As the implementation of SAN (Storage Area Network) for clusters, optical network has a high performance advantage and possibility to be applied in cluster system: 1) The bandwidth requirement of cluster network has grown from 100Mb to 1Gb, until currently 20Gb, and this trend is even continuing; 2) Today, most cluster networks, such as InfiniBand, Myrinet, and GE (Giga Ethernet) not only require high cost under 20Gb bandwidth but also need mature technology. On the contrary, optical network can provide 40GB bandwidth using mature technology while maintain low cost.The difficulty of applying optical network into cluster system lies in software compatibility and performance optimization. Firstly, optical network is based on circuit switching, which determines its difference to packet switching ones. Resources of certain connection will be reserved for users from the time when the connection is established. Network resource is exclusive and will not be released until the disconnection of link. Therefore, applying optical network into cluster system directly will lead to problems of compatibility, especially for some management software of packet switching network. Secondly, optical network can only setup point to point but one-to-multiple or multiple-to-one connections; even if using TCP/IP can implement multi-cast indirectly, performance optimization should be taken into considerationIn this paper, our research on optical network in cluster mainly bases on MPI (Message Passing Interface). MPI is the most popular message passing specification currently. It provides standard library for parallel message delivery and operation. There are so many parallel applications which developed on MPI, such as the HPL (High Performance LINPACK) which is used to test the performance of TOP 500 (Top 500 Super Computers). MPICH2 is a popular implementation of MPI, based on its source code, the author can implement the second development and related experiment works.This paper mainly focuses on research of applying ASON (Automatically Switched Optical Network) into parallel environment of cluster system. At first, we design and implement the BUNIA (Beyond UNI Agent), which encapsulates UNI-C (UNI Client Side Signal Agent Protocol) and provides remote invocation interface of dynamically establishing and destroying network connection to clients. Secondly, on the basis of MPICH2 source code as well as BUNIA interface invocation, we re-factor the communication and operation of P2P message delivery to implement ASON parallel message library as AN_MPI. At last, we verify that optical network can be applied into cluster environment for higher efficiency by performance experiments.The innovation of this paper lies in two aspects: 1) The UNI-C of ASON provides interfaces of establishing and disconnecting light path links. However such APIs can not be invoked by client using remote call directly. Since it is expected that the system should be a loose coupling one, we design and implement the BUNIA which encapsulates the UNI-C protocol of ASON, providing remote invocation APIs for clients by means of socket connection.; 2) we design and implement the AN_MPI, which includes re-factoring of MPI-1 on peer-to-peer communication and collective communication operations, adding interaction with BUNIA for establish and disconnection of light path links. |
PDF Full Text Request