Research On Service Organization, Discovery And Access Based On Structured Overlay NetworK In High Performance Computing Environment

The high performance computing (HPC) is widely applied in some significant fields of national defense and national economic construction (such as information analysis, weapon system simulation, weather forecast and more), playing an important role in safeguarding national security, promoting the development of science and technology and propelling economic development. The research on the service organization, discovery and access of HPC services system has important practical significance.Due to the problems in centralized services system such as single-point failure and single point of failure, the structured P2P-based (Peer-to-Peer) services system has received widespread attention. However, the traditional Distributed Hash Table (DHT) does not support complex query, and can not meet the demand for service dispatch, task allocation and cooperative processing in the context of HPC.In this context, this paper comes up with a new structured P2P network model which is applied in HPC service organization successfully and conducts a further research on the construction of service overlay network, two-stage service discovery algorithm for complex query, the collaborative computing model in the context of and structured overlay network, and other issues. The main research content and innovation points are as follows:1. Analyze the current research of P2P technology in HPC field, point out main existing problems, and define the research range and basic ideas.2. Introduce structured P2P network model to HPC field, build service overlay network with service as nodes, and design routing table structure, routing algorithm, embedding algorithm and updating algorithm.3. Incorporate semantic information into service addressing, routing table and routing algorithm to realize the service distribution of semantic congregation and semantically related routing processing. It has higher routing efficiency and lower bandwidth consumption than Kademlia.4. Use the rich semantic information of HPC service and build multiple index mechanism. The two-stage service discovery algorithm is proposed to realize many functions for complex query (such as fuzzy keyword search, mixed search and etc.). Besides, the semantic feedback mechanism is proposed to further optimize routing. It creates better query results than Kademlia.5. Implant semantic tree with computing nodes and form computational domain through service aggregation. The concurrence, dispatch and other cooperative computing models in the context of structured overlay network are proposed based on this to meet the demand of HPC system for decentration and expand the application fields of structured P2P technology.6. Design and realize Soverlay prototype system. And the structure, functional unit operation interface and routing message format of Soverlay system are provided in this paper.