Font Size: a A A

Digital Oil Field Of Unstructured Data Management System Design And Implementation,

Posted on:2012-12-30Degree:MasterType:Thesis
Country:ChinaCandidate:X ChengFull Text:PDF
GTID:2208330332493744Subject:Computer software and theory
Abstract/Summary:PDF Full Text Request
Nowadays, for oil enterprises who regard information as their lifeline, appropriate storage and management of unstructured data is becoming one of their main concerns. Distributed file system is the key technique to make unstructured management possible. This essay, through a systematic study and investigation and in combination with oil well logging project explored by the laboratory, designed an unstructured data management system applicable for oil industry. This essay focused on application needs of digital oilfield and made a thorough research on critical techniques involved in the system. This essay involves the following work:1. System analysis and designation. Targeting at unstructured data management challenging oil industry, this essay, in accordance with the features of distributed system, projected a three layer loose coupling system and made an elaborate analysis on each layer and their interbehavior.2. Research on high performance of the system. Outbound load balancing serves as an effective way to promote the system's performance. Based on the mainstream research on outbound load balancing and making reference to the features of the system, this essay adopted the idea of two-level outbound load balancing. Different load balancing algorithm for data service layer and storage layer are employed to promote the system's performance.3. Research on high applicability of the system. Taking into consideration of the applicability and reliability of the system, piece storage was brought into data storage layer with a replica distributed for each file piece. This research on data redundancy mechanism was conducted from two perspectives-the quantity of replica and replacement algorithm.4. Research on reliability of the system. The existence of replica in the system makes data consistency important. This essay researched and analyzed the mainstream methods of replica consistency, and adopted the approach of combining file making list with lease in the system.5. System implementation. This essay introduced the implementation of the system and demonstrated the procedures of the key operation of the system.Based on the first edition of system implementation for unstructured data management, this research firstly optimized the structure of the system and then, improved the system from its performance, applicability and reliability, which will further facilitate the practical use in oil well logging.
Keywords/Search Tags:Unstructured Data, Distributed, File Piece, Load-Balance, Replica
PDF Full Text Request
Related items