Access Control And Performance Optimization Modulein Web Query Platform Based On Hadoop

Big Data is really a hot concept in recent years. With the explosive growth of data generated and collected by human beings, the ability to store and analyze massive data must meet higher requirements. Data warehouse, especially when based on Hadoop, is an effective way to improve the ability of enterprise data storage and analysis.In this paper, we introduce the necessity of the construction of Web query platform based on Hadoop, analyze the requirements data warehouse need to meet and its technical architecture, highlight its access control module according to the problems occurred during the rapid growth of some company. The main work of this paper lies in the following two aspects. Firstly, we summarize the problems it is facing and the new requirements of data analysis by analyzing the existing data platform. Then we put forwards the Web query platform based on Hadoop. Secondly, we introduce the new model of fine-grained access control, including Web page level security, database objects level security and tuple level security. We also describe the detailed design and implements of this fine-grained model and analyze its performance optimization in this paper.The Web query platform introduced in this paper has already put into service. The implement of fine-grained access control model in data warehouse, successfully realizes the row level access control, protects the security of enterprise data perfectly and prevents the company from the threaten of data leakage. The performance optimization module reduces the execution time of queries in data warehouse, improves the availability of the Web query platform.