Research And Implementation Of HBase-based Application Platform

With the rapid development of mobile Internet and the computer industry in recent years, the amount of data generated has been growing explosively. The explosive growth of data gives rise to many new technology and titles, for example, big data. Traditional relational database cannot support characteristics of big data, such as huge data, high scalability, distributed computing and so on. There have been various types of emerging NoSQL technology, many of which performed well in the field of big data. HBase is a distributed storage system with open source of Apache Software Foundation (ASF), and a kind of NoSQL. HBase can be well integrated with big data computing framework Hadoop, which is very popular in the field of big data and can provide large scalability and highly reliable data storage solutions for big data.The storage of Big Data technology and traditional RDBMS is completely different technologies. As for most of the enterprises, systems used employed traditional relational database, which is greatly different from the newly and important NoSQL. With the system gradually getting huger, traditional relational databases cannot support MOOC very well.In this paper, through the study of HBase and related technologies of big data, we designed a application platform based on HBase. according to the requirements of quality courses and MOOC platform, we realized the system running on the platform. First, HBase technology and big data techniques were studied, mainly introduces the characteristics of HBase data, HBase data storage principle and characteristics, Hadoop technology, ZooKeeper, Solr. Secondly, proposed and designed based on HBase and big data technology solutions and infrastructure, including the overall architecture design, data storage and access design, data migration design, real-time search architecture. Then, analyzed the question answering module data requirements in quality courses and MOOC, mainly analyzes the data storage, data migration, data access and data search. According to the design and architecture, we achieved a specific function. Finally, we tested the system performance and stability, and analyzed test results and proposed improvement measures and verified the feasibility of the system.