Font Size: a A A

The Design And Implementation Of HS Big Data Indices Management System

Posted on:2018-10-27Degree:MasterType:Thesis
Country:ChinaCandidate:D YangFull Text:PDF
GTID:2348330512986436Subject:Software engineering
Abstract/Summary:PDF Full Text Request
With the development of the opening and sharing strategy of big data in the field of Human Resources and Social Security(Abbreviated as HRSS),we are in urgent need of that big data can support making decision accurately.In order to promot the opening and sharing of big data of HRSS,to improve the ability of big data decision-making,we need to manage and monitor the various big data indices of HRSS usefully.The big data indices mainly include documental informational big data index of insuranced people and business big data index of HSRR.The documental informational big data indices mainly involve status of insuranced people,course of insuranced people,individual information labels etc.,which is used to provide opening and sharing of big data.The business big index normally reflects the ratio of insurance people,insurance growth rate,employment rate and occupational injury rate etc.,which is used to provide accrate decision-making.According to the actual background above,in order to monitor and manage the big data indices of HSRR easily,this thesis puts forward that organizing and integrating the two sides content of documental informational indices of insuraned people and business indices of HSRR to build the MongoDB-based documental informational database and HBase-based business indices database,to store big data indices of HRSS.This thesis designs and realizes the big data indices monitor and management system,which through real-time monitoring,analyzing and processing of big data of HSRR,and stores documental information indices in the documental informational database,and stores pivotal business indices in the business indices database,to support the opening and sharing of big data and decision-making dependent on big data.The main working process of the system is that it firstly makes extraction of the business data of HSRR which is distributed in various cities and various databases of business system to HBase database(known as business process database of the system),and then makes clear,transformation,analysis processing of HSRR's business data,through the Apache Spark and Apache Storm big data analysis and processing technology,finally stores the analyzing result into the documental informational database and privotal business indices database.The basic function of this system includes system management,data collection,incremental message cluster management,documental informational indices management,privotal business indices management etc.The development of this system makes use of the Vaadin framework to design and fulfill the system,which greatly improves the efficiency of system development.The thesis mainly illustrates development background,system functions,system design and developing process etc,Especially Emphasizes design thought,development process of the system.The object that the system involves includes insuranced people and government's departments of Human Resources and Social Security.The system is different from regular application system,of which the mainly contents dealing with is huge amount of business data of Human Resources and Social Security,and characters with big data feature.In order to ensure the efficiency of the data,we use big data processing technology to improve efficiency of data processing and analysis,and to bring a great benefit for insurancd people learning about personal information timely,and be benefit for big data opening and sharing,be benefit for the government's departments of Human Resources and Social Security making decisions timely.
Keywords/Search Tags:HS Big Data, Big Data Indices, Vaadin, Spark, Data Analysis
PDF Full Text Request
Related items