Design And Implementation Of Campus Access Control Data Analysis Platform

The construction of smart campus is an important part of the Action Plan for Educational Informationization 2.0 and the core content of the construction of campus information during the 14 th Five-Year Plan.In recent years,colleges and universities take the first-line business departments as building units,actively carry out informationization and intellectualization of exploration and innovation,use computer technology to reconstruct business logic,and organize the use of existing business system data to guide daily work.In this extensive development mode,problems such as repeated development of software system,inability to share data among departments,confusion of data management within departments often occur,which make it difficult to form the joint force of intelligent campus construction,and can not meet the requirements of "145" information construction with interactive,collaborative and open sharing.This thesis solves the difficulties encountered in the construction of smart campus by building a data platform scheme based on data lake.It provides unified data storage and management functions,stores business datasets from various departments,breaks through inter-departmental data barriers from the architecture for data access;Show the source information of data fields of various departments in the data lake,provide data field information of other departments transparently while facilitating the management of data assets within departments by business personnel,so as to make clear the available and combinable data,speed up the efficiency of business data conversion and reduce communication costs;Provides a unified access interface to data based on data desensitization and user authentication,enabling business personnel to easily access and use data content from other departments,extract and form high value data analysis results,and improve the overall intelligence level of schools.On the basis of building the data platform,using a variety of data analysis methods to make use of the campus access data,to meet the business departments’ related analysis needs on the campus access records,and to solve the actual business pain points.The main contributions of this article are as follows:(1)Implement data management scheme based on data lake.Unified storage and management of data using Delta Lake Data Lake tool;Design three desensitization schemes for different business scenarios to ensure data security and protect personal information privacy;Use Apache Atlas tools to manage data assets,make it easier for staff to understand the source and direction of data,improve management efficiency,and enhance interdepartmental collaboration;The middleware Delta Access is designed to implement the data Lake unified access interface to meet the user’s requirements for reading data from various departments in the platform after authentication.(2)Achieve the analysis and application of campus access data.For structured data,there are two ways to analyze it: one is the design of offline data warehouse,which takes Kimball dimension modeling as the main line,and analyzes the traffic records from the device dimension to form long-term data statistical results;The other is real-time data analysis,which uses the Flume+Kafka+Flink architecture to achieve statistical functions such as access flow thermogram,students’ status desk accounts,and monitor functions such as campus access violation warning.For traveling face photos in unstructured data,the Campus＿APF(Campus Access Pass Face Dataset)is constructed by pre-processing,filtering and other steps.It contains more intra-school face features than the public dataset,which can support the task of campus face recognition.(3)Implement the data platform analysis results foreground display system.Build a user interface(UI)foreground using SSM+Redis+My SQL cache architecture to process business interaction quickly and efficiently;Use a variety of UI component databases and data visualization tools,Echarts,to chart data analysis results.Finally,after testing and evaluation,the Campus Access Data Analysis System has successfully passed all the functional tests,and the results are good.The system includes data platform,data import,data analysis and utilization,automation of computing tasks,UI system based on data lake.The work in this thesis includes data platform construction,real-time data import,equipment dimension number warehouse construction in data utilization,real-time data analysis,traffic prediction,face dataset construction,travel dense screening and other functions.The foreground data display system in UI system.In summary,the system can fully meet the relevant functional requirements,and help schools to achieve information and intelligent transformation and upgrade,which has a certain application value.