Design And Research Of Computer Professional Portrait Platform Based On Hadoop Technology

In recent years,global engineering education has undergone great changes,which has brought great challenges to the talent cultivation of engineering-based higher education institutions.The requirements of many countries for the quality of engineering education in higher education institutions are also getting higher and higher,which has led a series of engineering higher education institutions to carry out engineering education accreditation of engineering majors one after another.Through engineering education accreditation,the teaching achievements of engineering majors can be evaluated comprehensively.The process of engineering education accreditation involves various aspects such as talent cultivation program,curriculum system and graduation requirements of each major,which requires huge amount of relevant information and covers a wide range of areas.In order to solve the limitations of manual operation in engineering education certification work and realize the accuracy,efficiency and intelligence of professional engineering education certification work,this topic takes computer science majors as the research object,uses Hadoop technology and Sping Boot framework to realize the design of professional portrait platform and conducts research on all relevant aspects of certification.This paper first analyzes,designs and implements the computer professional portrait platform based on Hadoop technology based on the key technologies of Hadoop,HDFS,Map Reduce,HBase and the background related to the professional certification work in colleges and universities.By analyzing the certification workflow,business requirements and the problems faced,we realize the design of modules such as graduation requirement management,course system management,reach degree analysis,and student course grade management.Further modules such as continuous improvement management are designed to ensure informationization of professional certification work,automation of professional certification process,intelligence of graduation requirement achievement evaluation and visualization of certification information,and finally form the computer professional portrait platform.The platform can help professional certifying personnel to carry out engineering education certification work and graduation requirements achievement evaluation,and support continuous improvement evaluation.Based on the above professional portrait platform,the key technology of Hadoop is used to process students’ course grades for calculating the graduation requirement achievement.The specific process is to first set up a Hadoop cluster to obtain the student course grades stored on the HDFS platform,use Map Reduce programming to pre-process the grade data,obtain the assessment methods and student grades in the form of key-value pairs,store the calculation results in the table named by the course corresponding to HBase,and calculate the course target achievement according to the achievement formula,so as to realize the graduation requirements The secondary index points are supported.The platform implemented in this paper is not only highly reliable and efficient,but also solves the problems such as high concurrency that exist in traditional information management systems when dealing with large amounts of data.This professional portrait platform can eventually achieve simplification of engineering education accreditation workflow,improvement of engineering education accreditation efficiency and eventual normalization of engineering education accreditation processing through information management of professional accreditation and use of big data technology.