Demand Analysis Of Statistical Professionals Based On Text Mining

In recent years,the Internet,artificial intelligence and other fields have developed rapidly,and concepts such as digital economy and digital transformation are in the ascendant.As an essential method and tool for data collection and quantitative analysis,statistics have become more and more widely used in all walks of life.Statistics professionals have higher and higher requirements in terms of knowledge,skills,subject background and other aspects.However,the current talent training tends to emphasize theoretical knowledge rather than practical application,and there is less integration and training with other related disciplines,resulting in the quality of statistics professionals cannot meet the employment needs of all walks of life.The future employment situation is extremely severe and complex.Therefore,it is necessary to analyze the market demand for statistics professionals,to provide some reference for students' career goals and directions,and to provide a basis for formulating college personnel training programs.Based on the recruitment information released by the 51 Job recruitment website,this paper analyzes the demand for statistical professionals.First,descriptive statistical analysis is carried out from the three dimensions of company,qualification and position to obtain the basic demand characteristics of statistical professionals;secondly,the LDA model is constructed to explore the core requirements of the employment market for statistical professionals;then K-Means++ text clustering algorithm is used to divide job types and explores differences in demand between jobs.In addition,combined with the clustering results,the CART model is used to explore the influencing factors of salary,and the association rule analysis method is used to analyze the correlation between multiple indicators such as job type,education background,and work experience.The research results show that:(1)Demand characteristics: mainly distributed in the Internet industry,Guangdong,Shanghai and other places;mostly technology-based,private,and small and medium-sized enterprises;generally require 3-4 years of work experience,undergraduate education;work content includes data analysis,project implementation and management,market survey and research,etc.;(2)Job requirements: core requirements are computer technology,project skills and management capabilities;skill requirements include office software,PYTHON,SQL,R,etc.;quality requirements include communication skills,teamwork Cooperation ability,logical thinking,writing ability,etc.;interdisciplinary subjects are mainly mathematics,computer,etc.;(3)Job categories: management operations,data analysts,market research,data engineers,biological/medical statistics.Management and operation positions have lower requirements for work experience,and focus on execution and pressure resistance;data analysts and data engineers have higher requirements for work experience.The former requires strong logical thinking,data sensitivity and work efficiency,while the latter requires Strong writing ability is required;market research positions pay more attention to learning ability and innovation ability;biological/medical statistics have the greatest demand for master and doctoral talents,and also have high requirements for the use of SAS software and English proficiency;(4)Salary: the monthly salary is mainly 6 to 9 thousand,work experience has the greatest impact on salary,followed by job category,data analyst salary is the highest,followed by data analyst,biological/medical statistics,market research,management operations,education and regional salary also plays a role.(5)Affiliate relationship: Guangdong Province,private companies,data analysts or management and operation positions,recruitment information with a monthly salary of 3 to 9 thousand basically requires a bachelor's degree;requires a bachelor's degree and provides a monthly salary of 6 to 9 thousand general recruitment management operations positions.