Demand Analysis Of Data Jobs Based On Text Mining

With the advent of the era of big data and the development and popularization of higher education,the number of data talents in colleges and universities is increasing;in the process of development of big data and artificial intelligence technology,the market demand for data positions is also gradually increasing.However,there will still be situations in which it is difficult for graduates to find more satisfactory jobs and for companies to recruit ideal talents.This paper aims to explore the recruitment situation of data talents in the job market,compare the focus of data positions,and discover the requirements of enterprises for data talents,so as to provide some references for job seekers who want to engage in data positions.In this paper,four keywords,such as "data analysis" "data mining" "data development" and "data operation",are used to search on the 51.5.com.cn recruitment platform,and the web crawler technology is used to obtain job information and then expand the data-based jobs.Research.First of all,using descriptive statistics and visualization methods to compare the urban demand distribution,work experience requirements,and education requirements of these four types of jobs,explore the differences in demand for data jobs in different regions,and analyze job salaries and work experience on this basis.The trend of requirements,salary and educational requirements;secondly,text data preprocessing and text vectorization are carried out on the recruitment text information of the four types of positions,the LDA topic model is constructed,the optimal number of topics is determined according to the model evaluation index,and various types of topics are output.Subject words;finally,the Word2 Vec model is used to expand the subject words extracted by the LDA model,extract terms with similar semantics,and combine the two to filter out the keywords to draw a word cloud.class positions for comparison.The research results show that cities with large demand for data jobs include Shanghai,Hangzhou,Nanjing,etc.in eastern China,Guangzhou,Shenzhen,Dongguan,etc.in southern China,and there is a greater demand for data mining and data development jobs in southern China;work experience In terms of requirements,most positions require employees to have more than 1 year of relevant work experience;in terms of academic requirements,a bachelor’s degree has become the starting degree for most data-related jobs.When seeking data mining and data development jobs,a bachelor’s degree does not have a competitive advantage.The results of the subject heading extraction of the LDA topic model and the Word2 Vec model show that the data analysis position emphasizes data sensitivity and the establishment of an index system;the data mining position focuses on the design and optimization of data analysis and mining algorithms,and requires the ability to use big data platforms;data development The research and development and operation and maintenance of major data platforms and data computing architectures on the job side;data operations aim to guide business growth through the combination of data and business.Data analysis and data operations are more business-oriented,while data mining and data development are more technology-oriented.According to the above results,this paper aims to help job seekers who are committed to the development of data-related positions,help job seekers,fresh graduates and school students to choose suitable job types and employment areas according to their own conditions,and to provide targeted solutions according to market demand.Strengthen its own strength and increase the employment rate.