The Study And Implement Of Chat Robots Based On Big Data Analysis

Currently under the background of Big Data, Machine Learning, Data Mining and other fields of related science are rising rapidly, artificial intelligence(AI) is no longer out of reach. The study of Big Data Analysis and Deep Learning lead to the development of chat robot, some experts predict that chat robots will replace the APP to become the next generation of Internet services entrance,business opportunities stimulate the development, so, it can be said that the chat robot research is half for the opportunity and half for the challenge. There are many research institutions focus on chat robot research and development, but this area is still in its infancy, current chat robots are more or less having shortcomings.Therefore, in this paper, we study the main technologies involved in chatting robots. In view of the common shortcomings of chat robots, two improvements are proposed. First, chat robots should have the ability to analyze the content mentioned above, that is, chat robots should not be confined to a form of simple response, but based on the above dialogues which called "memory"; Second, in chat robot system, the user's friendliness analysis should not be limited to a single word, but to consider more association between words. This article can be divided into four parts, the development of chat robots and related science and technology background, the design part of the chat robot based on large data analysis, the implement part of chat robot which contains deep learning algorithm and question-answer pairs' classification based on distributed computing environment, and the last part is of test results' analysis and the summary and prospect of this paper.The first part is the corresponding chapter 1 and chapter 2 of the text. In this paper, firstly, the research background, research results and the significance are introduced, and the improvement direction of our chat robot is proposed; The second chapter, introduces the key technology involved in chat robot, the principle and mathematical derivation of related algorithms.The second part corresponds to the third chapter of the text, which is the design part of chat robot based on big data analysis, includes the design of chatting strategy based on large data analysis and Web display platform of chat robot. Among them, the chat strategy part includes seven modules from the corpus collection to the big data distributed computation, the Web mutual platform includes from the overall design of the Web framework to Chatting interface design contains three parts.The third part corresponds to the text's the fourth chapter, which implements a chat robot based on big data analysis, this part specifically elaborated the realization process of the third chapter's design. Including the realization of corpus collection, corpus preprocessing, problem processing algorithm, LSTM model used in S2S, user friendliness analysis algorithm, corpus classification and LSTM model parameter computing in distributed environment, and implement of chat robot mutual platform.