Design And Implementation Of Natural Language Processing Platform Software

Search engine, artificial intelligence has affected people’s lives in all aspects, and natural language processing is the core of search engines and artificial intelligence. However, there are many problems in the process of using natural language algorithm, such as the use of natural language processing algorithm is complex and the call of the related algorithms can only be loaded by the local static link mode, which causes the system to be inefficient for the natural language processing. A natural language platform is proposed to solve the above problems, which is based on the actual project of enterprise. The main contents of the paper are as follows:Firstly, four different computing architectures are designed for the computing service of natural language processing under different scenarios. Four computing architectures are as follows:Ordinary stream computing architecture is suitable for general fast services; Online computing architecture is suitable for online services which are extremely demanding for the delay; Large scale offline architecture is suitable for the high throughput offline computing services; Local computing architecture is suitable for the algorithm using less resources but relatively high access.Secondly, the interface of the natural language processing service invocation is designed. This interface encapsulates the service call for four architectures, shielding the differences of access between the four architectures, providing users with a simple and efficient natural language processing service; the platform provides the users with two programming interfaces for C++ and python, and the access mode of HTTPFinally, the development of natural language processing platform software is accomplished by using zookeeper, inotify and RPC technology.The actual operation of the system shows that the function of the system meets the design requirements. The system performance is superior in load balance, fault recovery, traffic control and statistics. The system has made a good effect.