Research And Implementation Of TELNET Universal Data Collection System

Internet era has come, in the wider use of the Internet today, adding tothe tens of thousands of network equipment and computing networks, itbring us a great convenience for our work and life. However, networkequipment to enable these networks become increasingly large and complex.We need effective management skills to achieve the best effect. Networkmanagement platform built so that the network environment for real-timemonitoring and management of equipment as possible, have access to timelyinformation on the network and avoid network equipment failures. DataCollection is the basis for the network management platform,which will playa decisive role. Compared to the past, today's data collection has becomemore complicated than before, which needs an effective strategy for datacollection, Information collected in the form of timely data needs to besubmitted to the upper of the network management system, and ensure theefficient collection and reliability; On the other hand, because of theincreasingdiversityofnetworkequipmenttypes, manufacturers,notthesametype of equipment and other factors, we need a common data collectionsystem for collection of such equipment in order to enhance the versatilityandexpandabilitycollectionsystem.This paper shows the Design and Implementation of TELNET UniversalData Collection System,and tries to improve generic, efficiency andscalability of TELNET data collection through the common method of datacollectionsuchascustomizedrules,multithreadinganddesignpatterns.TELNET data collection is base on TELNET protocol,which processesto gain the corresponding information by downloading the remote terminalequipment.TELNET data collection process probably can be divided into thefollowing three : First, Download the remote terminal equipment throughTelnet; Then send different directions based on different equipment in orderto gain the different text information, then use the information for theselective collection and analysis; Finally, the information will be stored andtransmitted,thuswhichcancompletetheentireprocessofdatacollection.Multithreadingtechnologyin the current data collection system has wideapplication. In the process of collecting data, we will encounter a number oftasks simultaneously work. For example, during the data collection forreal-time data display, the use of thread programming, The cycle needs to bedata collection and display data can be set until after data showed the cycleagain. Multithreading and the application of these tasks can be divided intotwo threads, a thread can be real-time data collection, Another thread isreal-time, combining the two threads together complete data collection,real-time display; Another important aspect of multithreading operatingprocedures to expand the concept of a multi-task, a number of tasks can becollectedsimultaneously. This datacollection process control is ameaningfulone.Therefore,datacollectionapplication uses multithreadingwidely. Inthispaper, multi-thread controls the implementation of data collection task, theimplementation of various tasks in different threads have Noninterferencewitheachtaskinthecollection.This paper uses a rule-based dynamic customized data collectionmethods, this method is characterized by the rules controlling the collectionprocess, classified data structure, data manipulation and data transmission.The processing System of Network Data Collection based on rules Packagesrules to use network data collection and processing logic. It's easyto expressawiderangeofnetworkdatacollectionmethodsandprocessingrequirements.Meanwhile systems have greater flexibility and efficiency, achieving thebusiness logic and process of separation The network equipment, networkadministrators can be different rules for collecting and transmitting thecorrespondingallocationrules,Customizationsodifferentcollectiontask.After Data Collection System based on TELNET gains the original data,it will findthe collection corresponds to a concentration of the rules ,then theparser of the rules will collect it from the set of the rules for analysis ,toformat it into general rule to use, Data Collection Parser package with acommon analytical data collection process. Under different rules, the datacollection modules can be out of different analytical results. Collection ofdata in different data formats need to send to different database tables, whichneeds the control of the transmitted rules. transmitted interpreter explainedthe corresponding transmitted rules and Common rules,then transmittingcontroller transmits the format data into the database custommed by rules.How to design transmittingrules depend on the actual need. The transmittingrules service for the transmitting controller, in general, the transmittingcontroller has adapt well to different database tables used. This means thedata colleted need to be recombinated and formatted into the stored form weneed,then send it to the database. The store - and- transmit data collectionrealizes data organization, separate data collection systems from networkdatabase platform.The data collection system is more independent, can beeasilyembeddedinothernetworkmanagementplatformtoachievereuse.Design patterns in data collection software development play a veryimportant role. In order to improve the reusability and extensibility, we canuse a design model Universal design pattern in the data collection softwaredesign and development in appropriate circumstances,and design pattern willplay a certain role. Two models were used to design this one is Singletaonmode,AnotherisStrategymodel.Design and implement TELNET Universal Data Collection System thatcontains customizeing tasks, task management, text analysis, collection andstore - and-transmit functions.The interface of customiziontasks can read theconfiguration file to be initialized.The Administrator can acommplish thecustomizion of tasks by the interface; Collection centers task Manager incollection center realizes that the unified management of the task,whichimproves the efficiency of the collection; Collector is a multi-threadsynchronization data collection and implemented through collaboration withthe text parser modules; configuration management through the realization ofa set of rules and the initialization information management interfaceprovidestheconvenientforthenetworkadministrator.This paper provides very high flexibility of TELNET data collection.Most of the variable information can be preservated into the configurationfile.It's onlyneed to change the rules and the initialization information in thefile,not need to modify the codes. By customizating the collecting andtransmitting rules, it can be easy for the vast majority of network equipmentfor data collection. As the system of data exchange with other systemsthrough database, so The collection system can be easily embedded in othernetworkmanagementplatform,andusedbyothernetworkmanagement.