Font Size: a A A

Design And Implementation Of Kettle-Based Distributed Sci-Tech Resource Collection And Sharing Platform

Posted on:2018-03-06Degree:MasterType:Thesis
Country:ChinaCandidate:Y A LiFull Text:PDF
GTID:2348330512484585Subject:Computer technology
Abstract/Summary:PDF Full Text Request
For scientific and technological activities,human,financial,material,and corresponding information,organization,management and other software and hardware elements collectively,or a collection of a number of factors,are defined as scientific and technological resources.They provide material support for the development of science and technology,and it is an important strategic guarantee of the country.The allocation of China's scientific and technological resources needs to be challenged by the world,and the sharing of scientific and technological resources will undoubtedly become one of the most efficient and practical ways of allocation.With the Internet infrastructure in China constantly improve and upgrade,the Internet began to accelerate the penetration of traditional areas,how to share the Internet thinking applied to the science and technology resources,become a problem in our country.In recent years,the science and technology resource sharing across government have made innovations,but there are still technical resources scattered,repetition,inefficient,existing technology platform service mode and backward way,such as poor user experience.Therefore,the construction of a unified science and technology resources sharing platform is the urgent requirement for the development of science and technology in China,the only way to improve the technological level of open sharing of resources,with the market mechanism to fully release the science and technology resources,public service,business innovation.This paper analyzes the present situation of the research on the sharing of science and technology resources,points out the key problems existing in the information sharing of science and technology resources in China,and puts forward the feasible solutions.In this paper,the design and implementation of scientific and technological resource sharing platform uses a completely separate development model of the development of the front and rear,through the high-speed service framework to achievemulti application calls and communications.One end of the service interface using java language,the use of the front wave website framework,the overall system is based on the current mainstream Springframework development.The system is mainly divided into two parts to solve the technical resources sharing two problems,one is the data center module,the module of distributed data acquisition of multi database through the open source ETL tool KETTLE,the integration of scientific and technological resources so as to solve the difficult problem;two is sharing portal module,this module mainly realizes the display and search technology resources resources,the collected data into the Solr search engine indexing,so as to realize the display of personalized search and resource sharing portal.The test results show that the system can meet the needs of users.Science and technology resources sharing platform is a development project in my internship in the wave of software companies in the process,the current phase of the project has been completed and used in Chongqing Department of science,it designed for innovation and entrepreneurship in Chongqing to solve the problem of difficult to find resources,resource selection is difficult,difficult to use resources.At this stage,the platform in Chongqing has been integrated into the instrument,equipment,experts,literature,scientific research institutions,research and development and other aspects of the sharing of open resources.Among all the resources,large instruments and equipment are the focus of opening and sharing,including 106 institutions of higher learning,research institutes,enterprises and institutions in Chongqing,and more than 200 thousand yuan of advanced instruments and equipment,3031 units.In the field of documentation,more than 140 Chinese and foreign language databases of 8 institutions,such as universities,enterprises and so on,have been integrated,and they have joined the Wanfang Data,such as China HowNet and national research data center,for nearly 40TB of resources.
Keywords/Search Tags:Resource Sharing, Data Collection, Search Engine
PDF Full Text Request
Related items