Test Design And Implementation Of Big Data ETL Tools

With the development of the Internet, the data for a firm's strategic layout and business development plays a more and more important role. Data extraction transformation and loading is a key link in the process of data warehouse, also has important influence on data warehouse and data quality. The Internet companies to ETL tools research has become more and more active. On this background, the characteristics of the research and development of a suitable for their business data ETL tools become a priority for many companies. DT Data Management Platform is a company independent research and development of the internal use of the ETL tool, DT is short for 'Data Team'. This paper combining theory and techniques of software testing and agile development best practices, analyzing the requirement of DT Data Management Platform, designs functional testing and non- functional testing; Through a series of tests,ensures that the DT Data Management Platform has high efficiency and high quality.Firstly, This paper introduces the background of DT Data Management Platform,the main content of the subject and what tasks I undertake; secondly, introduces the software testing theory and technology; thirdly, based on the DT Data Management Platform requirement analysis, determines the functional requirements, non-functional testing requirements and test automation requirements; Finally, to develops test cases according to the test case design methods, mainly completed the function test, stress test, compatibility test and automated test coverage and code of continuous integration,and through the error management tool to manage the problems found, continuously follow up, problem solving, push the project forward.In this paper, through the test of DT Data Management Platform, proved the usability of the software testing can not only guarantee the software with high quality,and through the project development process, the tester's testing and continuous integration of code, improve the development efficiency of the whole project.