The Design And Implementation Of PaaS Auto-testing Framework

Since the concept of cloud was born in 2006, it has been indispensable among the internet industry. Famous corporations such as Amazon, Google and Alibaba, have all been building and using their own cloud platform to provider internet service for customers. eBay, trading with various client groups, also decides to have its own cloud while still possess the ability to cooperate with public cloud outside the firm. Frankly speaking, eBay cloud platform is so complicated and highly security-and-reliability-required that the testing work of it turns out to be quite important but difficult. That is why developing an automation testing framework tailored for PaaS Provisioning occurred to us.Based on requirements of eBay PaaS provisioning project, we describe the development background of the testing framework in the first part, including the overall state of testing automation as well as application of REST. This framework consists of five modules, which are System Configuration, Client, TestCase, Framework and Validator. Client module is responsible for invoking resource-and-service-related methods, such as interacting with CMS, the data management system used at eBay. Meanwhile TestCase module includes specific test classes and base classes from which they inherit. Framework and System Configuration offer necessary support for other part of the system. To be specific, Framework contains implementation details as well as utility methods like logging, templates rendering and assertion. Finally, Validator module takes care of checking correctness of model itself along with its consistency with expected results.First we start with the requirements of this framework based on the cloud business logic. On deciding of the system boundary, overall architecture design, detailed module design and implementation of the project follow, with usecase diagrams, class diagrams and implementation codes as illustrations. So far, the framework has been applied to daily testing work of PaaS Provisioning and we are still working on it and improving its functionality and quality.