| The rise of the mobile market has present higher demands on application quality.To ensure the quality of applications,automated testing tools are widely used in the development stage.The bug reports generated by these tools are important references for developers to understand and fix application bugs.However,existing tools ignore the inconsistency introduced by the multi-device testing,their reports lack insights into bugs,such as bug category information,and also retain duplicate bugs in multiple devices,leading the lack of comprehensive and easy-to-understand bug reports.This thesis proposes a bug report generation technology based on inconsistency analysis,which is used to generate reproducible and easy-to-understand bug reports for automated testing.We first defined the GUI inconsistency and device inconsistency based on multi-device automated testing results,and proposed a structured bug model that can be used for inconsistency analysis.Through the manual review of the real automated testing results of 50 applications on 20 devices,analyzing the relationship between bugs and inconsistencies,confirming the root cause of bugs,and extracting common log patterns of similar bugs,we constructed an extensible bug taxonomy with inconsistency labels,which contains a total of 67 bug categories.Next,we implemented an automated tool called BREGAT to generate structured bugs for multi-device automated testing results,classify and deduplicate bugs via the defined taxonomy.Finally,heterogeneous data in the testing results such as screenshots,test operations,and device logs are combined to generate reproducible and easy-to-understand bug reports.This thesis evaluates the bug classification and deduplication ability of BREGAT through the automated testing results of 30 applications on 20 Android devices.The taxonomy defined in this thesis covers 83% of real bugs,and the classification precision is 86%,which means it can represent real bugs of Android applications.BREGAT removes 97% of duplicate bugs,and the deduplication precision reaches 100%,which is more efficient than existing tools.In the bug reproduction experiment in which 16 developer representatives participated,the reproduction success rate of BREGAT's report is 100%,and the reproduction speed is 17.4 seconds per bug,which is significantly better than the reports generated by the existing technology.The results of the bug report questionnaire show that the BREGAT's report is more readable and can significantly improve the speed and success rate of bug reproduction,especially for device-specific bugs. |
PDF Full Text Request