Multi-Dimensions Of Developer Trustworthiness Assessment In Oss Community

With the vigorous development of the Open Source Software, various software communities have arisen and they attract huge numbers of developers to participate in the development of distributed software. The developers involved in open source communities are often widely dispersed in different regions even different countries across the world, participating in projects peer to peer through the Internet network. For such software development paradigm, how to evaluate the skills and contribution of developers comprehensively and automatically, is critical. Also, the evaluation has always been an enormous challenge for developing an open source software.The paper did deep analysis on evaluation models of traditional software and existing open source software, resulting in finding that current work mainly focus on one certain perspective, which is difficult to calculate developers' comprehensive qualities in diversified development activities. Therefore, the paper developed the existing local evaluation method, which was based on software implementation, into comprehensive evaluation method. In this way, a new evaluation system was built on the platform TRUSTIE, which belongs to National High-tech R&D Program of China. Lastly, the system's effectiveness was validated with the case of real developing teams.Main contributions of the thesis are as follows:(1) A trustworthy evidence framework and an evaluation model for open source developers are built. The contribution is evaluated by four targets, from not only the software implementation level but also the social cooperation point, including coordination level, technical competence, social influence and contribution degree.(2) A multi-dimensional evaluation system is realized based on the TRUSTIE platform. It collects evidence from software version management tools, the defect repository and community tools, then evaluates developers automatically and comprehensively.(3) By taking the true case of software projects on the TRUSTIE platform, the feasibility and rationality are confirmed.