A model-based methodology for the evaluation of computerized group decision-making

Increased global competition is forcing organizations to increase their use of group decision making today. Computerized group decision support aids (CGDSAs) are being developed to improve the efficiency of these groups and to improve decision quality. Even though the use of CGDSAs has increased, very little research has been done on the evaluation of CGDSAs. The purpose of this research was to develop a model-based generalized methodology for CGDSA evaluation from the user's perspective.; Two models were developed as a foundation for the CGDSA evaluation methodology. The first model was a model of group decision making and the second model was a model of computer-aided group decision making. The group decision making model was based upon a basic input-output model with the problem as the input and the selected alternative as the output. Analogous to how problems are viewed in terms of classical design of experiments, independent variables affect the outcome (problem solution—the dependent variable) of the decision making process. As in design of experiments, independent variables are either noise variables or control variables. In the model presented, the independent variables are further divided into four categories (internal, external, process, and problem) in the group decision making model as a way to help develop an exhaustive list of independent variables affecting the decision making process.; The generalized methodology for CGDSA evaluation mapped directly to the computer-aided group decision making model. Solution quality is measured directly or by measuring independent variables that have been previously been correlated to solution quality using standard design of experiment techniques.; The generalized methodology for CGDSA evaluation was applied to the assessment of ConsensusBuilder, an example of a CGDSA. As prescribed by the CGDSA evaluation methodology, usability was also assessed and practical use considerations were followed when designing the evaluation. The value of the ConsensusBuilder evaluation for this research was that it was possible to perform a thorough evaluation of ConsensusBuilder, a CGDSA, using the CGDSA Evaluation Methodology developed in this research. In addition to the ConsensusBuilder evaluation, six different CGDSA evaluations cited in the literature were assessed in terms of the CGDSA evaluation methodology.