Research On Ensemble Learning Algorithm

Ensemble learning is a new machine learning paradigm. It can significantly improve the generalization ability of learning systems through utilizing multiple learners to solve a problem. Therefore the research on its theory and algorithm becomes a hot topic in the field of machine learning since the beginning of 1990s. Now ensemble learning has successfully applied in many fields, such as planet exploration, seismic wave analysis, Web information filtering, biology feature recognition, and computer aided medical diagnoses.However, ensemble learning technique is not mature, and there exists many problems unsolved on its research. Considering its applications, Ensemble learning still far fall short of the level people expect.This paper goes deep into ensemble learning. It briefly introduces the concept, structure and functions of ensemble learning, analyzes thetwo representative algorithm families------Boosting & Bagging, andexpounds the basic idea of selective ensemble learning. On the discussion of ensemble learning's shortcoming, corresponding resolvents based on swarm intelligence and cloud model are proposed. The main work of this paper are summarized as follows:...