Font Size: a A A

Research And Application On Intelligent Computing

Posted on:2011-06-08Degree:DoctorType:Dissertation
Country:ChinaCandidate:B YangFull Text:PDF
GTID:1118360305453599Subject:Computer software and theory
Abstract/Summary:PDF Full Text Request
Research and Application on Intelligent ComputingIntelligent computing is that people affected by natural (biosphere) law of enlightenment, according to whose principle, copy the problem solving algorithm, through study, self-organization, etc. to synthesize,inductive or reason the Information, in order to establish the mathematical model of symbolism, connectionist or behaviorism. The use of intelligent computing to achieve intelligent information processing is quite different from the traditional information processing. It is a novel "soft computing" approach. Intelligent computing technology is a cross-disciplinary involving physics, mathematics, physiology, psychology, neuroscience, computer science and intelligent technology. As the second-generation artificial intelligence methods, Intelligent computing methods include neural networks, evolutionary, genetic, immune, ecology, artificial life and the subject theory, which have a wide range of applications in multi-disciplinary fields, not only providing new scientific logic and research methods for artificial intelligence and cognitive science, but also providing an effective way processing technology for the information science. Carrying out intelligent computing In-depth research has important theoretical significance and application prospects.In this paper, the author studied the theory of intelligent computing and applications.Based on statistical learning theory and structural risk minimization principle, Vapnik and his collaborators established a support vector machine theory, which was introduced into the field of machine learning at the meeting of calculation learning theory in 1992. Compared with the traditional machine learning methods, support vector machine has the strong generalization ability in the learning of small samples, and there is no local minimum problem. SVM was originally proposed for the pattern recognition problem. However, with the introduction of s-insensitive loss function by Vapnik, SVM was applied to nonlinear regression and curve fitting, as well as obtained support vector machine regression method, which also demonstrated a very good learning effect.But the standard support vector machine training algorithm ultimately comes down to solving a linear inequality constrained quadratic programming problem. As for the case of large-scale data samples, quadratic programming consumes the large resource in time and space, which limits the application of the support vector machines for large-scale data sample size problem, In particular, for the regression problem, the the number of unknown variables in corresponding quadratic programming problem is 2n+1 (n is the number of data samples), as opposed to the classification problem, which has doubled the amount of the unknown and more to increase large-scale data sample problem solving difficulty.Suykens, and others made the least squares support vector machine, which skillfully transferred the standard SVM, the inequality constraints into equality constraints. It will make quadratic programming problem converted into solving the problem of linear equations, which greatly reduces the difficulty of learning SVM and improves the training speed. But in the least squares support vector machines, almost every training sample is a support vector, which have lost the advantage of the sparseness of SVM solution. For the shortcoming of least squares support vector machines, this paper combines the incremental learning algorithm and the decremental learning algorithm, proposes the adaptive and iterative least squares support vector machine regression algorithm and gives a matrix reduced-order inversion proof. By default learning precision and the size of training data, this algorithm can adaptively determine the number of support vectors, which is a good solution to their shortcoming of the least-squares support vector machine regression under sparse nature, while greatly enhanced its learning speed.Swarm intelligence algorithm is another important research area of intelligent computing, which originated in the study of artificial life. The concept of swarm intelligence was first proposed by Beni, Hackwood, and Wang at the molecular automata system. However, until E Bonabeau and M Dorigo popularized the concept can it obtains a rapid development. In the context of the non-focused and not providing the global model, swarm Intelligence provides the basis to find solutions to complex distributed problems.Ant colony algorithm is a kind of swarm intelligence algorithm, which is inspired by the foraging behavior of real ant colony. Its biological basis is that ants will leave the pheromones through a path, as time goes by, which will gradually disappear. In sports, ants can be aware of the existence and the concentration of the substance, and tend to mobile to the areas with high concentrations of pheromone, that is, the probability of selecting the path is proportional to the concentration of pheromone in the path. The higher the pheromone concentration in the path, the more ants there are, then the concentration of pheromone left on the path are higher, which have formed a positive feedback mechanism. Through it, ants can finally find the best path, and most of the ants will take this path.But the basic ant colony algorithm has deficiencies, which is that the algorithm running time is very long. On the one hand, this is due to the complexity of algorithm computation. On the other hand, at the initial stage of the algorithm, the pheromones on the paths are not much different and the search of the randomness is high. Until after several iterations, a better advantage of the pheromone on the path can be reflected, so that the initial algorithm consumes a lot of running time. In addition, the positive feedback mechanism of the ant colony algorithm would lead to a path of a high concentration of pheromone, so that all the ants concentrated to this path, while the algorithms converge to local optimal solution prematurely. This paper improved the shortage of the basic ant colony algorithms. The first is the dynamic adjustment of the size of the group. At the early stage of the algorithm's running, the group which maintained a larger scale will help to ensure the multidimensionality of initial feasible solution and avoid premature convergence of algorithm. However, at the late stage of the algorithm's running, in the search towards the optimal solution, too large population size leads to the waste of time. Therefore, the dynamic adjustment of ant colony size is useful to improving the operational efficiency of the algorithm. The second is to establish candidate collection for each individual node, choose the nearest candidate to join a number of nodes in the node set, reduce the computation and improve the operating efficiency. The third is the adoption of optimization-based sorting pheromone update strategy. It only selects part of ants with the best quality solution to update pheromone on their path, which reduces the interference of the poor solution in the search and increases speed. Meanwhile, in order to avoid excessive or pheromones tending to zero by volatile, it sets up on the maximum and minimum threshold for the pheromone on the path. The fourth introduces random transition probabilities to control and make good use of existing good search paths and search for new high-tech prime interest rate the relative importance of the concentration of the path. The 5th simulates individual differences of real ant colony, so that individuals have different routing capabilities. The 6th, adaptive adjustment of the information heuristic factors a and expectations of the heuristic factorβ, as the search progresses, have a gradual increase in value of the parameter to increase the positive feedback. At last, the genetic algorithm crossover and mutation operators to improve the algorithm's global search capabilities.The paper applied an improved ant colony algorithm in the combinatorial optimization in one-dimensional cutting stock problem. Through experiments, optimizing the algorithm parameters, the simulation results verify the algorithm for solving one-dimensional cutting stock problem of good performance.Content-based music retrieval has developed into a research hotspot in recent years. Since the original audio data is a non semantic notation and unstructured binary stream, besides containing the sampling frequency, quantization precision, encoding these limited registration information, the lack of semantic descriptions of the content and structure of the organization, all have brought great difficulties to the depth of processing and analysis of the audio data. This article has applied intelligent computing technology into the problem, and achieved good results. It put forward for the human voice detection method of short time frame based on unsupervised clustering and support vector machine classification, as well as used the results of clustering support vector machines to select the training samples to reduce the size of training samples and improve the learning speed. At the same time using the proposed adaptive and iterative least squares support vector machine regression algorithm realized the classification of regression. Such combination of voice detection algorithm has been applied to the extraction of human voice fragments and achieved good results. The use of fuzzy clustering to extract the audio clips of cluster centroid as the music features achieved a Query by Humming. The introduction of intelligent methods improves the performance of the prototype system.
Keywords/Search Tags:Intelligent Computing, Least Square Support Vector Machine Regression, Ant Colony Algorithm, Fuzzy Clustering, Music Retrival Based on Content
PDF Full Text Request
Related items