Research On Multi-level Hierarchical And Interactive MDP

Public safety is an important cornerstone of national security involving the majorissues like major national infrastructure, natural disasters and social security, etc. BecauseChina is in a period of social and economic transformation, public emergencies upwardpeak momentum which do serious harm to China’s economic development and socialstability. The emergency decision-making is the key to cope and deal with emergencies asthe major issues of emergency management.From the viewpoint of the emergency decision-making in the organization, Amulti-level hierarchical Markov decision model on emergency decision has been built inthe dissertation. The emergency decision-making is a multi-stage and dynamicdecision-making process, so the emergency dynamic decision-making process shouldreflect the hierarchy and coordination of decision-making. The hierarchy and coordinationof decision-making is one of the important scientific questions that need to be addressedby the theoretical study of the emergency decision. The emergency decision involvesmulti-sectoral, multi-level and collaborative decision-making. This includes two parts:hierarchical decision between departments of different levels; collaboration between thesectors on the same level. Organization has the characteristic of hierarchy because oforganization’s inherent hierarchy. Decision-makings at all levels affect each other. Thispaper established a multi-level hierarchical Markov decision process model. The modeltakes the interaction of the different levels of Agent into account. The model usesbackward induction to solve the optimization problem of limited-stage decision, given thedetailed algorithm combined with modeling and solving a practical example. On this basis,the dissertation further explores the multi-level hierarchical interactive decision model inthe case of game theory. Agent at upper level gives a certain proportion incentive rewardto the Agent at lower level. This proportion directly affects the lower level’s the optimalstrategy. The paper has given the result that how game strategy changes with theproportion parameter with examples. The experimental results show that the model is avery effective and practical level decision problem solving.In this dissertation, the characteristics of the emergency decision, emergencydecision-making hierarchy and dynamic combination provides a new modeling method forthe level of decision-making in a dynamic environment, uncertainty, certain references toresearch theories and methods for emergency decision.