Hierarchical Markov decision process based on DEVS formalism | IEEE Conference Publication | IEEE Xplore