Automatic detection of moving targets is one of important research area in the remote sensing field. In this paper, we propose a method that accurately detects moving targets in aerial videos using hierarchical spatiotemporal saliency analysis. First, coarse motion regions are extracted by utilizing global temporal saliency analysis. Based on these local candidate regions, spatial saliency methods are used to obtain accurate description of targets. After fusing spatial and temporal saliency values, we can get refined results of the detection. Considering about the inter-frame consistency of motion, trajectory level analysis is added in the proposed method to eliminate false alarms. Experiments conducted on the VIVID dataset validate the effectiveness and efficiency of the proposed method.