In this paper, a region-based moving object detection based on hu moments is concerned. Firstly, the feasibility analysis of hu moments in moving object detection is performed. Then a model of hu moments in moving object detection is presented and the performances are evaluated. The experiment results show that the hu moments can eliminate the large amount of noise caused by traditional Single Gaussian Model, and the hu moments with Single Gaussian Model work better than Gaussian Mixture Model.