A detection algorithm with color information for two dynamic images in a real surveillance system is proposed. It considers input region of frame as a detected region or the region behind other objects based on fuzzy corresponding map which describes common regions between input two dynamic images. Detection experimental results for the real surveillance situation show that the proposed algorithm improves 30% of accuracy compared with the independent detection algorithm. The algorithm will be installed in a basis unit for the real surveillance systems.