Public safety has became an important issue in recent years. Developing smart systems to detect abnormal crowd behavior is crucial to intervene the situation as soon as possible. In this work, we propose a novel algorithm based on Coarse to Fine Optical Flow and Influence Map.