This paper proposes a near-duplicate video clustering method based on temporal gradient pattern (TGP). Most related work that extract feature from video ignored temporal changes of video. To solve this problem we propose feature extraction method that used temporal changes of video that is the most important feature at video. Temporal gradient pattern is extracted from a shot video and patterned by temporal changes of frames within a shot video. We proposed the method that can cluster near-duplicate video effectively and quickly using the temporal gradient pattern. Experiments have performed for speed, feature extraction and video clustering evaluation. Proposed method shows good performance to represent videos using proposed feature extraction method, clustering method can obtain good performance and speed also is good.