Median filtering has received extensive attention from forensics analyzers, as a common content-preserving, smoothing, and denoising manipulation. We propose a detection scheme for median filtering of video sequences in compressed domain based on the singular value decomposition of the process matrix, which approximates the median filtering. Projection over some of the eigenspaces of the process matrix gives a set of features of small dimension, even as small as three, making the proposed scheme a fast and suitable detector for video median filtering. The experimental evaluations show that the proposed method outperforms the state-of-the-art detectors of median filtering, and its edge becomes significant for localized detection over small blocks within frames. The new method can potentially be used as a detector of other editing processes.