In previous researches, the reconstructed residual data in the current frame or in the reference frame are used to predict the residual of the current block. These researches demonstrate that the redundancy still exists in the residual. We propose a new residual prediction scheme for inter coding to further remove the redundancy in the residual encoded by the original framework so that the coding performance can be enhanced. Experimental results show the proposed method achieves an improvement of 4.26% in bitrate saving; meanwhile, the encoding time of proposed method is only increased by 7.95% when compared to HEVC (High Efficiency Video Coding).