Face verification and face identification are two main applications for face recognition. Based on the face representation which they use, the current image-based face recognition techniques can be roughly classified into two groups: appearance-based methods and model-based methods. The method presented in this paper focuses on applying model-based methods to face verification. Unfortunately, the existing current model-based schemes are used for the applications of face identification and are not suitable for face verification. A novel scheme, which is custom-built for face verification applications, is therefore proposed in this paper. Active appearance model, a 2D morphable face model, is chosen and applied to realize the proposed scheme.