Freckles is a facial feature of human, it has many significant applications in many video surveillance area. This paper proposes to use deep learning method to perform freckles detection and recognition in face images. To be more specific, a freckle recognition model is proposed in this paper based on convolution neural network. Experimental results are presented to show that the proposed approach is able to achieve 98% accuracy freckle recognition rate.