Abstract
This study proposes an intelligent algorithm with tri-state architecture for real-time car body extraction and color classification. The algorithm is capable of managing both the difficulties of viewpoint and light reflection. Because the influence of light reflection is significantly different on bright, dark, and colored cars, three different strategies are designed for various color categories to acquire a more intact car body. A SARM (Separating and Re-Merging) algorithm is proposed to separate the car body and the background, and recover the entire car body more completely. A robust selection algorithm is also performed to determine the correct color category and car body. Then, the color type of the vehicle is decided only by the pixels in the extracted car body. The experimental results show that the tri-state method can extract almost 90% of car body pixels from a car image. Over 98% of car images are distinguished correctly in their categories, and the average accuracy of the 10-color-type classification is higher than 93%. Furthermore, the computation load of the proposed method is light; therefore it is applicable for real-time systems.
Similar content being viewed by others
References
Al Aghbari Z, Al-Haj R (2006) Hill-manipulation: an effective algorithm for color image segmentation. Image Vis Comput 24(8):894–903
Baek N, Park S-M, Kim K-J, Park S-B (2007) Vehicle color classification based on the support vector machine method. Commun Comput Info Sci 2(24):1133–1139
Brown LM (2010) Example-based color vehicle retrieval for surveillance. International Conference on Advanced Video and Signal Based Surveillance 91–96
Butzke M, Silva AG, Hounsell MS, Pillon MA (2008) Automatic recognition of vehicle attributes – color classification and logo segmentation. HIFEN 32(62)
Chang C-C, Lin C-J (2001) Training nu-support vector classifiers: theory and algorithms. Neural Comput 13(9):2119–2147
Chen B, Lei Y, Li W (2004) A novel background model for real-time vehicle detection. Int Conf Signal Proces 2:1276–1279
Chen Z-Z, Pears N, Freeman M, Austin J (2009) Road vehicle classification using support vector machines. IEEE International conference on Intelligent Computing and Intelligent Systems. 214–218
Colormap by MathWorks, http://www.mathworks.com/help/techdoc/ref/colormap.html
Dataset and implementation of the tri-state system: http://www.cs.nctu.edu.tw/~hcku/
Elgammal A, Harwood D, Davis L (2000) Non-parametric Model for Background Subtraction,” 6th European Conference on Computer Vision, Lecture Notes in Computer Science 1843:751–767
Finlayson GD, Schaefer G (2001) Solving for color constancy using a constrained dischromatic reflection model. Int J Comput Vis 42(3):127–144
Haralick RM, Shapiro LG (1992) Computer and robot vision, Volume I, Addison-Wesley, pp 28–48
Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31(3):316–323
Kim K-J, Park S-M, Choi Y-J (2008) Deciding the Number of Color Histogram Bins for Vehicle Color Recognition. IEEE Asia-Pacific Services Computing Conference 134–138
Kim S, Park S, Kim M (2003) Central object extraction for object-based image retrieval. International Conference on Image and Video Retrieval pp 39–49
Li X, Zhang G, Fang J, Wu J, Cui Z (2010) Vehicle color recognition using vector matching of template. Proc. of International Symposium on Electronic Commerce and Security 189–193
Lin S, Li Y, Kang SB, Tong X, Shum HY (2002) Diffuse-specular Separation and Depth Recovery from Image Sequences. Proc. of Europe Conference of Computer Vision 210–224
Ohashi T, Aghbari Z, Makinouchi A (2003) Hill-climbing algorithm for efficient color-based image segmentation. IASTED International Conference on Signal Processing, Pattern Recognition, and Applications 17–22
Santos D, Correia PL (2009) Car recognition based on back lights and rear view features. Workshop on Image Analysis for Multimedia Interactive Services. 137–140
Shih FY, Cheng S (2005) Automatic seeded region growing for color image segmentation. Image Vis Comput 23:877–886
Son J-W, Park S-B, Kim K-J (2007) A convolution kernel method for color recognition. International Conference on Advanced Language Processing and Web Information Technology 242–247
Sural S, Zian G, Pramanik S (2002) Segmentation and histogram generation using the HSV color space for image retrieval. Int Conf Image Proces 2:589–592
Tan RT, Ikeuchi K (2003) Separating reflection components of textured surfaces using a single image. IEEE Int Conf Comput Vis 2:870–877
Theodoridis S, Koutroumbas K (2008) Pattern recognition 4th edn. Academic Press, ISBN: 1597492728, pp 119–128
Wu Y-T, Kao J-H, Shih M-Y (2010) A vehicle color classification method for video surveillance system concerning model-based background subtraction. Advances in Multimedia Information Processing – PCM Lecture Notes in Computer Science 6297:369–380
Xu Z, Cao J (2009) Vehicle color extraction based on first sight window. IEEE International Conference on Information Science and Engineering 1503–1506
Zhang DS, Lu G (2001) Segmentation of moving objects in image sequence: a review. Circuits Syst Signal Process 20(2):143–183
Acknowledgements
This work was partially supported by National Science Council grant NSC98-2221-E-009-091-MY3: Multiview multimedia content analysis, indexing and query
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gu, HZ., Lee, SY. A view-invariant and anti-reflection algorithm for car body extraction and color classification. Multimed Tools Appl 65, 387–418 (2013). https://doi.org/10.1007/s11042-012-0996-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-0996-1