Abstract
Rodent monitoring in biomedical laboratories is a time consuming and tedious task. Several automatic solutions that rely on different types of sensors have been proposed. Computer vision provides a significantly more universal and less intrusive solution. In this article we propose a new method to detect and classify three behaviors in rodents: exploring, rearing, and static. The method uses motion history images and a multiple classifier system to detect the three behaviors under typical laboratory conditions. It is independent of the color of the rodent and of the background. The method performs equally well on short and long video sequences, achieving a success rate of 87 %.
Similar content being viewed by others
References
Rats and Research. (February 2013) [online]. Available at: http://www.chrcrm.org/en/rats-and-research
Ishii, H., Ogura, M., Kurisu, S., Komura, A., Takanishi, A., Iida, N., Kimura, H.: Development of autonomous experimental setup for behavior analysis of rats. Intell. Robots Syst. 4152–4157 (2007)
Amano, S., Yokovama, M., Torri, R., tanaka, K., Ihara, N.: High performance seizure-monitoring system using a vibration sensor and videotape recording: behavioral analysis of genetically epileptic rats. Lab. Anim. Sci. 47(3), 317–320 (1997)
IntelliCage for rats. (February 2013) [online]. Available at: http://www.newbehavior.com/products/icr
Rudenko, O., Tkach, V., Berezin, V., Bock, E.: Detection of early behavioral markers of Huntington’s disease in R6/2 mice employing an automated social home cage. Behav. Brain Res. 203(2), 188–199 (2009)
Gibbs, S., et al.: Long-term consequences of a prolonged febrile seizure in a dual pathology model. Neurobiol. Dis. 43(2), 312–321 (2011)
Belongie, S., Branson, K., Dollar, P., Rabaud, V.: Monitoring animal behavior in the smart vivarium. Meas. Behav. 70–72 (2005)
Nie, Y., Ishii, I., Yamamoto, K., Takaki, T., Orito, K., Matsuda, H.: High-speed video analysis of laboratory rats behaviors in forced swim test. Autom. Sci. Eng. 206–211, (2008)
Nie, Y., Takaki, T., Ishii, I., Matsuda, H.: Behavior recognition in laboratory Mice using HFR video analysis. In: Proceeding of the IEEE International Conference on Robotics and Automation, pp. 1595–1600, (2011)
Nie, Y., Ishii, I., Yamamoto, K., Orito, K., Matsuda, H.: Real-time scratching behavior quantification system for laboratory mice using high-speed vision. J. Real-time Image Process. 4, 181–190 (2009)
Dollar, P., Raboud, V., Cottrell, G., Belongie, S.: Behavior recognition via sparse spatio-temporal features. VS-PETS 65–72 (2005)
Jhuang, H., Garrote, E., Yu, X., Khilnani, V., Poggio, T., Steele, A., Serre, T.: Automated home-cage behavioural phenotyping of mice. Nat. Commun. 6, 1–9 (2010)
Wilks, S.L., Wolf, W., Liang, Y., Kobla, V., Bais, X., Zhang, Y., Crnic, L. S.: Unified system and method for animal behavior characterization from top view using video analysis, U.S. Patent 7 643 655 (2004)
Liang, Y., Kobla, V., Bais, X., Zhang, Y.: Unified system and method for animal characterization in home cages using video analysis, U.S. Patent 7 209 588, (2007)
Home Cage Environment. (February 2013) [online]. http://cleversysinc.com/products/hardware/home-cage-environment
Yau, W., Kumar, D., Arjunan, S., Kumar, S.: Visual speech recognition using image moments and multiresolution wavelet. Comput. Graphics Imaging Vis. pp. 194–199 (2006)
Ahad, MdAR, Tan, J.K., Kim, H., Ishikawa, S.: Motion history Image: its variants and applications. Mach. Vision Appl. 23(2), 255–281 (2012)
Bobick, A., Davis, J.: Real-time recognition of activity using temporal templates. WACV, 38–42 (1996)
Hu, M.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179–187 (1962)
Therrien, C.: Decision Estimation and Classification. Wiley, New York (1989)
Bobick, A., Davis, J.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)
Ahad, Md.A.R., Tan, J.K., Kim, H., Ishikawa, S.: Action Recognition by Employing Combined Directional Motion History and Energy Images. Computer Vision and Pattern Recognition Workshops, 73–78 (2010)
Farah, R., Langlois, J.M.P., Bilodeau, G.A.: Catching a Rat by its edglet. IEEE Trans. Image Process. 22(2), 668–678 (2013)
Rahman, A.F.R., Fairhurst, M.C.: Multiple classifier decision combination strategies for character recognition: a review. Int. J. Doc. Anal. Recognit. (IJDAR) 5, 166–194 (2006)
Menahem, E., Rokach, L., Elovici, Y.: Troika - An improved stacking schema for classification tasks. Inf. Sci. 179(24), 4097–4122 (2009)
Kuncheva, L.I., Bezdek, J.C., Duin, R.P.W.: Decision Templates for multiple classier fusion: an experimental comparison. Pattern Recognit. 34, 299–314 (2001)
Xing, H.J., Ha, M.H., Hu, B.G., Tian, D.Z.: Linear feature-weighted support vector machine. Fuzzy Inf. Eng. 1(3), 289–305 (2012)
Zhang, C.X., Duin, R.P.W.: An experimental study of one- and two-level classifier fusion for different sample size. Patter Recognit. Lett. 32, 1756–1767 (2011)
Duin, R.P.W., Tax, D.M.J.: Experiments with classifiers combination rules. In: Kittler, J., Roli, F. (eds.) MCS, Lecture Notes in Computer Science, vol. 1857, pp. 16–29. Springer, berlin (2000)
Dallal, N., Triggs, B.: Histograms of oriented gradients for human detection. CVPR. 886–893 (2005)
Support Vector Machines. (2013 February) [online]. Available at: http://opencv.willowgarage.com/documentation/cpp/support_vector_machines.html
Jhuang, H., Garrote, E., Poggio, T., Steele, A.D., Serre, T.: Vision-based automated recognition of mice home-cage behaviors. Visual observation and analysis of animal and insect behavior, ICPR (2010)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is funded by CRSNG (Conseil de recherche en science naturelles et en génie du Canada) and the FQRNT (The fonds de recherche du Québec—Nature et technologies).
Rights and permissions
About this article
Cite this article
Farah, R., Langlois, J.M.P. & Bilodeau, GA. Computing a rodent’s diary. SIViP 10, 567–574 (2016). https://doi.org/10.1007/s11760-015-0776-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0776-2