Skip to main content

Advertisement

Log in

Monitoring of Medication Intake Using a Camera System

  • Original Paper
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

This paper presents a computer vision system for monitoring medication intake in the context of home care services. We use a method based on color and shape to detect the body parts and the medication bottles. Color is used for skin detection, and the shape is used to distinguish the face from the hands and to differentiate bottles of medicine. To track these objects, we use a method based on color histograms, Hu moments, and edges. For the recognition of medication intake, we use a Petri network and event recognition. Our method has an accuracy of more than 75% and allows the detection of the medication intake in various scenarios where the user is cooperative.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ammouri, S., and Bilodeau, G. A., Face and hands detection and tracking applied to the monitoring of medication intake. In: CRV ’08: Canadian Conference on Computer and Robot Vision, 2008. pp. 147–154, 2008.

  2. Batz, D., Batz, M., da Vitoria Lobo, N., and Shah, M., A computer vision system for monitoring medication intake. In: Proceedings of the 2nd Canadian Conference on Computer and Robot Vision, 2005. pp. 362–369, 2005.

  3. Birchfield, S., Elliptical head tracking using intensity gradients and color histograms. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp. 232–237, 1998.

  4. Canny, J., A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6):679–698, 1986.

    Article  Google Scholar 

  5. Cha, S. H., and Srihari, S. N., On measuring the distance between histograms. Pattern Recogn. 35(6):1355–1370, 2002.

    Article  MATH  Google Scholar 

  6. Choksuriwong, A., Emile, B., Laurent, H., and Rosenberger, C., Comparative study of global invariant descriptors for object recognition. J. Electron. Imaging 17(2):1–35, 2008.

    Article  Google Scholar 

  7. Comaniciu, D., Ramesh, V., and Meer, P., Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5):564–577, 2003.

    Article  Google Scholar 

  8. Fuentes, L. M., and Velastin, S. A., People tracking in surveillance applications. Image Vis. Comput. 24(11):1165–1171, 2006.

    Article  Google Scholar 

  9. Gabriel, P., Verly, J., Piater, J., and Genon, A., The state of the art in multiple object tracking under occlusion in video sequences. In: Proceedings of ACIVS. pp. 377–380, 2003.

  10. Ghanem, N., DeMenthon, D., Doermann, D., and Davis, L., Representation and recognition of events in surveillance video using petri nets. In: Computer Vision and Pattern Recognition Workshop. Vol. 7, p. 112, 2004.

  11. Habili, N., Lim, C. C., and Moini, A., Hand and face segmentation using motion and color cues in digital image sequences. In: IEEE International Conference on Multimedia and Expo. pp. 377–380, 2001.

  12. Hongeng, S., Nevatia, R., and Bremond, F., Video-based event recognition: activity representation and probabilistic recognition methods. Comput. Vis. Image Underst. 96(2):129–162, special Issue on Event Detection in Video, 2004

    Article  Google Scholar 

  13. Isard, M., and Blake, A., Condensation—conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1):5–28, 1998.

    Article  Google Scholar 

  14. Jacquot, A., Sturm, P., and Ruch, O., Adaptive tracking of non-rigid objects based on color histograms and automatic parameter selection. In: WACV/MOTIONS ’05 Vol. 2: IEEE Workshop on Motion and Video Computing, 2005. Vol. 2, pp. 103–109, 2005.

  15. Kakumanu, P., Makrogiannis, S., and Bourbakis, N., A survey of skin-color modeling and detection methods. Pattern Recogn. 40(3):1106–1122, 2007.

    Article  MATH  Google Scholar 

  16. Lanz, O., Approximate bayesian multibody tracking. IEEE Trans. Pattern Anal. Mach. Intell. 28(9):1436–1449, 2006.

    Article  Google Scholar 

  17. Lemieux, A., and Parizeau, M., Experiments on eigenfaces robustness. In: Proceedings of the 16th International Conference on Pattern Recognition, 2002. Vol. 1, pp. 421–424, 2002.

  18. Peterson, J. L., Petri nets. ACM Comput. Surv. 9(3):223–252, 1977

    Article  MATH  Google Scholar 

  19. Rui, Y., and Chen, Y., Better proposal distributions: Object tracking using unscented particle filter. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Vol. 2, pp. 786–793, 2001.

  20. Shapiro, L. G., Stockman, G. C., Shapiro L. G., and Stockman G., Computer Vision. Englewood Cliffs, NJ: Prentice Hall, 2001.

    Google Scholar 

  21. Sobottka, K., and Pitas, I., Face localization and facial feature extraction based on shape and color information. In: Proceedings of the International Conference on Image Processing, 1996. Vol. 3, pp. 483–486, 1996.

  22. Valin, M., Meunier, J., St-Arnaud, A., and Rousseau, J., Video surveillance of medication intake. In: EMBS ’06: 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2006. pp. 6396–6399, 2006.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guillaume-Alexandre Bilodeau.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bilodeau, GA., Ammouri, S. Monitoring of Medication Intake Using a Camera System. J Med Syst 35, 377–389 (2011). https://doi.org/10.1007/s10916-009-9374-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10916-009-9374-6

Keywords

Navigation